Jul 06 20:03:36.659410 ip-10-0-136-9 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 20:03:36.659419 ip-10-0-136-9 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 20:03:36.659426 ip-10-0-136-9 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 20:03:36.659628 ip-10-0-136-9 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 20:03:46.674184 ip-10-0-136-9 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 20:03:46.674206 ip-10-0-136-9 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ae58d79dde824cdeabdeff8ab932e217 --
Jul 06 20:05:49.267523 ip-10-0-136-9 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.724953    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730870    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730883    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730889    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730894    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730897    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730900    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730903    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:05:49.743013 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730905    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730915    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730918    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730921    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730923    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730926    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730929    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730931    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730934    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730936    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730939    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730941    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730944    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730947    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730949    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730968    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730973    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730976    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730979    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730982    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:05:49.744130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730984    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730987    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730989    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730992    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730995    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.730997    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731000    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731002    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731005    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731010    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731013    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731016    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731020    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731023    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731028    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731030    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731033    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731037    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731040    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731043    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:05:49.744667 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731045    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731048    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731051    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731054    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731056    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731059    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731062    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731065    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731067    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731070    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731073    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731076    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731078    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731081    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731083    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731086    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731088    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731091    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731094    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731096    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:05:49.745229 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731099    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731101    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731104    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731107    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731109    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731114    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731117    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731119    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731122    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731125    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731129    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731131    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731134    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731137    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731139    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731142    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731145    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731148    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731150    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:05:49.745760 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731153    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731155    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731158    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731161    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731163    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731166    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731168    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731171    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731173    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731176    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731178    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731181    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731183    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731893    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731900    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731903    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731906    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731909    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731911    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731915    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:05:49.746293 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731917    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731920    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731923    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731925    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731928    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731930    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731933    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731937    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731939    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731942    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731945    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731947    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731950    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731953    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731955    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731959    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731961    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731964    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731967    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731969    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:05:49.746828 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731972    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731975    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731977    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731980    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731982    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731985    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731988    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731991    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731993    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731996    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.731998    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732001    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732004    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732007    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732009    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732012    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732014    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732017    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732019    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:05:49.747417 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732022    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732025    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732029    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732031    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732034    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732039    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732043    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732046    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732049    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732052    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732055    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732058    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732061    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732064    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732067    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732069    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732072    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732077    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732079    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:05:49.747904 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732082    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732084    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732087    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732089    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732092    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732095    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732097    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732101    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732105    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732108    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732111    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732113    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732116    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732119    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732121    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732123    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732126    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732130    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732133    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732137    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:05:49.748474 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732140    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732143    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732146    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732149    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732152    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732155    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732157    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732160    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732162    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732165    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732169    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732171    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732174    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732177    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732552    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732556    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732559    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732562    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732564    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732579    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:05:49.748982 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732583    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732587    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732591    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732594    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732598    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732601    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732603    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732606    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732609    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732611    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732614    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732617    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732620    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732623    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732625    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732628    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732630    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732633    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732635    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:05:49.749609 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732639    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732641    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732644    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732648    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732651    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732654    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732656    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732659    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732661    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732664    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732667    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732670    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732673    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732676    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732679    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732682    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732684    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732687    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732689    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732693    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:05:49.750098 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732696    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732698    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732701    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732703    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732706    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732709    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732711    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732714    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732716    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732719    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732721    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732724    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732726    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732729    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732732    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732736    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732739    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732741    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732744    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732746    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:05:49.750676 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732749    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732751    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732754    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732756    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732759    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732761    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732766    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732769    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732772    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732774    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732777    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732780    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732783    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732785    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732788    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732790    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732793    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732795    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732798    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732801    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732803    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:05:49.751179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732806    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732808    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732811    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732813    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732816    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732818    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732822    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732824    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732827    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732830    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732832    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732835    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.732838    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732911    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732925    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732931    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732935    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732939    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732943    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732947    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732951    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 20:05:49.751809 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732955    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732959    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732963    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732966    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732970    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732972    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732975    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732978    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732981    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732984    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732988    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732991    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732994    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.732997    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733000    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733004    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733007    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733011    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733015    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733018    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733021    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733024    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733027    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733030    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 20:05:49.903389 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733034    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 20:05:49.810152 ip-10-0-136-9 systemd[1]: Started Kubernetes Kubelet.
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733037    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733039    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733042    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733045    2582 flags.go:64] FLAG: --enable-server="true"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733048    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733053    2582 flags.go:64] FLAG: --event-burst="100"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733056    2582 flags.go:64] FLAG: --event-qps="50"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733059    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733080    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733084    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733088    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733092    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733095    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733098    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733101    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733104    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733107    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733110    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733113    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733116    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733118    2582 flags.go:64] FLAG: --feature-gates=""
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733134    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733138    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733142    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 20:05:49.904549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733147    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733150    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733153    2582 flags.go:64] FLAG: --help="false"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733156    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-136-9.ec2.internal"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733159    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733162    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733165    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733168    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733171    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733174    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733177    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733179    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733183    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733186    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733189    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733192    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733197    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733199    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733202    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733205    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733208    2582 flags.go:64] FLAG: --lock-file=""
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733210    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733213    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733216    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 20:05:49.905571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733222    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733224    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733227    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733230    2582 flags.go:64] FLAG: --logging-format="text"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733232    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733235    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733238    2582 flags.go:64] FLAG: --manifest-url=""
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733255    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733261    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733264    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733268    2582 flags.go:64] FLAG: --max-pods="110"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733271    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733274    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733277    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733280    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733283    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733286    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733289    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733296    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733299    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733302    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733305    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733308    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 20:05:49.906334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733314    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733318    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733321    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733324    2582 flags.go:64] FLAG: --port="10250"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733327    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733330    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0347cddd473c2c6e9"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733333    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733336    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733339    2582 flags.go:64] FLAG: --register-node="true"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733342    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733345    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733348    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733351    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733354    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733358    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733361    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733363    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733366    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733370    2582 flags.go:64] FLAG: --runonce="false"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733373    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733376    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733379    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733382    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733385    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733388    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733391    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 20:05:50.990647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733394    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733396    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733399    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733402    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733405    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733408    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733410    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733415    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733421    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733424    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733426    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733431    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733434    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733437    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733440    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733443    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733445    2582 flags.go:64] FLAG: --v="2"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733449    2582 flags.go:64] FLAG: --version="false"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733453    2582 flags.go:64] FLAG: --vmodule=""
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733456    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.733459    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733574    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733578    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733581    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:05:50.991836 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733586    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733589    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733591    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733594    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733597    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733600    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733602    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733605    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733607    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733610    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733613    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733615    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733618    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733620    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733623    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733627    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733630    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733632    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733635    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733638    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:05:51.131025 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733640    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733643    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733646    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733649    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733653    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733655    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733658    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733661    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733663    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733666    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733669    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733673    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733677    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733680    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733683    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733686    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733689    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733692    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733695    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:05:51.131914 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733697    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733700    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733703    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733705    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733708    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733710    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733713    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733717    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733721    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733724    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733728    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733731    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733733    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733736    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733740    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733742    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733745    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733747    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733750    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733753    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:05:51.132777 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733755    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733758    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733760    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733763    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733765    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733769    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733772    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733775    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733777    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733780    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733783    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733785    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733788    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733790    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733793    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733795    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733798    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733800    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733803    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733805    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:05:51.133601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733809    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733812    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733814    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733818    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733821    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733823    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733826    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733828    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733831    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733833    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733836    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733838    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733841    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733843    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733846    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733848    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:05:51.134220 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.733851    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.734506    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.745027    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.745044    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.745064    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.745070    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745141    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745147    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745151    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745154    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745156    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745159    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745162    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745165    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:05:51.134831 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745169    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745173    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745177    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745180    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745183    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745186    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745190    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745193    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745196    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745199    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745201    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745204    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745207    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745209    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745212    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745214    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745217    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745220    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745222    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:05:51.135561 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745224    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745232    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745235    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745238    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745255    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745259    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745262    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745265    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745267    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745270    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745272    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745275    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745278    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745280    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745283    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745285    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745288    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745291    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745293    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745296    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:05:51.136152 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745298    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745301    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745305    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745308    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745311    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745314    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745317    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745320    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745323    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745326    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745328    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745331    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745333    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745336    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745339    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745342    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745345    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745347    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745350    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:05:51.136784 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745352    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745354    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745357    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745359    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745362    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745365    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745368    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745370    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745373    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745376    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745378    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745381    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745384    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745387    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745390    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745392    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745395    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745397    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745400    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745402    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:05:51.137426 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745405    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745408    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745410    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745413    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745415    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745418    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745420    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745423    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745425    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745428    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745431    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745434    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745436    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.745441    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745561    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 20:05:51.138033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745567    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745570    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745573    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745576    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745580    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745583    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745585    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745588    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745591    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745595    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745599    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745602    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745605    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745608    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745610    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745613    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745615    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745618    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745620    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745623    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 20:05:51.138636 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745626    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745629    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745632    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745634    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745637    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745639    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745643    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745646    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745649    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745651    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745654    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745656    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745660    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745664    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745667    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745670    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745673    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745676    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745679    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 20:05:51.139440 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745682    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745684    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745689    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745692    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745694    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745698    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745701    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745703    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745706    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745709    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745711    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745714    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745716    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745719    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745722    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745724    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745727    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745729    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745732    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745735    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 20:05:51.140031 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745738    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745742    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745745    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745748    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745751    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745753    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745756    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745758    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745761    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745764    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745766    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745770    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745774    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745777    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745780    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745783    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745786    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745789    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745793    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745795    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 20:05:51.140594 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745798    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745800    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745803    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745805    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745808    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745810    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745813    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745815    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745818    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745821    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745823    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745827    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745829    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745832    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745834    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745837    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745840    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745842    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 20:05:51.141155 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:49.745845    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.745849    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.745961    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.748040    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.750504    2582 server.go:1019] "Starting client certificate rotation"
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.750608    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.750642    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.754065    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.758213    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.768687    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.776306    2582 log.go:25] "Validated CRI v1 image API"
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.777202    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 20:05:51.141656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.779831    2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 806de104-776e-4b73-aa10-9a5b0cf42d28:/dev/nvme0n1p3 c420dfb5-135d-46e7-bb8b-e888d0581dcd:/dev/nvme0n1p4]
Jul 06 20:05:51.142038 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.779847    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 20:05:51.142108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.787532    2582 manager.go:216] Machine: {Timestamp:2026-07-06 20:05:49.786200976 +0000 UTC m=+0.393571081 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100119 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec243148f4c94ef20d6b4672b1994554 SystemUUID:ec243148-f4c9-4ef2-0d6b-4672b1994554 BootID:ae58d79d-de82-4cde-abde-ff8ab932e217 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a2:74:f6:32:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a2:74:f6:32:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:a6:fe:43:e1:3a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 20:05:51.142108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.787630    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 20:05:51.142108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.787740    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 20:05:51.142108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.791098    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 20:05:51.142108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.791131    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-9.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 20:05:51.142108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.792066    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 20:05:51.142108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.792078    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 20:05:51.142108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.792085    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.792681    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.793346    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.793978    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.797604    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.797745    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.797778    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.797796    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.797809    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.797823    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.797842    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.798237    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.798276    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.802233    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.804025    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.804052    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805179    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805193    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805199    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805204    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805214    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805223    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805368    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805374    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805382    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805388    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805397    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.805405    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.806098    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.806108    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.809194    2582 server.go:1268] "Started kubelet"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.809349    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.809432    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.810012    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.811111    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.811583    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:49.814356    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.818623    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:49.818962    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.818940    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.819354    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.819423    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.819437    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.819587    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.819597    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 20:05:51.142438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.819966    2582 factory.go:153] Registering CRI-O factory
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.819990    2582 factory.go:223] Registration of the crio container factory successfully
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.820040    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.820047    2582 factory.go:55] Registering systemd factory
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.820052    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.820067    2582 factory.go:103] Registering Raw factory
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.820076    2582 manager.go:1196] Started watching for new ooms in manager
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.820550    2582 manager.go:349] Starting recovery of all containers
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:49.823035    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:49.823037    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:49.823339    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:49.823391    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.824499    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-9.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:49.823462    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-9.ec2.internal.18bfcc10c20cd502  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-9.ec2.internal,UID:ip-10-0-136-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-9.ec2.internal,},FirstTimestamp:2026-07-06 20:05:49.809169666 +0000 UTC m=+0.416539769,LastTimestamp:2026-07-06 20:05:49.809169666 +0000 UTC m=+0.416539769,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-9.ec2.internal,}"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.833994    2582 manager.go:354] Recovery completed
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.839006    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.841258    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vqvqp"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.841772    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.841796    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.841805    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.842305    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.842317    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.842328    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.842336    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.842943    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.842965    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.842975    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:05:51.143898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.843546    2582 policy_none.go:49] "None policy: Start"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.843558    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.843585    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.844497    2582 policy_none.go:47] "Start"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.850214    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vqvqp"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:49.852755    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-9.ec2.internal.18bfcc10c3fe7526  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-9.ec2.internal,UID:ip-10-0-136-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-9.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-9.ec2.internal,},FirstTimestamp:2026-07-06 20:05:49.841782054 +0000 UTC m=+0.449152158,LastTimestamp:2026-07-06 20:05:49.841782054 +0000 UTC m=+0.449152158,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-9.ec2.internal,}"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.868832    2582 manager.go:337] "Starting Device Plugin manager"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:49.868860    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.868870    2582 server.go:87] "Starting device plugin registration server"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.869128    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.869140    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.869353    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.869422    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:49.869430    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:49.874775    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:49.874826    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.035963    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.039903    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.039940    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.039955    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.039990    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.057843    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.059290    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.059336    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.059367    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.059420    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.060572    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.060597    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-9.ec2.internal\": node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.063231    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 20:05:51.144688 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.109481    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.160147    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"]
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.160249    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.161975    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.162001    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.162010    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.163257    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.163421    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.163445    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.163893    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.163916    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.163930    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.163976    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.163993    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.164006    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.165111    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.165134    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.165768    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.165795    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.165805    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.187852    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3fea1585bfc77c4bc4a27ad8e69f0753-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"3fea1585bfc77c4bc4a27ad8e69f0753\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.187875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fea1585bfc77c4bc4a27ad8e69f0753-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"3fea1585bfc77c4bc4a27ad8e69f0753\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.187910    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a1ef2ca68729a3e6662bb61abe38ed8a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-9.ec2.internal\" (UID: \"a1ef2ca68729a3e6662bb61abe38ed8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.200808    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-9.ec2.internal\" not found" node="ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.205041    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-9.ec2.internal\" not found" node="ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.322941 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.210080    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.324119 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.288862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3fea1585bfc77c4bc4a27ad8e69f0753-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"3fea1585bfc77c4bc4a27ad8e69f0753\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.324119 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.288899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fea1585bfc77c4bc4a27ad8e69f0753-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"3fea1585bfc77c4bc4a27ad8e69f0753\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.324119 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.288923    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a1ef2ca68729a3e6662bb61abe38ed8a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-9.ec2.internal\" (UID: \"a1ef2ca68729a3e6662bb61abe38ed8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.324119 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.288956    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a1ef2ca68729a3e6662bb61abe38ed8a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-9.ec2.internal\" (UID: \"a1ef2ca68729a3e6662bb61abe38ed8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.324119 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.288959    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fea1585bfc77c4bc4a27ad8e69f0753-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"3fea1585bfc77c4bc4a27ad8e69f0753\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.324119 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.288959    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3fea1585bfc77c4bc4a27ad8e69f0753-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"3fea1585bfc77c4bc4a27ad8e69f0753\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.324119 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.310170    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.525072 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.410812    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.525072 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.504444    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.525072 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.508242    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:51.525072 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.511456    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.738029 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.612468    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.738029 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.712932    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.921287 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.813469    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.921287 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.814558    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 20:05:51.921287 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.814741    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 20:05:51.921287 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.887195    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 20:05:51.921287 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:51.914418    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:51.921287 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.918404    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:00:50 +0000 UTC" deadline="2028-02-06 18:05:41.938301306 +0000 UTC"
Jul 06 20:05:51.921287 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.918434    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13917h59m50.019871424s"
Jul 06 20:05:52.060936 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.924959    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 20:05:52.060936 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.926063    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 20:05:52.060936 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.926090    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 20:05:52.060936 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:51.926099    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 06 20:05:52.060936 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:52.015467    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:52.220177 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:52.077138    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fea1585bfc77c4bc4a27ad8e69f0753.slice/crio-475bf53f7889556d2c619ce21764e4735e6dc58a289661a4b600f1503e2020e9 WatchSource:0}: Error finding container 475bf53f7889556d2c619ce21764e4735e6dc58a289661a4b600f1503e2020e9: Status 404 returned error can't find the container with id 475bf53f7889556d2c619ce21764e4735e6dc58a289661a4b600f1503e2020e9
Jul 06 20:05:52.220177 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:52.077639    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ef2ca68729a3e6662bb61abe38ed8a.slice/crio-40c4e6924d61bd2763c6d8817fadd415ab1cb8ad61d27e2c3268dfca3e219cb2 WatchSource:0}: Error finding container 40c4e6924d61bd2763c6d8817fadd415ab1cb8ad61d27e2c3268dfca3e219cb2: Status 404 returned error can't find the container with id 40c4e6924d61bd2763c6d8817fadd415ab1cb8ad61d27e2c3268dfca3e219cb2
Jul 06 20:05:52.220177 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.087915    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:05:52.220177 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:52.115557    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:52.220177 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.155010    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 20:05:52.220177 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:52.216168    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 06 20:05:52.352129 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.235471    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 20:05:52.352129 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.285905    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:52.352129 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.310970    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 20:05:52.352129 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.312267    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 06 20:05:52.352129 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.323616    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.864130    2582 apiserver.go:52] "Watching apiserver"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.873502    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.873927    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-rcrxc","kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89","openshift-dns/node-resolver-6l7s4","openshift-multus/multus-additional-cni-plugins-9zlfc","openshift-multus/network-metrics-daemon-thz5p","openshift-network-operator/iptables-alerter-hkn28","openshift-ovn-kubernetes/ovnkube-node-5gqht","kube-system/global-pull-secret-syncer-wsxpw","kube-system/konnectivity-agent-mhlr9","openshift-cluster-node-tuning-operator/tuned-r2brh","openshift-image-registry/node-ca-bxbv8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal","openshift-multus/multus-8mc4j"]
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.875879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hkn28"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.877299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.878686    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.879696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6l7s4"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.880371    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.880668    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.880867    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.880886    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.881081    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.881114    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d9v86\""
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.881272    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.881319    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g847p\""
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.881376    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.881519    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.881694    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2dt99\""
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.881892    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.882084    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:52.882126    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.883486    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:52.883540    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.884611    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.938999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.885863    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.886280    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.887255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.888744    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:52.888807    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.889932    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxbv8"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-slash\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-run-openvswitch\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-run-ovn\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898621    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-kubernetes\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898671    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/818182a4-4f0a-4550-b386-2ecf302c2dce-cni-binary-copy\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898696    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp4lg\" (UniqueName: \"kubernetes.io/projected/818182a4-4f0a-4550-b386-2ecf302c2dce-kube-api-access-gp4lg\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-run\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898726    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-lib-modules\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-socket-dir-parent\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898782    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-hostroot\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.940368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-daemon-config\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-sysctl-d\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898848    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-system-cni-dir\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-sys-fs\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898866    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-modprobe-d\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898890    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-systemd\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898918    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898959    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898919    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.898923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-sys\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899041    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-conf-dir\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7-iptables-alerter-script\") pod \"iptables-alerter-hkn28\" (UID: \"3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7\") " pod="openshift-network-operator/iptables-alerter-hkn28"
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899091    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899104    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-etc-openvswitch\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899124    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-cni-bin\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.943254 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rg89\" (UniqueName: \"kubernetes.io/projected/bfca2d36-fdc6-4f7e-8078-735f6241ee00-kube-api-access-5rg89\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/17d4f092-7b09-45ef-8131-fb1024022a7c-hosts-file\") pod \"node-resolver-6l7s4\" (UID: \"17d4f092-7b09-45ef-8131-fb1024022a7c\") " pod="openshift-dns/node-resolver-6l7s4"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-os-release\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899248    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6cffdb3-f577-42bc-abf6-4bf50fb66414-cni-binary-copy\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-run-systemd\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899297    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899300    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b790fa8-3aa5-42d0-822d-1985b5526b53-ovn-node-metrics-cert\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-var-lib-kubelet\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899435    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17d4f092-7b09-45ef-8131-fb1024022a7c-tmp-dir\") pod \"node-resolver-6l7s4\" (UID: \"17d4f092-7b09-45ef-8131-fb1024022a7c\") " pod="openshift-dns/node-resolver-6l7s4"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-cni-dir\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-var-lib-cni-multus\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899508    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-cnibin\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:52.943921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7078019-dd34-434c-81b1-bf5685ff76ed-dbus\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899570    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-kubelet\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-var-lib-openvswitch\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slgzk\" (UniqueName: \"kubernetes.io/projected/6b790fa8-3aa5-42d0-822d-1985b5526b53-kube-api-access-slgzk\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-sysctl-conf\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899648    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-run-k8s-cni-cncf-io\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-socket-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b790fa8-3aa5-42d0-822d-1985b5526b53-env-overrides\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-log-socket\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-run-ovn-kubernetes\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kj8g\" (UniqueName: \"kubernetes.io/projected/3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7-kube-api-access-5kj8g\") pod \"iptables-alerter-hkn28\" (UID: \"3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7\") " pod="openshift-network-operator/iptables-alerter-hkn28"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cgs2\" (UniqueName: \"kubernetes.io/projected/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-kube-api-access-6cgs2\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899785    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:52.946164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-systemd-units\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899828    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-etc-kubernetes\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-registration-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c6cffdb3-f577-42bc-abf6-4bf50fb66414-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.899962    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b790fa8-3aa5-42d0-822d-1985b5526b53-ovnkube-config\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-host\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-var-lib-kubelet\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-cni-netd\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7078019-dd34-434c-81b1-bf5685ff76ed-kubelet-config\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900133    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfca2d36-fdc6-4f7e-8078-735f6241ee00-tmp\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nzdk\" (UniqueName: \"kubernetes.io/projected/17d4f092-7b09-45ef-8131-fb1024022a7c-kube-api-access-7nzdk\") pod \"node-resolver-6l7s4\" (UID: \"17d4f092-7b09-45ef-8131-fb1024022a7c\") " pod="openshift-dns/node-resolver-6l7s4"
Jul 06 20:05:52.946857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900165    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900176    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-var-lib-cni-bin\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-device-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900218    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900235    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900236    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7-host-slash\") pod \"iptables-alerter-hkn28\" (UID: \"3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7\") " pod="openshift-network-operator/iptables-alerter-hkn28"
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqwbf\" (UniqueName: \"kubernetes.io/projected/c6cffdb3-f577-42bc-abf6-4bf50fb66414-kube-api-access-tqwbf\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900338    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900391    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-sysconfig\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-tuned\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900419    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2fsmw\""
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900438    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-run-multus-certs\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900480    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdsvh\" (UniqueName: \"kubernetes.io/projected/e26f4f5f-2217-4906-aab7-9889ef8983a6-kube-api-access-jdsvh\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900528    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-os-release\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c6cffdb3-f577-42bc-abf6-4bf50fb66414-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:52.948609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900587    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900585    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-run-netns\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900631    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-node-log\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-cnibin\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900669    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-run-netns\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900693    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-system-cni-dir\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b790fa8-3aa5-42d0-822d-1985b5526b53-ovnkube-script-lib\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900760    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-glx27\""
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.900771    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.902077    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.902253    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.902478    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nlvmv\""
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.906273    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xr74p\""
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.908697    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7pxfd\""
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.908704    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.911943    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wf7sp\""
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.918907    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 20:05:52.949314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.946838    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h6kd2"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.967732    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h6kd2"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:52.992162    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c6cffdb3-f577-42bc-abf6-4bf50fb66414-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b790fa8-3aa5-42d0-822d-1985b5526b53-ovnkube-config\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-host\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-var-lib-kubelet\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001779    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-var-lib-kubelet\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75740867-2cfc-477f-864f-ef0357a87bfc-konnectivity-ca\") pod \"konnectivity-agent-mhlr9\" (UID: \"75740867-2cfc-477f-864f-ef0357a87bfc\") " pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001824    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-host\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-cni-netd\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001864    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-cni-netd\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001877    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27f9059b-2e69-457b-9fbf-17b8bb36e010-host\") pod \"node-ca-bxbv8\" (UID: \"27f9059b-2e69-457b-9fbf-17b8bb36e010\") " pod="openshift-image-registry/node-ca-bxbv8"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7078019-dd34-434c-81b1-bf5685ff76ed-kubelet-config\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfca2d36-fdc6-4f7e-8078-735f6241ee00-tmp\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.037170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.001983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nzdk\" (UniqueName: \"kubernetes.io/projected/17d4f092-7b09-45ef-8131-fb1024022a7c-kube-api-access-7nzdk\") pod \"node-resolver-6l7s4\" (UID: \"17d4f092-7b09-45ef-8131-fb1024022a7c\") " pod="openshift-dns/node-resolver-6l7s4"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.002004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-var-lib-cni-bin\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.002026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-device-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.002049    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7-host-slash\") pod \"iptables-alerter-hkn28\" (UID: \"3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7\") " pod="openshift-network-operator/iptables-alerter-hkn28"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.002070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqwbf\" (UniqueName: \"kubernetes.io/projected/c6cffdb3-f577-42bc-abf6-4bf50fb66414-kube-api-access-tqwbf\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.002095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75740867-2cfc-477f-864f-ef0357a87bfc-agent-certs\") pod \"konnectivity-agent-mhlr9\" (UID: \"75740867-2cfc-477f-864f-ef0357a87bfc\") " pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.002117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-sysconfig\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.002138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-tuned\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.002158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-run-multus-certs\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.002184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdsvh\" (UniqueName: \"kubernetes.io/projected/e26f4f5f-2217-4906-aab7-9889ef8983a6-kube-api-access-jdsvh\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.004776    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-device-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.004791    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-os-release\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.004843    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-sysconfig\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.004843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c6cffdb3-f577-42bc-abf6-4bf50fb66414-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.038034 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.002185    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b790fa8-3aa5-42d0-822d-1985b5526b53-ovnkube-config\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.002198    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c6cffdb3-f577-42bc-abf6-4bf50fb66414-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.004995    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7078019-dd34-434c-81b1-bf5685ff76ed-kubelet-config\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005004    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7-host-slash\") pod \"iptables-alerter-hkn28\" (UID: \"3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7\") " pod="openshift-network-operator/iptables-alerter-hkn28"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27f9059b-2e69-457b-9fbf-17b8bb36e010-serviceca\") pod \"node-ca-bxbv8\" (UID: \"27f9059b-2e69-457b-9fbf-17b8bb36e010\") " pod="openshift-image-registry/node-ca-bxbv8"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005110    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-run-multus-certs\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005129    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-run-netns\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005155    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-node-log\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-cnibin\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005189    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-var-lib-cni-bin\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-run-netns\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-system-cni-dir\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005287    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-os-release\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.005295    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b790fa8-3aa5-42d0-822d-1985b5526b53-ovnkube-script-lib\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.040231 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005339    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-node-log\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.005399    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs podName:07d190c2-2d5c-4c50-9e18-56b25a2d5ada nodeName:}" failed. No retries permitted until 2026-07-06 20:05:53.505372946 +0000 UTC m=+3.046783917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs") pod "network-metrics-daemon-thz5p" (UID: "07d190c2-2d5c-4c50-9e18-56b25a2d5ada") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005403    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-slash\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005404    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005457    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-cnibin\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005486    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-system-cni-dir\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005517    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-run-netns\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005567    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-run-netns\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005581    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c6cffdb3-f577-42bc-abf6-4bf50fb66414-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-slash\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-run-openvswitch\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-run-ovn\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-kubernetes\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/818182a4-4f0a-4550-b386-2ecf302c2dce-cni-binary-copy\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.040882 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp4lg\" (UniqueName: \"kubernetes.io/projected/818182a4-4f0a-4550-b386-2ecf302c2dce-kube-api-access-gp4lg\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-run\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-lib-modules\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005940    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b790fa8-3aa5-42d0-822d-1985b5526b53-ovnkube-script-lib\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.005969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-socket-dir-parent\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006037    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-run-openvswitch\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006082    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-run-ovn\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006100    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-socket-dir-parent\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006139    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-kubernetes\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006225    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-run\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006398    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-lib-modules\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-hostroot\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-daemon-config\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-sysctl-d\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-system-cni-dir\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-sys-fs\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006602    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/818182a4-4f0a-4550-b386-2ecf302c2dce-cni-binary-copy\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-modprobe-d\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006665    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-systemd\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006704    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-hostroot\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006730    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-sys\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006739    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-sysctl-d\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006744    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-modprobe-d\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006775    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-system-cni-dir\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006779    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-conf-dir\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006801    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-sys-fs\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.006805    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-sys\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007220    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-daemon-config\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007290    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-conf-dir\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007334    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7-iptables-alerter-script\") pod \"iptables-alerter-hkn28\" (UID: \"3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7\") " pod="openshift-network-operator/iptables-alerter-hkn28"
Jul 06 20:05:53.043715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-etc-openvswitch\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007378    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-systemd\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-cni-bin\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rg89\" (UniqueName: \"kubernetes.io/projected/bfca2d36-fdc6-4f7e-8078-735f6241ee00-kube-api-access-5rg89\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/17d4f092-7b09-45ef-8131-fb1024022a7c-hosts-file\") pod \"node-resolver-6l7s4\" (UID: \"17d4f092-7b09-45ef-8131-fb1024022a7c\") " pod="openshift-dns/node-resolver-6l7s4"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007492    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-os-release\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6cffdb3-f577-42bc-abf6-4bf50fb66414-cni-binary-copy\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9wm4\" (UniqueName: \"kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4\") pod \"network-check-target-rcrxc\" (UID: \"6cbd9b58-6895-4378-95dc-7541b9cab4b0\") " pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-run-systemd\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007652    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b790fa8-3aa5-42d0-822d-1985b5526b53-ovn-node-metrics-cert\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-var-lib-kubelet\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17d4f092-7b09-45ef-8131-fb1024022a7c-tmp-dir\") pod \"node-resolver-6l7s4\" (UID: \"17d4f092-7b09-45ef-8131-fb1024022a7c\") " pod="openshift-dns/node-resolver-6l7s4"
Jul 06 20:05:53.132040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-cni-dir\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-var-lib-cni-multus\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-cnibin\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007925    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-etc-openvswitch\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfcb2\" (UniqueName: \"kubernetes.io/projected/27f9059b-2e69-457b-9fbf-17b8bb36e010-kube-api-access-mfcb2\") pod \"node-ca-bxbv8\" (UID: \"27f9059b-2e69-457b-9fbf-17b8bb36e010\") " pod="openshift-image-registry/node-ca-bxbv8"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7078019-dd34-434c-81b1-bf5685ff76ed-dbus\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007978    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-cni-bin\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008002    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-kubelet\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-var-lib-openvswitch\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slgzk\" (UniqueName: \"kubernetes.io/projected/6b790fa8-3aa5-42d0-822d-1985b5526b53-kube-api-access-slgzk\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-sysctl-conf\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-run-k8s-cni-cncf-io\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-socket-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b790fa8-3aa5-42d0-822d-1985b5526b53-env-overrides\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.132601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-log-socket\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-run-ovn-kubernetes\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kj8g\" (UniqueName: \"kubernetes.io/projected/3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7-kube-api-access-5kj8g\") pod \"iptables-alerter-hkn28\" (UID: \"3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7\") " pod="openshift-network-operator/iptables-alerter-hkn28"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cgs2\" (UniqueName: \"kubernetes.io/projected/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-kube-api-access-6cgs2\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008393    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-systemd-units\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008444    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6cffdb3-f577-42bc-abf6-4bf50fb66414-cni-binary-copy\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-etc-kubernetes\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008586    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-run-k8s-cni-cncf-io\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008592    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-run-systemd\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008599    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-log-socket\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008643    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-var-lib-openvswitch\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.007868    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7-iptables-alerter-script\") pod \"iptables-alerter-hkn28\" (UID: \"3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7\") " pod="openshift-network-operator/iptables-alerter-hkn28"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008667    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-etc-kubernetes\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.133079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008733    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-multus-cni-dir\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008746    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-var-lib-kubelet\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.008803    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008809    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-host-var-lib-cni-multus\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008819    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-socket-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.008864    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret podName:d7078019-dd34-434c-81b1-bf5685ff76ed nodeName:}" failed. No retries permitted until 2026-07-06 20:05:53.508846598 +0000 UTC m=+3.050257575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret") pod "global-pull-secret-syncer-wsxpw" (UID: "d7078019-dd34-434c-81b1-bf5685ff76ed") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008885    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-cnibin\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008915    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-systemd-units\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008941    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7078019-dd34-434c-81b1-bf5685ff76ed-dbus\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.008982    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/818182a4-4f0a-4550-b386-2ecf302c2dce-os-release\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-registration-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009129    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b790fa8-3aa5-42d0-822d-1985b5526b53-env-overrides\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009135    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17d4f092-7b09-45ef-8131-fb1024022a7c-tmp-dir\") pod \"node-resolver-6l7s4\" (UID: \"17d4f092-7b09-45ef-8131-fb1024022a7c\") " pod="openshift-dns/node-resolver-6l7s4"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.133700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009151    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-run-ovn-kubernetes\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009244    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-registration-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009280    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009374    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-kubelet\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009375    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-sysctl-conf\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009391    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6cffdb3-f577-42bc-abf6-4bf50fb66414-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009394    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/17d4f092-7b09-45ef-8131-fb1024022a7c-hosts-file\") pod \"node-resolver-6l7s4\" (UID: \"17d4f092-7b09-45ef-8131-fb1024022a7c\") " pod="openshift-dns/node-resolver-6l7s4"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009433    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e26f4f5f-2217-4906-aab7-9889ef8983a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.009475    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b790fa8-3aa5-42d0-822d-1985b5526b53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.011123    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfca2d36-fdc6-4f7e-8078-735f6241ee00-tmp\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.011283    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bfca2d36-fdc6-4f7e-8078-735f6241ee00-etc-tuned\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.011367    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b790fa8-3aa5-42d0-822d-1985b5526b53-ovn-node-metrics-cert\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.017114    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp4lg\" (UniqueName: \"kubernetes.io/projected/818182a4-4f0a-4550-b386-2ecf302c2dce-kube-api-access-gp4lg\") pod \"multus-8mc4j\" (UID: \"818182a4-4f0a-4550-b386-2ecf302c2dce\") " pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.134264 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.017255    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqwbf\" (UniqueName: \"kubernetes.io/projected/c6cffdb3-f577-42bc-abf6-4bf50fb66414-kube-api-access-tqwbf\") pod \"multus-additional-cni-plugins-9zlfc\" (UID: \"c6cffdb3-f577-42bc-abf6-4bf50fb66414\") " pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.019927    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdsvh\" (UniqueName: \"kubernetes.io/projected/e26f4f5f-2217-4906-aab7-9889ef8983a6-kube-api-access-jdsvh\") pod \"aws-ebs-csi-driver-node-pdn89\" (UID: \"e26f4f5f-2217-4906-aab7-9889ef8983a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.020566    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nzdk\" (UniqueName: \"kubernetes.io/projected/17d4f092-7b09-45ef-8131-fb1024022a7c-kube-api-access-7nzdk\") pod \"node-resolver-6l7s4\" (UID: \"17d4f092-7b09-45ef-8131-fb1024022a7c\") " pod="openshift-dns/node-resolver-6l7s4"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.020679    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kj8g\" (UniqueName: \"kubernetes.io/projected/3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7-kube-api-access-5kj8g\") pod \"iptables-alerter-hkn28\" (UID: \"3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7\") " pod="openshift-network-operator/iptables-alerter-hkn28"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.021250    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slgzk\" (UniqueName: \"kubernetes.io/projected/6b790fa8-3aa5-42d0-822d-1985b5526b53-kube-api-access-slgzk\") pod \"ovnkube-node-5gqht\" (UID: \"6b790fa8-3aa5-42d0-822d-1985b5526b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.021298    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rg89\" (UniqueName: \"kubernetes.io/projected/bfca2d36-fdc6-4f7e-8078-735f6241ee00-kube-api-access-5rg89\") pod \"tuned-r2brh\" (UID: \"bfca2d36-fdc6-4f7e-8078-735f6241ee00\") " pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.022994    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cgs2\" (UniqueName: \"kubernetes.io/projected/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-kube-api-access-6cgs2\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.064342    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" event={"ID":"a1ef2ca68729a3e6662bb61abe38ed8a","Type":"ContainerStarted","Data":"40c4e6924d61bd2763c6d8817fadd415ab1cb8ad61d27e2c3268dfca3e219cb2"}
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.065442    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" event={"ID":"3fea1585bfc77c4bc4a27ad8e69f0753","Type":"ContainerStarted","Data":"475bf53f7889556d2c619ce21764e4735e6dc58a289661a4b600f1503e2020e9"}
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.110062    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75740867-2cfc-477f-864f-ef0357a87bfc-konnectivity-ca\") pod \"konnectivity-agent-mhlr9\" (UID: \"75740867-2cfc-477f-864f-ef0357a87bfc\") " pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.110089    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27f9059b-2e69-457b-9fbf-17b8bb36e010-host\") pod \"node-ca-bxbv8\" (UID: \"27f9059b-2e69-457b-9fbf-17b8bb36e010\") " pod="openshift-image-registry/node-ca-bxbv8"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.110119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75740867-2cfc-477f-864f-ef0357a87bfc-agent-certs\") pod \"konnectivity-agent-mhlr9\" (UID: \"75740867-2cfc-477f-864f-ef0357a87bfc\") " pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.110136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27f9059b-2e69-457b-9fbf-17b8bb36e010-serviceca\") pod \"node-ca-bxbv8\" (UID: \"27f9059b-2e69-457b-9fbf-17b8bb36e010\") " pod="openshift-image-registry/node-ca-bxbv8"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.110169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wm4\" (UniqueName: \"kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4\") pod \"network-check-target-rcrxc\" (UID: \"6cbd9b58-6895-4378-95dc-7541b9cab4b0\") " pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.110184    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27f9059b-2e69-457b-9fbf-17b8bb36e010-host\") pod \"node-ca-bxbv8\" (UID: \"27f9059b-2e69-457b-9fbf-17b8bb36e010\") " pod="openshift-image-registry/node-ca-bxbv8"
Jul 06 20:05:53.134850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.110235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfcb2\" (UniqueName: \"kubernetes.io/projected/27f9059b-2e69-457b-9fbf-17b8bb36e010-kube-api-access-mfcb2\") pod \"node-ca-bxbv8\" (UID: \"27f9059b-2e69-457b-9fbf-17b8bb36e010\") " pod="openshift-image-registry/node-ca-bxbv8"
Jul 06 20:05:53.135591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.110644    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27f9059b-2e69-457b-9fbf-17b8bb36e010-serviceca\") pod \"node-ca-bxbv8\" (UID: \"27f9059b-2e69-457b-9fbf-17b8bb36e010\") " pod="openshift-image-registry/node-ca-bxbv8"
Jul 06 20:05:53.135591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.111362    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/75740867-2cfc-477f-864f-ef0357a87bfc-konnectivity-ca\") pod \"konnectivity-agent-mhlr9\" (UID: \"75740867-2cfc-477f-864f-ef0357a87bfc\") " pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:05:53.135591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.115153    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 20:05:53.135591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.120543    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/75740867-2cfc-477f-864f-ef0357a87bfc-agent-certs\") pod \"konnectivity-agent-mhlr9\" (UID: \"75740867-2cfc-477f-864f-ef0357a87bfc\") " pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:05:53.135591 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.122567    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:05:53.135591 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.122589    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:05:53.135591 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.122606    2582 projected.go:196] Error preparing data for projected volume kube-api-access-f9wm4 for pod openshift-network-diagnostics/network-check-target-rcrxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:05:53.135591 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.122684    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4 podName:6cbd9b58-6895-4378-95dc-7541b9cab4b0 nodeName:}" failed. No retries permitted until 2026-07-06 20:05:53.622666489 +0000 UTC m=+3.164077475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f9wm4" (UniqueName: "kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4") pod "network-check-target-rcrxc" (UID: "6cbd9b58-6895-4378-95dc-7541b9cab4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:05:53.135591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.123187    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfcb2\" (UniqueName: \"kubernetes.io/projected/27f9059b-2e69-457b-9fbf-17b8bb36e010-kube-api-access-mfcb2\") pod \"node-ca-bxbv8\" (UID: \"27f9059b-2e69-457b-9fbf-17b8bb36e010\") " pod="openshift-image-registry/node-ca-bxbv8"
Jul 06 20:05:53.267055 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.188831    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hkn28"
Jul 06 20:05:53.267055 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.209697    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r2brh"
Jul 06 20:05:53.267055 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.218089    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89"
Jul 06 20:05:53.267055 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.222982    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6l7s4"
Jul 06 20:05:53.267055 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.230149    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9zlfc"
Jul 06 20:05:53.267055 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.244289    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8mc4j"
Jul 06 20:05:53.267055 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.250348    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:05:53.267055 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.264834    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:05:53.267055 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.265890    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxbv8"
Jul 06 20:05:53.365176 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:53.365146    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc8e0ca_03df_4be4_a4a7_05a0c223b8d7.slice/crio-ebca50a0e542f5747ee97d9933ca1bb359d1418d3fd653293f7f173a3c95291e WatchSource:0}: Error finding container ebca50a0e542f5747ee97d9933ca1bb359d1418d3fd653293f7f173a3c95291e: Status 404 returned error can't find the container with id ebca50a0e542f5747ee97d9933ca1bb359d1418d3fd653293f7f173a3c95291e
Jul 06 20:05:53.378509 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:53.378476    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b790fa8_3aa5_42d0_822d_1985b5526b53.slice/crio-cdba69a4af66ace2ee9507000a6b5bd1ab5391f412f4cb12ec0bbab205e916fe WatchSource:0}: Error finding container cdba69a4af66ace2ee9507000a6b5bd1ab5391f412f4cb12ec0bbab205e916fe: Status 404 returned error can't find the container with id cdba69a4af66ace2ee9507000a6b5bd1ab5391f412f4cb12ec0bbab205e916fe
Jul 06 20:05:53.383130 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:53.383097    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d4f092_7b09_45ef_8131_fb1024022a7c.slice/crio-f368b4ffdfd1be53004b9537a94e8abdb0a87aa36f74816812f837612e67c7e7 WatchSource:0}: Error finding container f368b4ffdfd1be53004b9537a94e8abdb0a87aa36f74816812f837612e67c7e7: Status 404 returned error can't find the container with id f368b4ffdfd1be53004b9537a94e8abdb0a87aa36f74816812f837612e67c7e7
Jul 06 20:05:53.384033 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:53.384010    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6cffdb3_f577_42bc_abf6_4bf50fb66414.slice/crio-6709ab99660bc4345051e85237deee78d749139c86c34f1759b32193edfd2526 WatchSource:0}: Error finding container 6709ab99660bc4345051e85237deee78d749139c86c34f1759b32193edfd2526: Status 404 returned error can't find the container with id 6709ab99660bc4345051e85237deee78d749139c86c34f1759b32193edfd2526
Jul 06 20:05:53.385483 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:53.385326    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75740867_2cfc_477f_864f_ef0357a87bfc.slice/crio-949a22e95ceecfab4fa88abedd7cbac78480a4eae23bb042a9603a27c25f42d3 WatchSource:0}: Error finding container 949a22e95ceecfab4fa88abedd7cbac78480a4eae23bb042a9603a27c25f42d3: Status 404 returned error can't find the container with id 949a22e95ceecfab4fa88abedd7cbac78480a4eae23bb042a9603a27c25f42d3
Jul 06 20:05:53.385623 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:53.385599    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818182a4_4f0a_4550_b386_2ecf302c2dce.slice/crio-43f8f3d31627464b3f62f3eaba66aa4b5eedbac402c05cfdf72d75af3f59774d WatchSource:0}: Error finding container 43f8f3d31627464b3f62f3eaba66aa4b5eedbac402c05cfdf72d75af3f59774d: Status 404 returned error can't find the container with id 43f8f3d31627464b3f62f3eaba66aa4b5eedbac402c05cfdf72d75af3f59774d
Jul 06 20:05:53.386632 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:53.386470    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26f4f5f_2217_4906_aab7_9889ef8983a6.slice/crio-6bdeac5d07c35e50e53936f01bd3872f21233336ec0fc17146cddf240d439e6d WatchSource:0}: Error finding container 6bdeac5d07c35e50e53936f01bd3872f21233336ec0fc17146cddf240d439e6d: Status 404 returned error can't find the container with id 6bdeac5d07c35e50e53936f01bd3872f21233336ec0fc17146cddf240d439e6d
Jul 06 20:05:53.387592 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:53.387569    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f9059b_2e69_457b_9fbf_17b8bb36e010.slice/crio-f8a18646a9a16431f425334b808c36f6f7bee3ccf8cfc852cda1f7ea670b2b3c WatchSource:0}: Error finding container f8a18646a9a16431f425334b808c36f6f7bee3ccf8cfc852cda1f7ea670b2b3c: Status 404 returned error can't find the container with id f8a18646a9a16431f425334b808c36f6f7bee3ccf8cfc852cda1f7ea670b2b3c
Jul 06 20:05:53.388848 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:05:53.388699    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfca2d36_fdc6_4f7e_8078_735f6241ee00.slice/crio-0fa4ca415a981b821543d5e46ec0a608bf1585ff9bdfb379142453a60af9e578 WatchSource:0}: Error finding container 0fa4ca415a981b821543d5e46ec0a608bf1585ff9bdfb379142453a60af9e578: Status 404 returned error can't find the container with id 0fa4ca415a981b821543d5e46ec0a608bf1585ff9bdfb379142453a60af9e578
Jul 06 20:05:53.513457 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.513419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:53.513612 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.513473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:53.513612 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.513564    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:05:53.513729 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.513616    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs podName:07d190c2-2d5c-4c50-9e18-56b25a2d5ada nodeName:}" failed. No retries permitted until 2026-07-06 20:05:54.513602667 +0000 UTC m=+4.055013638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs") pod "network-metrics-daemon-thz5p" (UID: "07d190c2-2d5c-4c50-9e18-56b25a2d5ada") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:05:53.513729 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.513564    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:05:53.513729 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.513714    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret podName:d7078019-dd34-434c-81b1-bf5685ff76ed nodeName:}" failed. No retries permitted until 2026-07-06 20:05:54.513699783 +0000 UTC m=+4.055110768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret") pod "global-pull-secret-syncer-wsxpw" (UID: "d7078019-dd34-434c-81b1-bf5685ff76ed") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:05:53.715982 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.715909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wm4\" (UniqueName: \"kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4\") pod \"network-check-target-rcrxc\" (UID: \"6cbd9b58-6895-4378-95dc-7541b9cab4b0\") " pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:05:53.716142 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.716060    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:05:53.716142 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.716080    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:05:53.716142 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.716092    2582 projected.go:196] Error preparing data for projected volume kube-api-access-f9wm4 for pod openshift-network-diagnostics/network-check-target-rcrxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:05:53.716311 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:53.716150    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4 podName:6cbd9b58-6895-4378-95dc-7541b9cab4b0 nodeName:}" failed. No retries permitted until 2026-07-06 20:05:54.71613119 +0000 UTC m=+4.257542162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9wm4" (UniqueName: "kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4") pod "network-check-target-rcrxc" (UID: "6cbd9b58-6895-4378-95dc-7541b9cab4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:05:53.970717 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.970564    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:00:52 +0000 UTC" deadline="2028-01-29 22:35:10.591321758 +0000 UTC"
Jul 06 20:05:53.970717 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:53.970631    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13730h29m16.620694737s"
Jul 06 20:05:54.060173 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.059706    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:54.060173 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:54.059845    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:05:54.074555 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.074514    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89" event={"ID":"e26f4f5f-2217-4906-aab7-9889ef8983a6","Type":"ContainerStarted","Data":"6bdeac5d07c35e50e53936f01bd3872f21233336ec0fc17146cddf240d439e6d"}
Jul 06 20:05:54.078278 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.078173    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8mc4j" event={"ID":"818182a4-4f0a-4550-b386-2ecf302c2dce","Type":"ContainerStarted","Data":"43f8f3d31627464b3f62f3eaba66aa4b5eedbac402c05cfdf72d75af3f59774d"}
Jul 06 20:05:54.085112 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.085070    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mhlr9" event={"ID":"75740867-2cfc-477f-864f-ef0357a87bfc","Type":"ContainerStarted","Data":"949a22e95ceecfab4fa88abedd7cbac78480a4eae23bb042a9603a27c25f42d3"}
Jul 06 20:05:54.086793 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.086726    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zlfc" event={"ID":"c6cffdb3-f577-42bc-abf6-4bf50fb66414","Type":"ContainerStarted","Data":"6709ab99660bc4345051e85237deee78d749139c86c34f1759b32193edfd2526"}
Jul 06 20:05:54.090698 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.090676    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6l7s4" event={"ID":"17d4f092-7b09-45ef-8131-fb1024022a7c","Type":"ContainerStarted","Data":"f368b4ffdfd1be53004b9537a94e8abdb0a87aa36f74816812f837612e67c7e7"}
Jul 06 20:05:54.098379 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.098320    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxbv8" event={"ID":"27f9059b-2e69-457b-9fbf-17b8bb36e010","Type":"ContainerStarted","Data":"f8a18646a9a16431f425334b808c36f6f7bee3ccf8cfc852cda1f7ea670b2b3c"}
Jul 06 20:05:54.106612 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.106588    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht" event={"ID":"6b790fa8-3aa5-42d0-822d-1985b5526b53","Type":"ContainerStarted","Data":"cdba69a4af66ace2ee9507000a6b5bd1ab5391f412f4cb12ec0bbab205e916fe"}
Jul 06 20:05:54.110078 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.110054    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hkn28" event={"ID":"3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7","Type":"ContainerStarted","Data":"ebca50a0e542f5747ee97d9933ca1bb359d1418d3fd653293f7f173a3c95291e"}
Jul 06 20:05:54.116980 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.116954    2582 generic.go:356] "Generic (PLEG): container finished" podID="3fea1585bfc77c4bc4a27ad8e69f0753" containerID="f07ce544c4de8bc7e7f3d2b22568ea60943fea18a36ecd9803afb11de7ba0a7e" exitCode=0
Jul 06 20:05:54.117077 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.117034    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" event={"ID":"3fea1585bfc77c4bc4a27ad8e69f0753","Type":"ContainerDied","Data":"f07ce544c4de8bc7e7f3d2b22568ea60943fea18a36ecd9803afb11de7ba0a7e"}
Jul 06 20:05:54.126967 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.126942    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r2brh" event={"ID":"bfca2d36-fdc6-4f7e-8078-735f6241ee00","Type":"ContainerStarted","Data":"0fa4ca415a981b821543d5e46ec0a608bf1585ff9bdfb379142453a60af9e578"}
Jul 06 20:05:54.522412 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.522087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:54.522412 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.522147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:54.522412 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:54.522229    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:05:54.522412 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:54.522267    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:05:54.522412 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:54.522316    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret podName:d7078019-dd34-434c-81b1-bf5685ff76ed nodeName:}" failed. No retries permitted until 2026-07-06 20:05:56.522287463 +0000 UTC m=+6.063698450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret") pod "global-pull-secret-syncer-wsxpw" (UID: "d7078019-dd34-434c-81b1-bf5685ff76ed") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:05:54.522412 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:54.522336    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs podName:07d190c2-2d5c-4c50-9e18-56b25a2d5ada nodeName:}" failed. No retries permitted until 2026-07-06 20:05:56.522325321 +0000 UTC m=+6.063736294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs") pod "network-metrics-daemon-thz5p" (UID: "07d190c2-2d5c-4c50-9e18-56b25a2d5ada") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:05:54.723648 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.723610    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wm4\" (UniqueName: \"kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4\") pod \"network-check-target-rcrxc\" (UID: \"6cbd9b58-6895-4378-95dc-7541b9cab4b0\") " pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:05:54.723823 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:54.723794    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:05:54.723823 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:54.723817    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:05:54.723917 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:54.723832    2582 projected.go:196] Error preparing data for projected volume kube-api-access-f9wm4 for pod openshift-network-diagnostics/network-check-target-rcrxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:05:54.723917 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:54.723894    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4 podName:6cbd9b58-6895-4378-95dc-7541b9cab4b0 nodeName:}" failed. No retries permitted until 2026-07-06 20:05:56.723873232 +0000 UTC m=+6.265284217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9wm4" (UniqueName: "kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4") pod "network-check-target-rcrxc" (UID: "6cbd9b58-6895-4378-95dc-7541b9cab4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:05:54.971232 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.971178    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:00:52 +0000 UTC" deadline="2027-12-15 23:50:54.790773584 +0000 UTC"
Jul 06 20:05:54.971232 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:54.971230    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12651h44m59.819548676s"
Jul 06 20:05:55.060675 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:55.060645    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:55.060850 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:55.060780    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:05:55.061316 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:55.061173    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:05:55.061316 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:55.061276    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:05:55.146102 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:55.146065    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" event={"ID":"3fea1585bfc77c4bc4a27ad8e69f0753","Type":"ContainerStarted","Data":"2423974627f796b8b92bf5ca620d43b18b373ff162d276103f170fdb0a1f57dd"}
Jul 06 20:05:55.172981 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:55.172925    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" podStartSLOduration=3.172902757 podStartE2EDuration="3.172902757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:05:55.172815785 +0000 UTC m=+4.714226778" watchObservedRunningTime="2026-07-06 20:05:55.172902757 +0000 UTC m=+4.714313743"
Jul 06 20:05:56.060995 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:56.060438    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:56.060995 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:56.060572    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:05:56.541577 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:56.541481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:56.541577 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:56.541597    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:56.541900 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:56.541724    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:05:56.541900 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:56.541785    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret podName:d7078019-dd34-434c-81b1-bf5685ff76ed nodeName:}" failed. No retries permitted until 2026-07-06 20:06:00.541768219 +0000 UTC m=+10.083179205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret") pod "global-pull-secret-syncer-wsxpw" (UID: "d7078019-dd34-434c-81b1-bf5685ff76ed") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:05:56.542223 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:56.542192    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:05:56.542311 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:56.542258    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs podName:07d190c2-2d5c-4c50-9e18-56b25a2d5ada nodeName:}" failed. No retries permitted until 2026-07-06 20:06:00.542242328 +0000 UTC m=+10.083653313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs") pod "network-metrics-daemon-thz5p" (UID: "07d190c2-2d5c-4c50-9e18-56b25a2d5ada") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:05:56.742972 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:56.742916    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wm4\" (UniqueName: \"kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4\") pod \"network-check-target-rcrxc\" (UID: \"6cbd9b58-6895-4378-95dc-7541b9cab4b0\") " pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:05:56.743128 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:56.743072    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:05:56.743128 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:56.743106    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:05:56.743128 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:56.743116    2582 projected.go:196] Error preparing data for projected volume kube-api-access-f9wm4 for pod openshift-network-diagnostics/network-check-target-rcrxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:05:56.743322 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:56.743169    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4 podName:6cbd9b58-6895-4378-95dc-7541b9cab4b0 nodeName:}" failed. No retries permitted until 2026-07-06 20:06:00.743154978 +0000 UTC m=+10.284565954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9wm4" (UniqueName: "kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4") pod "network-check-target-rcrxc" (UID: "6cbd9b58-6895-4378-95dc-7541b9cab4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:05:57.060792 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:57.060308    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:05:57.060792 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:57.060437    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:05:57.061266 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:57.061116    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:57.061266 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:57.061232    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:05:58.060603 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:58.060524    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:05:58.060774 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:58.060670    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:05:59.060663 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:59.060143    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:05:59.060663 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:59.060286    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:05:59.060663 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:05:59.060366    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:05:59.060663 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:05:59.060485    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:00.059688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:00.059651    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:00.059874 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:00.059789    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:00.572884 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:00.572847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:00.573368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:00.572900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:00.573368 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:00.573039    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:06:00.573368 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:00.573103    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs podName:07d190c2-2d5c-4c50-9e18-56b25a2d5ada nodeName:}" failed. No retries permitted until 2026-07-06 20:06:08.573085762 +0000 UTC m=+18.114496751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs") pod "network-metrics-daemon-thz5p" (UID: "07d190c2-2d5c-4c50-9e18-56b25a2d5ada") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:06:00.573535 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:00.573503    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:06:00.573588 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:00.573553    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret podName:d7078019-dd34-434c-81b1-bf5685ff76ed nodeName:}" failed. No retries permitted until 2026-07-06 20:06:08.573538203 +0000 UTC m=+18.114949177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret") pod "global-pull-secret-syncer-wsxpw" (UID: "d7078019-dd34-434c-81b1-bf5685ff76ed") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:06:00.774909 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:00.774870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wm4\" (UniqueName: \"kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4\") pod \"network-check-target-rcrxc\" (UID: \"6cbd9b58-6895-4378-95dc-7541b9cab4b0\") " pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:00.775174 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:00.775080    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:06:00.775174 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:00.775104    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:06:00.775174 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:00.775120    2582 projected.go:196] Error preparing data for projected volume kube-api-access-f9wm4 for pod openshift-network-diagnostics/network-check-target-rcrxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:06:00.775423 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:00.775240    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4 podName:6cbd9b58-6895-4378-95dc-7541b9cab4b0 nodeName:}" failed. No retries permitted until 2026-07-06 20:06:08.77522057 +0000 UTC m=+18.316631561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9wm4" (UniqueName: "kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4") pod "network-check-target-rcrxc" (UID: "6cbd9b58-6895-4378-95dc-7541b9cab4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:06:01.061726 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:01.061646    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:01.061872 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:01.061758    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:01.062121 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:01.061968    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:01.062121 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:01.062086    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:02.060309 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:02.060262    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:02.060751 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:02.060411    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:03.059696 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:03.059660    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:03.059867 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:03.059660    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:03.059867 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:03.059797    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:03.059867 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:03.059842    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:04.060553 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:04.060518    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:04.060995 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:04.060666    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:05.060071 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:05.060039    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:05.060321 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:05.060170    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:05.060321 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:05.060229    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:05.060432 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:05.060380    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:06.059943 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:06.059907    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:06.060406 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:06.060038    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:07.060479 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:07.060261    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:07.060479 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:07.060292    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:07.060479 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:07.060387    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:07.061016 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:07.060529    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:08.059945 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:08.059926    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:08.060060 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:08.060039    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:08.632314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:08.632132    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:08.632838 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:08.632329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:08.632838 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:08.632284    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:06:08.632838 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:08.632438    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:06:08.632838 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:08.632446    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret podName:d7078019-dd34-434c-81b1-bf5685ff76ed nodeName:}" failed. No retries permitted until 2026-07-06 20:06:24.632426323 +0000 UTC m=+34.173837303 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret") pod "global-pull-secret-syncer-wsxpw" (UID: "d7078019-dd34-434c-81b1-bf5685ff76ed") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:06:08.632838 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:08.632474    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs podName:07d190c2-2d5c-4c50-9e18-56b25a2d5ada nodeName:}" failed. No retries permitted until 2026-07-06 20:06:24.63246421 +0000 UTC m=+34.173875180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs") pod "network-metrics-daemon-thz5p" (UID: "07d190c2-2d5c-4c50-9e18-56b25a2d5ada") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:06:08.833494 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:08.833433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wm4\" (UniqueName: \"kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4\") pod \"network-check-target-rcrxc\" (UID: \"6cbd9b58-6895-4378-95dc-7541b9cab4b0\") " pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:08.833595 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:08.833578    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:06:08.833635 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:08.833598    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:06:08.833635 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:08.833607    2582 projected.go:196] Error preparing data for projected volume kube-api-access-f9wm4 for pod openshift-network-diagnostics/network-check-target-rcrxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:06:08.833690 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:08.833656    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4 podName:6cbd9b58-6895-4378-95dc-7541b9cab4b0 nodeName:}" failed. No retries permitted until 2026-07-06 20:06:24.833643814 +0000 UTC m=+34.375054789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9wm4" (UniqueName: "kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4") pod "network-check-target-rcrxc" (UID: "6cbd9b58-6895-4378-95dc-7541b9cab4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:06:09.060517 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.060484    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:09.060672 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:09.060620    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:09.060720 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.060676    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:09.060807 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:09.060786    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:09.175464 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.175387    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" event={"ID":"a1ef2ca68729a3e6662bb61abe38ed8a","Type":"ContainerStarted","Data":"16842eac78a9c7630eadfee4d94fc4cb394e3a42c61c51685b1f9b61d8a1de14"}
Jul 06 20:06:09.177373 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.177343    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r2brh" event={"ID":"bfca2d36-fdc6-4f7e-8078-735f6241ee00","Type":"ContainerStarted","Data":"55cec935c2b7dc7cad67e618a19336e42bb296a127a3ac08552b940e7bc9c69d"}
Jul 06 20:06:09.179102 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.179078    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89" event={"ID":"e26f4f5f-2217-4906-aab7-9889ef8983a6","Type":"ContainerStarted","Data":"fe2feec3f180be95088bfb07b02c2637efd48b09be32ec4aea66bed00522fb2b"}
Jul 06 20:06:09.180820 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.180770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mhlr9" event={"ID":"75740867-2cfc-477f-864f-ef0357a87bfc","Type":"ContainerStarted","Data":"49bbc8b52833fa67f4052c7d0849b5fa5d51cd828aee3112c71dfe31bfb312b2"}
Jul 06 20:06:09.182586 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.182561    2582 generic.go:356] "Generic (PLEG): container finished" podID="c6cffdb3-f577-42bc-abf6-4bf50fb66414" containerID="1266c83fd4b826251d83666d21551b33b3afb671a213d7edadfca658f279717d" exitCode=0
Jul 06 20:06:09.182661 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.182631    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zlfc" event={"ID":"c6cffdb3-f577-42bc-abf6-4bf50fb66414","Type":"ContainerDied","Data":"1266c83fd4b826251d83666d21551b33b3afb671a213d7edadfca658f279717d"}
Jul 06 20:06:09.184286 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.184240    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6l7s4" event={"ID":"17d4f092-7b09-45ef-8131-fb1024022a7c","Type":"ContainerStarted","Data":"f08b5e396375a10fea5da2f69f3912ee8d94ff8071638a97545efacfb42e8412"}
Jul 06 20:06:09.185848 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.185826    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxbv8" event={"ID":"27f9059b-2e69-457b-9fbf-17b8bb36e010","Type":"ContainerStarted","Data":"f1f3f918a0a2b5ac7e30d4d93fbf3f3ec35dc3001ef1f8d0a4f2c4712c2d6d3c"}
Jul 06 20:06:09.190378 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.190354    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:06:09.190822 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.190804    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b790fa8-3aa5-42d0-822d-1985b5526b53" containerID="7a512bc66262cddb52ace79067f7ec4765ff6b674ff27d7e2c6fd0e3dd249f2f" exitCode=1
Jul 06 20:06:09.190922 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.190836    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht" event={"ID":"6b790fa8-3aa5-42d0-822d-1985b5526b53","Type":"ContainerStarted","Data":"613e45a434995dca8a55d2d4d78da1d52355dace8046b6fd6ca47201a68171f5"}
Jul 06 20:06:09.190922 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.190897    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht" event={"ID":"6b790fa8-3aa5-42d0-822d-1985b5526b53","Type":"ContainerStarted","Data":"3949a0587446de4ce4663d364a9c6bba49c58c7bf69d6110290baae32ce04be9"}
Jul 06 20:06:09.191039 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.190946    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht" event={"ID":"6b790fa8-3aa5-42d0-822d-1985b5526b53","Type":"ContainerStarted","Data":"b6e40bafd6b603dfaa0d82102018f9466d20c72aab75ddbf8e7e782fe2d08086"}
Jul 06 20:06:09.191039 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.190996    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht" event={"ID":"6b790fa8-3aa5-42d0-822d-1985b5526b53","Type":"ContainerStarted","Data":"2c4c15fe64f85004626759cfe0ee617a6d06ab34a898e8ac60d2c086222a82a9"}
Jul 06 20:06:09.191140 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.191047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht" event={"ID":"6b790fa8-3aa5-42d0-822d-1985b5526b53","Type":"ContainerDied","Data":"7a512bc66262cddb52ace79067f7ec4765ff6b674ff27d7e2c6fd0e3dd249f2f"}
Jul 06 20:06:09.191140 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.191106    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht" event={"ID":"6b790fa8-3aa5-42d0-822d-1985b5526b53","Type":"ContainerStarted","Data":"c737e8ffd97f4d9aafa4e9141074bad29d7eaee325ca8b55217cc6f3665fbb84"}
Jul 06 20:06:09.227046 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.226998    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" podStartSLOduration=17.226983784 podStartE2EDuration="17.226983784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:09.203483686 +0000 UTC m=+18.744894678" watchObservedRunningTime="2026-07-06 20:06:09.226983784 +0000 UTC m=+18.768394776"
Jul 06 20:06:09.227556 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.227512    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mhlr9" podStartSLOduration=3.548435722 podStartE2EDuration="18.227500852s" totalImagesPullingTime="14.67906513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:09.22684404 +0000 UTC m=+18.768255034" watchObservedRunningTime="2026-07-06 20:06:09.227500852 +0000 UTC m=+18.768911845"
Jul 06 20:06:09.250561 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.250511    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bxbv8" podStartSLOduration=3.574329514 podStartE2EDuration="18.250498272s" totalImagesPullingTime="14.676168758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:09.249052171 +0000 UTC m=+18.790463165" watchObservedRunningTime="2026-07-06 20:06:09.250498272 +0000 UTC m=+18.791909265"
Jul 06 20:06:09.301743 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.301667    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r2brh" podStartSLOduration=3.625712704 podStartE2EDuration="18.301646645s" totalImagesPullingTime="14.675933941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:09.276160664 +0000 UTC m=+18.817571657" watchObservedRunningTime="2026-07-06 20:06:09.301646645 +0000 UTC m=+18.843057639"
Jul 06 20:06:09.357987 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.357942    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6l7s4" podStartSLOduration=3.963896866 podStartE2EDuration="18.357927577s" totalImagesPullingTime="14.394030711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:09.302233896 +0000 UTC m=+18.843644888" watchObservedRunningTime="2026-07-06 20:06:09.357927577 +0000 UTC m=+18.899338570"
Jul 06 20:06:09.473694 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.473668    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 20:06:09.947040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.946941    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:06:09.473688921Z","UUID":"7c16e5f7-6678-4fb9-ad22-45a02ea5f828","Handler":null,"Name":"","Endpoint":""}
Jul 06 20:06:09.948747 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.948721    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 20:06:09.948871 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:09.948759    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 20:06:10.060381 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:10.060348    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:10.060555 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:10.060488    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:10.195118 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:10.195085    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89" event={"ID":"e26f4f5f-2217-4906-aab7-9889ef8983a6","Type":"ContainerStarted","Data":"8de6f082087389319d6974583b238d3912c0e034e4e06f48a8817f6692ebd7ac"}
Jul 06 20:06:10.196854 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:10.196817    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hkn28" event={"ID":"3fc8e0ca-03df-4be4-a4a7-05a0c223b8d7","Type":"ContainerStarted","Data":"3f69b5bd81a987b038a92a7482891ef0b4a210c0fa9aeca7a248564413231d09"}
Jul 06 20:06:10.228540 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:10.228454    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hkn28" podStartSLOduration=4.537027563 podStartE2EDuration="19.228430548s" totalImagesPullingTime="14.691402985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:10.228230751 +0000 UTC m=+19.769641742" watchObservedRunningTime="2026-07-06 20:06:10.228430548 +0000 UTC m=+19.769841542"
Jul 06 20:06:11.060683 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:11.060650    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:11.060956 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:11.060738    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:11.060956 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:11.060791    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:11.060956 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:11.060906    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:11.201265 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:11.201230    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89" event={"ID":"e26f4f5f-2217-4906-aab7-9889ef8983a6","Type":"ContainerStarted","Data":"f9bf786f718e8fc7e9c2d69f8591e4eca649bd81ad6ae97e3acbab85e2b4e910"}
Jul 06 20:06:11.203914 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:11.203897    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:06:11.204229 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:11.204194    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht" event={"ID":"6b790fa8-3aa5-42d0-822d-1985b5526b53","Type":"ContainerStarted","Data":"8bc64b87e320329c2cecee047a98e35a70b69734a8b6c1c6b832b32544302ad6"}
Jul 06 20:06:11.233015 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:11.232965    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdn89" podStartSLOduration=3.597363163 podStartE2EDuration="20.232945525s" totalImagesPullingTime="16.635582362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:11.232456966 +0000 UTC m=+20.773867961" watchObservedRunningTime="2026-07-06 20:06:11.232945525 +0000 UTC m=+20.774356519"
Jul 06 20:06:12.060404 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:12.060155    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:12.060571 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:12.060497    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:13.059814 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:13.059743    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:13.060405 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:13.059883    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:13.060405 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:13.059906    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:13.060405 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:13.060018    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:13.213895 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:13.213714    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:06:13.214299 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:13.214156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht" event={"ID":"6b790fa8-3aa5-42d0-822d-1985b5526b53","Type":"ContainerStarted","Data":"d094c0af1c89c08c4febc9e1aec688ea321f591c40acf5ff2196bf2c6da04cbf"}
Jul 06 20:06:13.214799 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:13.214577    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:06:13.214799 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:13.214650    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:06:13.214799 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:13.214748    2582 scope.go:117] "RemoveContainer" containerID="7a512bc66262cddb52ace79067f7ec4765ff6b674ff27d7e2c6fd0e3dd249f2f"
Jul 06 20:06:13.236477 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:13.236320    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:06:14.060065 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:14.059864    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:14.060973 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:14.060152    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:14.102246 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:14.102198    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:06:14.102823 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:14.102799    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:06:14.220831 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:14.220805    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:06:14.221343 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:14.221307    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht" event={"ID":"6b790fa8-3aa5-42d0-822d-1985b5526b53","Type":"ContainerStarted","Data":"ee03dd9b59679ba9977302c84ace639fc28d3a553c15fc9261abd10db6ca81af"}
Jul 06 20:06:14.221575 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:14.221560    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:06:14.221664 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:14.221601    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:06:14.222356 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:14.222331    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mhlr9"
Jul 06 20:06:14.238052 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:14.238029    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:06:14.259810 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:14.259759    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht" podStartSLOduration=8.526210917 podStartE2EDuration="23.259740473s" totalImagesPullingTime="14.733529556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:14.259441257 +0000 UTC m=+23.800852251" watchObservedRunningTime="2026-07-06 20:06:14.259740473 +0000 UTC m=+23.801151468"
Jul 06 20:06:15.059650 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:15.059621    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:15.059830 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:15.059621    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:15.059830 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:15.059754    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:15.059830 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:15.059795    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:15.533977 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:15.533946    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rcrxc"]
Jul 06 20:06:15.534441 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:15.534098    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:15.534441 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:15.534239    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:15.553685 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:15.553649    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wsxpw"]
Jul 06 20:06:15.553862 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:15.553783    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:15.553920 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:15.553881    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:15.554421 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:15.554391    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-thz5p"]
Jul 06 20:06:15.554527 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:15.554494    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:15.554623 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:15.554599    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:16.227160 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:16.227131    2582 generic.go:356] "Generic (PLEG): container finished" podID="c6cffdb3-f577-42bc-abf6-4bf50fb66414" containerID="6a49de69790df5b188f2114adbca64b2bfb4542749d949821a26f83107a0241e" exitCode=0
Jul 06 20:06:16.227337 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:16.227233    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zlfc" event={"ID":"c6cffdb3-f577-42bc-abf6-4bf50fb66414","Type":"ContainerDied","Data":"6a49de69790df5b188f2114adbca64b2bfb4542749d949821a26f83107a0241e"}
Jul 06 20:06:17.059975 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:17.059898    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:17.059975 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:17.059914    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:17.060520 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:17.059995    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:17.060520 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:17.060004    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:17.060520 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:17.060070    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:17.060520 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:17.060130    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:17.232622 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:17.232591    2582 generic.go:356] "Generic (PLEG): container finished" podID="c6cffdb3-f577-42bc-abf6-4bf50fb66414" containerID="85cac2ed09e7e3e2a6778372dcd4ef04a037361bbba7ef7eed53282fd7345e08" exitCode=0
Jul 06 20:06:17.232775 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:17.232658    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zlfc" event={"ID":"c6cffdb3-f577-42bc-abf6-4bf50fb66414","Type":"ContainerDied","Data":"85cac2ed09e7e3e2a6778372dcd4ef04a037361bbba7ef7eed53282fd7345e08"}
Jul 06 20:06:18.237100 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:18.237066    2582 generic.go:356] "Generic (PLEG): container finished" podID="c6cffdb3-f577-42bc-abf6-4bf50fb66414" containerID="59f2a75783847060b8b4d54579d822e651fdf39a6b7a5e0ab1c44d8abfc6fd5d" exitCode=0
Jul 06 20:06:18.237470 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:18.237123    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zlfc" event={"ID":"c6cffdb3-f577-42bc-abf6-4bf50fb66414","Type":"ContainerDied","Data":"59f2a75783847060b8b4d54579d822e651fdf39a6b7a5e0ab1c44d8abfc6fd5d"}
Jul 06 20:06:19.060016 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:19.059981    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:19.060185 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:19.059987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:19.060185 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:19.060121    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:19.060293 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:19.060236    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:19.060293 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:19.060000    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:19.060380 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:19.060337    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:21.061119 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:21.061082    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:21.061631 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:21.061224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:21.061631 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:21.061221    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:21.061631 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:21.061353    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:21.061631 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:21.061386    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:21.061631 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:21.061458    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:23.059566 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:23.059530    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:23.059566 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:23.059569    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:23.060133 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:23.059533    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:23.060133 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:23.059668    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:23.060133 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:23.059777    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:23.060133 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:23.059863    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:24.657890 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:24.657859    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:24.658515 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:24.657946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:24.658515 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:24.658031    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:06:24.658515 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:24.658061    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 20:06:24.658515 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:24.658094    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs podName:07d190c2-2d5c-4c50-9e18-56b25a2d5ada nodeName:}" failed. No retries permitted until 2026-07-06 20:06:56.658075968 +0000 UTC m=+66.199486939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs") pod "network-metrics-daemon-thz5p" (UID: "07d190c2-2d5c-4c50-9e18-56b25a2d5ada") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 20:06:24.658515 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:24.658112    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret podName:d7078019-dd34-434c-81b1-bf5685ff76ed nodeName:}" failed. No retries permitted until 2026-07-06 20:06:56.658105124 +0000 UTC m=+66.199516095 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret") pod "global-pull-secret-syncer-wsxpw" (UID: "d7078019-dd34-434c-81b1-bf5685ff76ed") : object "kube-system"/"original-pull-secret" not registered
Jul 06 20:06:24.859536 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:24.859495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wm4\" (UniqueName: \"kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4\") pod \"network-check-target-rcrxc\" (UID: \"6cbd9b58-6895-4378-95dc-7541b9cab4b0\") " pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:24.859716 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:24.859650    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 20:06:24.859716 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:24.859675    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 20:06:24.859716 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:24.859689    2582 projected.go:196] Error preparing data for projected volume kube-api-access-f9wm4 for pod openshift-network-diagnostics/network-check-target-rcrxc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:06:24.859879 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:24.859751    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4 podName:6cbd9b58-6895-4378-95dc-7541b9cab4b0 nodeName:}" failed. No retries permitted until 2026-07-06 20:06:56.859733562 +0000 UTC m=+66.401144539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f9wm4" (UniqueName: "kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4") pod "network-check-target-rcrxc" (UID: "6cbd9b58-6895-4378-95dc-7541b9cab4b0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 20:06:25.059884 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:25.059853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:25.060008 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:25.059853    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:25.060071 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:25.060001    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:25.060071 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:25.060041    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:25.060168 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:25.060117    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:25.060234 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:25.060184    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:27.060194 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:27.060163    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:27.060794 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:27.060163    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:27.060794 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:27.060224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:27.060794 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:27.060309    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wsxpw" podUID="d7078019-dd34-434c-81b1-bf5685ff76ed"
Jul 06 20:06:27.060794 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:27.060429    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcrxc" podUID="6cbd9b58-6895-4378-95dc-7541b9cab4b0"
Jul 06 20:06:27.060794 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:27.060500    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-thz5p" podUID="07d190c2-2d5c-4c50-9e18-56b25a2d5ada"
Jul 06 20:06:27.259613 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:27.259522    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8mc4j" event={"ID":"818182a4-4f0a-4550-b386-2ecf302c2dce","Type":"ContainerStarted","Data":"99676af6d09114f6199d4036b2222241bcfdb8855e1005b87e3c46f4ccd5cfc1"}
Jul 06 20:06:27.262252 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:27.262226    2582 generic.go:356] "Generic (PLEG): container finished" podID="c6cffdb3-f577-42bc-abf6-4bf50fb66414" containerID="4bf1e6f92fb0991815892803f787a29e4054e67fc16b35f28d7669513b18a802" exitCode=0
Jul 06 20:06:27.262373 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:27.262273    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zlfc" event={"ID":"c6cffdb3-f577-42bc-abf6-4bf50fb66414","Type":"ContainerDied","Data":"4bf1e6f92fb0991815892803f787a29e4054e67fc16b35f28d7669513b18a802"}
Jul 06 20:06:27.288259 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:27.288185    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8mc4j" podStartSLOduration=2.8775108830000002 podStartE2EDuration="36.288150034s" totalImagesPullingTime="33.410639151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:27.287964734 +0000 UTC m=+36.829375738" watchObservedRunningTime="2026-07-06 20:06:27.288150034 +0000 UTC m=+36.829561024"
Jul 06 20:06:28.267825 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.267791    2582 generic.go:356] "Generic (PLEG): container finished" podID="c6cffdb3-f577-42bc-abf6-4bf50fb66414" containerID="846f28ed92526f0fa41ff12bd4b3318d168cc94ac5a8cc307a2ae38def360d1c" exitCode=0
Jul 06 20:06:28.268165 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.267882    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zlfc" event={"ID":"c6cffdb3-f577-42bc-abf6-4bf50fb66414","Type":"ContainerDied","Data":"846f28ed92526f0fa41ff12bd4b3318d168cc94ac5a8cc307a2ae38def360d1c"}
Jul 06 20:06:28.741926 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.741900    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeReady"
Jul 06 20:06:28.742092 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.742019    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 20:06:28.809362 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.809334    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tlx2b"]
Jul 06 20:06:28.829064 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.827743    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6wgkd"]
Jul 06 20:06:28.829064 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.827888    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:28.831085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.831063    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 20:06:28.831236 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.831139    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 20:06:28.831581 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.831561    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5vcsc\""
Jul 06 20:06:28.850854 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.850825    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6wgkd"]
Jul 06 20:06:28.850974 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.850867    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tlx2b"]
Jul 06 20:06:28.850974 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.850957    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6wgkd"
Jul 06 20:06:28.855399 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.855379    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 20:06:28.855580 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.855560    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 20:06:28.855580 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.855576    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 20:06:28.855715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.855570    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kwpnh\""
Jul 06 20:06:28.991672 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.991632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88451c27-2e6a-42ab-9adc-94bb930464bc-tmp-dir\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:28.991848 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.991688    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trdql\" (UniqueName: \"kubernetes.io/projected/2aff33fa-c131-4aae-8bf8-3529eaf09bb5-kube-api-access-trdql\") pod \"ingress-canary-6wgkd\" (UID: \"2aff33fa-c131-4aae-8bf8-3529eaf09bb5\") " pod="openshift-ingress-canary/ingress-canary-6wgkd"
Jul 06 20:06:28.991848 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.991739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88451c27-2e6a-42ab-9adc-94bb930464bc-config-volume\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:28.991848 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.991754    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:28.991848 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.991773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4rlh\" (UniqueName: \"kubernetes.io/projected/88451c27-2e6a-42ab-9adc-94bb930464bc-kube-api-access-w4rlh\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:28.991848 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:28.991793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aff33fa-c131-4aae-8bf8-3529eaf09bb5-cert\") pod \"ingress-canary-6wgkd\" (UID: \"2aff33fa-c131-4aae-8bf8-3529eaf09bb5\") " pod="openshift-ingress-canary/ingress-canary-6wgkd"
Jul 06 20:06:29.059964 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.059890    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:29.060100 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.059897    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:29.060360 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.059900    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:29.063274 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.063250    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 20:06:29.063376 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.063254    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mt2s9\""
Jul 06 20:06:29.063376 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.063254    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 20:06:29.063376 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.063254    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vntfk\""
Jul 06 20:06:29.063676 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.063659    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 20:06:29.063710 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.063668    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 20:06:29.092319 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.092288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trdql\" (UniqueName: \"kubernetes.io/projected/2aff33fa-c131-4aae-8bf8-3529eaf09bb5-kube-api-access-trdql\") pod \"ingress-canary-6wgkd\" (UID: \"2aff33fa-c131-4aae-8bf8-3529eaf09bb5\") " pod="openshift-ingress-canary/ingress-canary-6wgkd"
Jul 06 20:06:29.092468 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.092351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88451c27-2e6a-42ab-9adc-94bb930464bc-config-volume\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:29.092468 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.092372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:29.092468 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.092395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4rlh\" (UniqueName: \"kubernetes.io/projected/88451c27-2e6a-42ab-9adc-94bb930464bc-kube-api-access-w4rlh\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:29.092468 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.092426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aff33fa-c131-4aae-8bf8-3529eaf09bb5-cert\") pod \"ingress-canary-6wgkd\" (UID: \"2aff33fa-c131-4aae-8bf8-3529eaf09bb5\") " pod="openshift-ingress-canary/ingress-canary-6wgkd"
Jul 06 20:06:29.092468 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:29.092460    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:06:29.092724 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.092460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88451c27-2e6a-42ab-9adc-94bb930464bc-tmp-dir\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:29.092724 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:29.092519    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls podName:88451c27-2e6a-42ab-9adc-94bb930464bc nodeName:}" failed. No retries permitted until 2026-07-06 20:06:29.592500561 +0000 UTC m=+39.133911543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls") pod "dns-default-tlx2b" (UID: "88451c27-2e6a-42ab-9adc-94bb930464bc") : secret "dns-default-metrics-tls" not found
Jul 06 20:06:29.092920 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.092900    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88451c27-2e6a-42ab-9adc-94bb930464bc-tmp-dir\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:29.092987 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.092957    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88451c27-2e6a-42ab-9adc-94bb930464bc-config-volume\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:29.096850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.096822    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aff33fa-c131-4aae-8bf8-3529eaf09bb5-cert\") pod \"ingress-canary-6wgkd\" (UID: \"2aff33fa-c131-4aae-8bf8-3529eaf09bb5\") " pod="openshift-ingress-canary/ingress-canary-6wgkd"
Jul 06 20:06:29.102082 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.102055    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4rlh\" (UniqueName: \"kubernetes.io/projected/88451c27-2e6a-42ab-9adc-94bb930464bc-kube-api-access-w4rlh\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:29.104303 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.104282    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trdql\" (UniqueName: \"kubernetes.io/projected/2aff33fa-c131-4aae-8bf8-3529eaf09bb5-kube-api-access-trdql\") pod \"ingress-canary-6wgkd\" (UID: \"2aff33fa-c131-4aae-8bf8-3529eaf09bb5\") " pod="openshift-ingress-canary/ingress-canary-6wgkd"
Jul 06 20:06:29.158334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.158296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6wgkd"
Jul 06 20:06:29.275363 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.275332    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9zlfc" event={"ID":"c6cffdb3-f577-42bc-abf6-4bf50fb66414","Type":"ContainerStarted","Data":"568c4e699d47bc853900ddbc16e121d7728b0cd0c588545ff27ee9ad8b254d85"}
Jul 06 20:06:29.353010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.352960    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9zlfc" podStartSLOduration=7.768211598 podStartE2EDuration="38.352942334s" totalImagesPullingTime="30.584730736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:29.318083413 +0000 UTC m=+38.859494406" watchObservedRunningTime="2026-07-06 20:06:29.352942334 +0000 UTC m=+38.894353330"
Jul 06 20:06:29.353514 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.353496    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6wgkd"]
Jul 06 20:06:29.355829 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:06:29.355802    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aff33fa_c131_4aae_8bf8_3529eaf09bb5.slice/crio-74efee922fce078ad0fd7768a193658cdd637466f28a01f1a0358654c1179762 WatchSource:0}: Error finding container 74efee922fce078ad0fd7768a193658cdd637466f28a01f1a0358654c1179762: Status 404 returned error can't find the container with id 74efee922fce078ad0fd7768a193658cdd637466f28a01f1a0358654c1179762
Jul 06 20:06:29.594920 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:29.594881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:29.595078 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:29.595024    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:06:29.595149 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:29.595083    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls podName:88451c27-2e6a-42ab-9adc-94bb930464bc nodeName:}" failed. No retries permitted until 2026-07-06 20:06:30.595070621 +0000 UTC m=+40.136481595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls") pod "dns-default-tlx2b" (UID: "88451c27-2e6a-42ab-9adc-94bb930464bc") : secret "dns-default-metrics-tls" not found
Jul 06 20:06:30.279026 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:30.278990    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6wgkd" event={"ID":"2aff33fa-c131-4aae-8bf8-3529eaf09bb5","Type":"ContainerStarted","Data":"74efee922fce078ad0fd7768a193658cdd637466f28a01f1a0358654c1179762"}
Jul 06 20:06:30.603682 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:30.603643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:30.603870 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:30.603777    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:06:30.603870 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:30.603825    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls podName:88451c27-2e6a-42ab-9adc-94bb930464bc nodeName:}" failed. No retries permitted until 2026-07-06 20:06:32.603811916 +0000 UTC m=+42.145222888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls") pod "dns-default-tlx2b" (UID: "88451c27-2e6a-42ab-9adc-94bb930464bc") : secret "dns-default-metrics-tls" not found
Jul 06 20:06:32.285266 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:32.285222    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6wgkd" event={"ID":"2aff33fa-c131-4aae-8bf8-3529eaf09bb5","Type":"ContainerStarted","Data":"1ffa12458e84527ae8a256c04f25f72372dd14ad758f4d865e72811a8acafd1d"}
Jul 06 20:06:32.320243 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:32.320181    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6wgkd" podStartSLOduration=1.619350155 podStartE2EDuration="4.320165686s" totalImagesPullingTime="2.700815531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:32.319630098 +0000 UTC m=+41.861041094" watchObservedRunningTime="2026-07-06 20:06:32.320165686 +0000 UTC m=+41.861576713"
Jul 06 20:06:32.619330 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:32.619237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:32.619487 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:32.619374    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:06:32.619487 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:32.619448    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls podName:88451c27-2e6a-42ab-9adc-94bb930464bc nodeName:}" failed. No retries permitted until 2026-07-06 20:06:36.619433779 +0000 UTC m=+46.160844751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls") pod "dns-default-tlx2b" (UID: "88451c27-2e6a-42ab-9adc-94bb930464bc") : secret "dns-default-metrics-tls" not found
Jul 06 20:06:33.721717 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.721682    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9m7jk"]
Jul 06 20:06:33.739747 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.739722    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.743690 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.743660    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 20:06:33.743690 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.743677    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nkxmb\""
Jul 06 20:06:33.744438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.744421    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 20:06:33.744507 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.744440    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 20:06:33.744751 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.744733    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 20:06:33.765669 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.765642    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9m7jk"]
Jul 06 20:06:33.828327 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.828291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.828327 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.828329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.828536 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.828353    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a1305d4-4c41-4579-8428-9ef08176ba4b-data-volume\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.828536 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.828452    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a1305d4-4c41-4579-8428-9ef08176ba4b-crio-socket\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.828536 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.828476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7d2s\" (UniqueName: \"kubernetes.io/projected/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-api-access-h7d2s\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.929306 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.929272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.929306 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.929313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.929500 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:33.929418    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 20:06:33.929500 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:33.929444    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 20:06:33.929500 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:33.929492    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls podName:9a1305d4-4c41-4579-8428-9ef08176ba4b nodeName:}" failed. No retries permitted until 2026-07-06 20:06:34.429474039 +0000 UTC m=+43.970885029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9m7jk" (UID: "9a1305d4-4c41-4579-8428-9ef08176ba4b") : secret "insights-runtime-extractor-tls" not found
Jul 06 20:06:33.929612 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:33.929508    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm podName:9a1305d4-4c41-4579-8428-9ef08176ba4b nodeName:}" failed. No retries permitted until 2026-07-06 20:06:34.429500628 +0000 UTC m=+43.970911599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9m7jk" (UID: "9a1305d4-4c41-4579-8428-9ef08176ba4b") : configmap "kube-rbac-proxy" not found
Jul 06 20:06:33.929612 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.929526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a1305d4-4c41-4579-8428-9ef08176ba4b-data-volume\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.929612 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.929605    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a1305d4-4c41-4579-8428-9ef08176ba4b-crio-socket\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.929715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.929631    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7d2s\" (UniqueName: \"kubernetes.io/projected/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-api-access-h7d2s\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.929816 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.929793    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a1305d4-4c41-4579-8428-9ef08176ba4b-crio-socket\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.929949 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.929934    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a1305d4-4c41-4579-8428-9ef08176ba4b-data-volume\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:33.944898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:33.944870    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7d2s\" (UniqueName: \"kubernetes.io/projected/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-api-access-h7d2s\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:34.433961 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.433920    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:34.433961 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.433969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:34.434240 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:34.434083    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 20:06:34.434240 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:34.434129    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 20:06:34.434240 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:34.434149    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls podName:9a1305d4-4c41-4579-8428-9ef08176ba4b nodeName:}" failed. No retries permitted until 2026-07-06 20:06:35.434135729 +0000 UTC m=+44.975546705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9m7jk" (UID: "9a1305d4-4c41-4579-8428-9ef08176ba4b") : secret "insights-runtime-extractor-tls" not found
Jul 06 20:06:34.434240 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:34.434195    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm podName:9a1305d4-4c41-4579-8428-9ef08176ba4b nodeName:}" failed. No retries permitted until 2026-07-06 20:06:35.434173556 +0000 UTC m=+44.975584527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9m7jk" (UID: "9a1305d4-4c41-4579-8428-9ef08176ba4b") : configmap "kube-rbac-proxy" not found
Jul 06 20:06:34.474985 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.474957    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl"]
Jul 06 20:06:34.496817 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.496789    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl"]
Jul 06 20:06:34.496973 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.496923    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl"
Jul 06 20:06:34.503762 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.503742    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 20:06:34.504700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.504680    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 20:06:34.504753 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.504729    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-j9rzs\""
Jul 06 20:06:34.635222 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.635176    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jrgm\" (UniqueName: \"kubernetes.io/projected/99eb4935-0f34-4567-821c-fbf0d442957c-kube-api-access-9jrgm\") pod \"migrator-d57d58cc9-zxcjl\" (UID: \"99eb4935-0f34-4567-821c-fbf0d442957c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl"
Jul 06 20:06:34.736548 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.736467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jrgm\" (UniqueName: \"kubernetes.io/projected/99eb4935-0f34-4567-821c-fbf0d442957c-kube-api-access-9jrgm\") pod \"migrator-d57d58cc9-zxcjl\" (UID: \"99eb4935-0f34-4567-821c-fbf0d442957c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl"
Jul 06 20:06:34.747502 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.747478    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jrgm\" (UniqueName: \"kubernetes.io/projected/99eb4935-0f34-4567-821c-fbf0d442957c-kube-api-access-9jrgm\") pod \"migrator-d57d58cc9-zxcjl\" (UID: \"99eb4935-0f34-4567-821c-fbf0d442957c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl"
Jul 06 20:06:34.805932 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.805900    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl"
Jul 06 20:06:34.943168 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:34.943137    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl"]
Jul 06 20:06:34.946324 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:06:34.946300    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99eb4935_0f34_4567_821c_fbf0d442957c.slice/crio-4a3f8a63a91b0370e3bf5af4ea79e39a9e3a507c24e125e8d5a89e1cab399fc0 WatchSource:0}: Error finding container 4a3f8a63a91b0370e3bf5af4ea79e39a9e3a507c24e125e8d5a89e1cab399fc0: Status 404 returned error can't find the container with id 4a3f8a63a91b0370e3bf5af4ea79e39a9e3a507c24e125e8d5a89e1cab399fc0
Jul 06 20:06:35.293865 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.293834    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl" event={"ID":"99eb4935-0f34-4567-821c-fbf0d442957c","Type":"ContainerStarted","Data":"4a3f8a63a91b0370e3bf5af4ea79e39a9e3a507c24e125e8d5a89e1cab399fc0"}
Jul 06 20:06:35.442387 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.442351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:35.442387 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.442390    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:35.442595 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:35.442459    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 20:06:35.442595 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:35.442500    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 20:06:35.442595 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:35.442510    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm podName:9a1305d4-4c41-4579-8428-9ef08176ba4b nodeName:}" failed. No retries permitted until 2026-07-06 20:06:37.44249767 +0000 UTC m=+46.983908641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9m7jk" (UID: "9a1305d4-4c41-4579-8428-9ef08176ba4b") : configmap "kube-rbac-proxy" not found
Jul 06 20:06:35.442595 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:35.442564    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls podName:9a1305d4-4c41-4579-8428-9ef08176ba4b nodeName:}" failed. No retries permitted until 2026-07-06 20:06:37.442547671 +0000 UTC m=+46.983958645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9m7jk" (UID: "9a1305d4-4c41-4579-8428-9ef08176ba4b") : secret "insights-runtime-extractor-tls" not found
Jul 06 20:06:35.497710 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.497684    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6l7s4_17d4f092-7b09-45ef-8131-fb1024022a7c/dns-node-resolver/0.log"
Jul 06 20:06:35.830263 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.830231    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x6rwx"]
Jul 06 20:06:35.852576 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.852550    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-x6rwx"
Jul 06 20:06:35.856235 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.856187    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x6rwx"]
Jul 06 20:06:35.856873 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.856856    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 20:06:35.857880 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.857854    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 20:06:35.857988 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.857855    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rnsb7\""
Jul 06 20:06:35.857988 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.857978    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 20:06:35.858083 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.858012    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 20:06:35.945797 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.945763    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c9ce033e-ed30-47c3-97c5-5d3fcfd72756-signing-key\") pod \"service-ca-758f599c5-x6rwx\" (UID: \"c9ce033e-ed30-47c3-97c5-5d3fcfd72756\") " pod="openshift-service-ca/service-ca-758f599c5-x6rwx"
Jul 06 20:06:35.945980 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.945916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgh85\" (UniqueName: \"kubernetes.io/projected/c9ce033e-ed30-47c3-97c5-5d3fcfd72756-kube-api-access-vgh85\") pod \"service-ca-758f599c5-x6rwx\" (UID: \"c9ce033e-ed30-47c3-97c5-5d3fcfd72756\") " pod="openshift-service-ca/service-ca-758f599c5-x6rwx"
Jul 06 20:06:35.945980 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:35.945972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c9ce033e-ed30-47c3-97c5-5d3fcfd72756-signing-cabundle\") pod \"service-ca-758f599c5-x6rwx\" (UID: \"c9ce033e-ed30-47c3-97c5-5d3fcfd72756\") " pod="openshift-service-ca/service-ca-758f599c5-x6rwx"
Jul 06 20:06:36.046445 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:36.046409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c9ce033e-ed30-47c3-97c5-5d3fcfd72756-signing-key\") pod \"service-ca-758f599c5-x6rwx\" (UID: \"c9ce033e-ed30-47c3-97c5-5d3fcfd72756\") " pod="openshift-service-ca/service-ca-758f599c5-x6rwx"
Jul 06 20:06:36.046591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:36.046479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgh85\" (UniqueName: \"kubernetes.io/projected/c9ce033e-ed30-47c3-97c5-5d3fcfd72756-kube-api-access-vgh85\") pod \"service-ca-758f599c5-x6rwx\" (UID: \"c9ce033e-ed30-47c3-97c5-5d3fcfd72756\") " pod="openshift-service-ca/service-ca-758f599c5-x6rwx"
Jul 06 20:06:36.046591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:36.046508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c9ce033e-ed30-47c3-97c5-5d3fcfd72756-signing-cabundle\") pod \"service-ca-758f599c5-x6rwx\" (UID: \"c9ce033e-ed30-47c3-97c5-5d3fcfd72756\") " pod="openshift-service-ca/service-ca-758f599c5-x6rwx"
Jul 06 20:06:36.047137 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:36.047116    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c9ce033e-ed30-47c3-97c5-5d3fcfd72756-signing-cabundle\") pod \"service-ca-758f599c5-x6rwx\" (UID: \"c9ce033e-ed30-47c3-97c5-5d3fcfd72756\") " pod="openshift-service-ca/service-ca-758f599c5-x6rwx"
Jul 06 20:06:36.048719 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:36.048691    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c9ce033e-ed30-47c3-97c5-5d3fcfd72756-signing-key\") pod \"service-ca-758f599c5-x6rwx\" (UID: \"c9ce033e-ed30-47c3-97c5-5d3fcfd72756\") " pod="openshift-service-ca/service-ca-758f599c5-x6rwx"
Jul 06 20:06:36.057030 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:36.057009    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgh85\" (UniqueName: \"kubernetes.io/projected/c9ce033e-ed30-47c3-97c5-5d3fcfd72756-kube-api-access-vgh85\") pod \"service-ca-758f599c5-x6rwx\" (UID: \"c9ce033e-ed30-47c3-97c5-5d3fcfd72756\") " pod="openshift-service-ca/service-ca-758f599c5-x6rwx"
Jul 06 20:06:36.162051 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:36.161972    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-x6rwx"
Jul 06 20:06:36.499583 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:36.499559    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxbv8_27f9059b-2e69-457b-9fbf-17b8bb36e010/node-ca/0.log"
Jul 06 20:06:36.588970 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:36.588940    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x6rwx"]
Jul 06 20:06:36.591761 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:06:36.591732    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ce033e_ed30_47c3_97c5_5d3fcfd72756.slice/crio-3e4d8a7e68be08b4840e7d0e664a43e0b656493bd9b429790d602c4f9809cb9e WatchSource:0}: Error finding container 3e4d8a7e68be08b4840e7d0e664a43e0b656493bd9b429790d602c4f9809cb9e: Status 404 returned error can't find the container with id 3e4d8a7e68be08b4840e7d0e664a43e0b656493bd9b429790d602c4f9809cb9e
Jul 06 20:06:36.651127 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:36.651094    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:36.651297 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:36.651218    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 20:06:36.651297 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:36.651276    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls podName:88451c27-2e6a-42ab-9adc-94bb930464bc nodeName:}" failed. No retries permitted until 2026-07-06 20:06:44.651262081 +0000 UTC m=+54.192673055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls") pod "dns-default-tlx2b" (UID: "88451c27-2e6a-42ab-9adc-94bb930464bc") : secret "dns-default-metrics-tls" not found
Jul 06 20:06:37.296548 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:37.296490    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6wgkd_2aff33fa-c131-4aae-8bf8-3529eaf09bb5/serve-healthcheck-canary/0.log"
Jul 06 20:06:37.300302 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:37.300196    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl" event={"ID":"99eb4935-0f34-4567-821c-fbf0d442957c","Type":"ContainerStarted","Data":"63bf2bce620f60fd8a5c0b36c7835f083b0933ef9b47d5b3d075083a3865c9e0"}
Jul 06 20:06:37.300302 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:37.300274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl" event={"ID":"99eb4935-0f34-4567-821c-fbf0d442957c","Type":"ContainerStarted","Data":"73d4b4e00fa1ee3454d637790188e406ae939a6c9a8a63d4bd56888cb4263d31"}
Jul 06 20:06:37.301491 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:37.301467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-x6rwx" event={"ID":"c9ce033e-ed30-47c3-97c5-5d3fcfd72756","Type":"ContainerStarted","Data":"3e4d8a7e68be08b4840e7d0e664a43e0b656493bd9b429790d602c4f9809cb9e"}
Jul 06 20:06:37.322627 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:37.322573    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-zxcjl" podStartSLOduration=1.466262774 podStartE2EDuration="3.322558432s" totalImagesPullingTime="1.856295658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:37.322257277 +0000 UTC m=+46.863668271" watchObservedRunningTime="2026-07-06 20:06:37.322558432 +0000 UTC m=+46.863969424"
Jul 06 20:06:37.456974 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:37.456938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:37.457132 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:37.456992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:37.457132 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:37.457108    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 20:06:37.457253 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:37.457131    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 20:06:37.457253 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:37.457187    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls podName:9a1305d4-4c41-4579-8428-9ef08176ba4b nodeName:}" failed. No retries permitted until 2026-07-06 20:06:41.457158491 +0000 UTC m=+50.998569483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9m7jk" (UID: "9a1305d4-4c41-4579-8428-9ef08176ba4b") : secret "insights-runtime-extractor-tls" not found
Jul 06 20:06:37.457253 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:37.457217    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm podName:9a1305d4-4c41-4579-8428-9ef08176ba4b nodeName:}" failed. No retries permitted until 2026-07-06 20:06:41.457195891 +0000 UTC m=+50.998606862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9m7jk" (UID: "9a1305d4-4c41-4579-8428-9ef08176ba4b") : configmap "kube-rbac-proxy" not found
Jul 06 20:06:39.308249 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:39.308139    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-x6rwx" event={"ID":"c9ce033e-ed30-47c3-97c5-5d3fcfd72756","Type":"ContainerStarted","Data":"236680f013d9bfcb54414932f22750ce5beff2fd1ffa402c1afe78c57e5231b3"}
Jul 06 20:06:39.333561 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:39.333512    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-x6rwx" podStartSLOduration=2.101110741 podStartE2EDuration="4.333496876s" totalImagesPullingTime="2.232386135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:39.33317505 +0000 UTC m=+48.874586045" watchObservedRunningTime="2026-07-06 20:06:39.333496876 +0000 UTC m=+48.874907847"
Jul 06 20:06:41.488167 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:41.488131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:41.488167 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:41.488171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:41.488589 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:41.488289    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 20:06:41.488589 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:06:41.488359    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls podName:9a1305d4-4c41-4579-8428-9ef08176ba4b nodeName:}" failed. No retries permitted until 2026-07-06 20:06:49.488343736 +0000 UTC m=+59.029754709 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9m7jk" (UID: "9a1305d4-4c41-4579-8428-9ef08176ba4b") : secret "insights-runtime-extractor-tls" not found
Jul 06 20:06:41.488670 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:41.488631    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a1305d4-4c41-4579-8428-9ef08176ba4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:44.712675 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:44.712636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:44.714957 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:44.714932    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88451c27-2e6a-42ab-9adc-94bb930464bc-metrics-tls\") pod \"dns-default-tlx2b\" (UID: \"88451c27-2e6a-42ab-9adc-94bb930464bc\") " pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:44.740900 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:44.740865    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:44.878372 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:44.878345    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tlx2b"]
Jul 06 20:06:44.880835 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:06:44.880805    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88451c27_2e6a_42ab_9adc_94bb930464bc.slice/crio-97114d37405038d7f1f0bef1ef7426cf0d47a5f67e3433999cd471372255505a WatchSource:0}: Error finding container 97114d37405038d7f1f0bef1ef7426cf0d47a5f67e3433999cd471372255505a: Status 404 returned error can't find the container with id 97114d37405038d7f1f0bef1ef7426cf0d47a5f67e3433999cd471372255505a
Jul 06 20:06:45.324594 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:45.324558    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlx2b" event={"ID":"88451c27-2e6a-42ab-9adc-94bb930464bc","Type":"ContainerStarted","Data":"97114d37405038d7f1f0bef1ef7426cf0d47a5f67e3433999cd471372255505a"}
Jul 06 20:06:46.239335 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:46.239307    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5gqht"
Jul 06 20:06:47.331698 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:47.331668    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlx2b" event={"ID":"88451c27-2e6a-42ab-9adc-94bb930464bc","Type":"ContainerStarted","Data":"7420f3a2252658b08b214c4221951b798574f75b1b4bc1b01583c3d257421be1"}
Jul 06 20:06:48.336469 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:48.336424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tlx2b" event={"ID":"88451c27-2e6a-42ab-9adc-94bb930464bc","Type":"ContainerStarted","Data":"1380fa4395a72fcc19b746b718dd6502937ef931984043be61bf403cd8a7d320"}
Jul 06 20:06:48.336873 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:48.336545    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:06:48.380180 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:48.380128    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tlx2b" podStartSLOduration=18.096423172 podStartE2EDuration="20.380112298s" totalImagesPullingTime="2.283689126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:48.379411461 +0000 UTC m=+57.920822455" watchObservedRunningTime="2026-07-06 20:06:48.380112298 +0000 UTC m=+57.921523291"
Jul 06 20:06:49.548461 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:49.548413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:49.550585 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:49.550563    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a1305d4-4c41-4579-8428-9ef08176ba4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9m7jk\" (UID: \"9a1305d4-4c41-4579-8428-9ef08176ba4b\") " pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:49.648426 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:49.648391    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9m7jk"
Jul 06 20:06:49.789522 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:49.789491    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9m7jk"]
Jul 06 20:06:49.792813 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:06:49.792787    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1305d4_4c41_4579_8428_9ef08176ba4b.slice/crio-2cc34a84f5ee384918b96d7353814568a9126f6fafbc104fe7669a3a17c5ad72 WatchSource:0}: Error finding container 2cc34a84f5ee384918b96d7353814568a9126f6fafbc104fe7669a3a17c5ad72: Status 404 returned error can't find the container with id 2cc34a84f5ee384918b96d7353814568a9126f6fafbc104fe7669a3a17c5ad72
Jul 06 20:06:50.345737 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:50.345536    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9m7jk" event={"ID":"9a1305d4-4c41-4579-8428-9ef08176ba4b","Type":"ContainerStarted","Data":"2cc34a84f5ee384918b96d7353814568a9126f6fafbc104fe7669a3a17c5ad72"}
Jul 06 20:06:54.359939 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:54.359907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9m7jk" event={"ID":"9a1305d4-4c41-4579-8428-9ef08176ba4b","Type":"ContainerStarted","Data":"4e17d7e8d4589333d7aedd02b1b190fea0cd85447d35caad19e2cfca160e28df"}
Jul 06 20:06:54.360297 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:54.359998    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9m7jk" event={"ID":"9a1305d4-4c41-4579-8428-9ef08176ba4b","Type":"ContainerStarted","Data":"3bdb9bfa10b9b7bda5df55165aef38158564dffb75d1288b089b8f54ef91150e"}
Jul 06 20:06:54.993048 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:54.993007    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6"]
Jul 06 20:06:54.995168 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:54.995146    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6"
Jul 06 20:06:54.999995 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:54.999957    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 20:06:55.000115 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.000019    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4bw8b\""
Jul 06 20:06:55.000115 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:54.999967    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 20:06:55.000709 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.000683    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 20:06:55.000807 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:54.999967    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 20:06:55.019037 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.019004    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6"]
Jul 06 20:06:55.079297 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.079269    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-5zv49"]
Jul 06 20:06:55.081321 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.081295    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5zv49"
Jul 06 20:06:55.085167 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.085094    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 20:06:55.085965 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.085913    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 20:06:55.085965 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.085929    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bwddb\""
Jul 06 20:06:55.093557 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.093535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9cf44281-2754-4a48-b05d-d9260651fc08-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6\" (UID: \"9cf44281-2754-4a48-b05d-d9260651fc08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6"
Jul 06 20:06:55.093707 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.093596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4p4r\" (UniqueName: \"kubernetes.io/projected/9cf44281-2754-4a48-b05d-d9260651fc08-kube-api-access-f4p4r\") pod \"managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6\" (UID: \"9cf44281-2754-4a48-b05d-d9260651fc08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6"
Jul 06 20:06:55.107270 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.107188    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5zv49"]
Jul 06 20:06:55.194527 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.194480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9cf44281-2754-4a48-b05d-d9260651fc08-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6\" (UID: \"9cf44281-2754-4a48-b05d-d9260651fc08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6"
Jul 06 20:06:55.194699 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.194539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr4pj\" (UniqueName: \"kubernetes.io/projected/b5063a29-75aa-4ba2-8891-3dcc53464f94-kube-api-access-lr4pj\") pod \"downloads-685bfb5f64-5zv49\" (UID: \"b5063a29-75aa-4ba2-8891-3dcc53464f94\") " pod="openshift-console/downloads-685bfb5f64-5zv49"
Jul 06 20:06:55.194764 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.194717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4p4r\" (UniqueName: \"kubernetes.io/projected/9cf44281-2754-4a48-b05d-d9260651fc08-kube-api-access-f4p4r\") pod \"managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6\" (UID: \"9cf44281-2754-4a48-b05d-d9260651fc08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6"
Jul 06 20:06:55.197562 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.197539    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9cf44281-2754-4a48-b05d-d9260651fc08-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6\" (UID: \"9cf44281-2754-4a48-b05d-d9260651fc08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6"
Jul 06 20:06:55.214281 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.214252    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4p4r\" (UniqueName: \"kubernetes.io/projected/9cf44281-2754-4a48-b05d-d9260651fc08-kube-api-access-f4p4r\") pod \"managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6\" (UID: \"9cf44281-2754-4a48-b05d-d9260651fc08\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6"
Jul 06 20:06:55.230166 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.230135    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-988f549c8-frzk4"]
Jul 06 20:06:55.232404 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.232388    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.240575 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.240553    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 20:06:55.241259 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.241238    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 20:06:55.241405 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.241389    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 20:06:55.241756 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.241727    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gmdh4\""
Jul 06 20:06:55.248035 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.247985    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 20:06:55.254284 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.254263    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-988f549c8-frzk4"]
Jul 06 20:06:55.295735 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.295702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr4pj\" (UniqueName: \"kubernetes.io/projected/b5063a29-75aa-4ba2-8891-3dcc53464f94-kube-api-access-lr4pj\") pod \"downloads-685bfb5f64-5zv49\" (UID: \"b5063a29-75aa-4ba2-8891-3dcc53464f94\") " pod="openshift-console/downloads-685bfb5f64-5zv49"
Jul 06 20:06:55.295902 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.295772    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f81738e4-4dc5-4744-8133-e6bcee225405-registry-certificates\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.295902 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.295818    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f81738e4-4dc5-4744-8133-e6bcee225405-registry-tls\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.295902 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.295848    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f81738e4-4dc5-4744-8133-e6bcee225405-trusted-ca\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.296065 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.295922    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f81738e4-4dc5-4744-8133-e6bcee225405-image-registry-private-configuration\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.296065 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.295958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f81738e4-4dc5-4744-8133-e6bcee225405-ca-trust-extracted\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.296065 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.295999    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f81738e4-4dc5-4744-8133-e6bcee225405-bound-sa-token\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.296065 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.296034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx7ql\" (UniqueName: \"kubernetes.io/projected/f81738e4-4dc5-4744-8133-e6bcee225405-kube-api-access-hx7ql\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.296269 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.296095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f81738e4-4dc5-4744-8133-e6bcee225405-installation-pull-secrets\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.317535 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.317500    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr4pj\" (UniqueName: \"kubernetes.io/projected/b5063a29-75aa-4ba2-8891-3dcc53464f94-kube-api-access-lr4pj\") pod \"downloads-685bfb5f64-5zv49\" (UID: \"b5063a29-75aa-4ba2-8891-3dcc53464f94\") " pod="openshift-console/downloads-685bfb5f64-5zv49"
Jul 06 20:06:55.321435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.321410    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6"
Jul 06 20:06:55.391722 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.391689    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5zv49"
Jul 06 20:06:55.396572 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.396546    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f81738e4-4dc5-4744-8133-e6bcee225405-registry-certificates\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.396687 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.396606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f81738e4-4dc5-4744-8133-e6bcee225405-registry-tls\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.396687 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.396642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f81738e4-4dc5-4744-8133-e6bcee225405-trusted-ca\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.396687 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.396678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f81738e4-4dc5-4744-8133-e6bcee225405-image-registry-private-configuration\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.396849 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.396702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f81738e4-4dc5-4744-8133-e6bcee225405-ca-trust-extracted\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.396849 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.396727    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f81738e4-4dc5-4744-8133-e6bcee225405-bound-sa-token\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.396849 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.396751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx7ql\" (UniqueName: \"kubernetes.io/projected/f81738e4-4dc5-4744-8133-e6bcee225405-kube-api-access-hx7ql\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.397303 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.397087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f81738e4-4dc5-4744-8133-e6bcee225405-installation-pull-secrets\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.397303 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.397168    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f81738e4-4dc5-4744-8133-e6bcee225405-ca-trust-extracted\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.397493 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.397470    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f81738e4-4dc5-4744-8133-e6bcee225405-registry-certificates\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.397611 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.397592    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f81738e4-4dc5-4744-8133-e6bcee225405-trusted-ca\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.399586 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.399569    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f81738e4-4dc5-4744-8133-e6bcee225405-image-registry-private-configuration\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.399674 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.399652    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f81738e4-4dc5-4744-8133-e6bcee225405-registry-tls\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.400150 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.400130    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f81738e4-4dc5-4744-8133-e6bcee225405-installation-pull-secrets\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.442529 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.442494    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx7ql\" (UniqueName: \"kubernetes.io/projected/f81738e4-4dc5-4744-8133-e6bcee225405-kube-api-access-hx7ql\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.442889 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.442865    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f81738e4-4dc5-4744-8133-e6bcee225405-bound-sa-token\") pod \"image-registry-988f549c8-frzk4\" (UID: \"f81738e4-4dc5-4744-8133-e6bcee225405\") " pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:55.542891 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:55.542809    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:56.521947 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.521920    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-988f549c8-frzk4"]
Jul 06 20:06:56.526067 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:06:56.526041    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81738e4_4dc5_4744_8133_e6bcee225405.slice/crio-bfac5bf8d840da24a2aa08471cdcaba9f12636d4918154b852cdd15e1f5da9a3 WatchSource:0}: Error finding container bfac5bf8d840da24a2aa08471cdcaba9f12636d4918154b852cdd15e1f5da9a3: Status 404 returned error can't find the container with id bfac5bf8d840da24a2aa08471cdcaba9f12636d4918154b852cdd15e1f5da9a3
Jul 06 20:06:56.548307 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.548278    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6"]
Jul 06 20:06:56.551011 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.550979    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5zv49"]
Jul 06 20:06:56.561345 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:06:56.561318    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cf44281_2754_4a48_b05d_d9260651fc08.slice/crio-f279e20c4246c0610dda5ca3515b5c6f2836e5a707b07c8f47e7b5a252ede9f4 WatchSource:0}: Error finding container f279e20c4246c0610dda5ca3515b5c6f2836e5a707b07c8f47e7b5a252ede9f4: Status 404 returned error can't find the container with id f279e20c4246c0610dda5ca3515b5c6f2836e5a707b07c8f47e7b5a252ede9f4
Jul 06 20:06:56.561601 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:06:56.561580    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5063a29_75aa_4ba2_8891_3dcc53464f94.slice/crio-018982b1cb7ce3823ee902ca0268479bb9daea0ada02c30ec92d7bf4086b8e5f WatchSource:0}: Error finding container 018982b1cb7ce3823ee902ca0268479bb9daea0ada02c30ec92d7bf4086b8e5f: Status 404 returned error can't find the container with id 018982b1cb7ce3823ee902ca0268479bb9daea0ada02c30ec92d7bf4086b8e5f
Jul 06 20:06:56.705841 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.705746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:56.706003 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.705866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:56.708573 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.708550    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 20:06:56.708661 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.708550    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 20:06:56.718703 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.718672    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07d190c2-2d5c-4c50-9e18-56b25a2d5ada-metrics-certs\") pod \"network-metrics-daemon-thz5p\" (UID: \"07d190c2-2d5c-4c50-9e18-56b25a2d5ada\") " pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:56.718924 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.718908    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7078019-dd34-434c-81b1-bf5685ff76ed-original-pull-secret\") pod \"global-pull-secret-syncer-wsxpw\" (UID: \"d7078019-dd34-434c-81b1-bf5685ff76ed\") " pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:56.822010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.821971    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6957c578d5-5nrs6"]
Jul 06 20:06:56.825849 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.825823    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:56.829249 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.829227    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 20:06:56.829695 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.829679    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 20:06:56.831104 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.831066    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 20:06:56.831244 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.831163    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 20:06:56.831517 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.831497    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5gqqx\""
Jul 06 20:06:56.831608 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.831529    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 20:06:56.840338 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.840315    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6957c578d5-5nrs6"]
Jul 06 20:06:56.907240 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.907193    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wm4\" (UniqueName: \"kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4\") pod \"network-check-target-rcrxc\" (UID: \"6cbd9b58-6895-4378-95dc-7541b9cab4b0\") " pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:56.907422 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.907253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-service-ca\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:56.907422 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.907281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-serving-cert\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:56.907422 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.907299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-config\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:56.907422 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.907322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88qcx\" (UniqueName: \"kubernetes.io/projected/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-kube-api-access-88qcx\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:56.907422 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.907340    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-oauth-serving-cert\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:56.907624 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.907471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-oauth-config\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:56.910447 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.910427    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 20:06:56.920009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.919981    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 20:06:56.930977 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.930952    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9wm4\" (UniqueName: \"kubernetes.io/projected/6cbd9b58-6895-4378-95dc-7541b9cab4b0-kube-api-access-f9wm4\") pod \"network-check-target-rcrxc\" (UID: \"6cbd9b58-6895-4378-95dc-7541b9cab4b0\") " pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:56.971248 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.971166    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mt2s9\""
Jul 06 20:06:56.977276 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.977256    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vntfk\""
Jul 06 20:06:56.979246 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.979227    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:06:56.979368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.979278    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wsxpw"
Jul 06 20:06:56.985476 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:56.985454    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-thz5p"
Jul 06 20:06:57.008295 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.008267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-service-ca\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.008435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.008304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-serving-cert\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.008435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.008322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-config\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.008435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.008347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88qcx\" (UniqueName: \"kubernetes.io/projected/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-kube-api-access-88qcx\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.008554 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.008465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-oauth-serving-cert\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.008554 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.008506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-oauth-config\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.009085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.009054    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-config\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.009085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.009074    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-oauth-serving-cert\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.009085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.009061    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-service-ca\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.010807 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.010786    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-serving-cert\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.010807 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.010804    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-oauth-config\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.019738 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.019683    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88qcx\" (UniqueName: \"kubernetes.io/projected/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-kube-api-access-88qcx\") pod \"console-6957c578d5-5nrs6\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") " pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.135732 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.135401    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:06:57.182695 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.182597    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rcrxc"]
Jul 06 20:06:57.186143 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:06:57.186117    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbd9b58_6895_4378_95dc_7541b9cab4b0.slice/crio-7b888f3683a096349ffbba60486becd1357a1b8a7947fc4327e508244d2ebf17 WatchSource:0}: Error finding container 7b888f3683a096349ffbba60486becd1357a1b8a7947fc4327e508244d2ebf17: Status 404 returned error can't find the container with id 7b888f3683a096349ffbba60486becd1357a1b8a7947fc4327e508244d2ebf17
Jul 06 20:06:57.220958 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.220885    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wsxpw"]
Jul 06 20:06:57.273898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.273867    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-thz5p"]
Jul 06 20:06:57.279717 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:06:57.279690    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d190c2_2d5c_4c50_9e18_56b25a2d5ada.slice/crio-dc9014e89e7f6a2707c2da1399397405fc2cb5f872907126e7180acc80e8acc7 WatchSource:0}: Error finding container dc9014e89e7f6a2707c2da1399397405fc2cb5f872907126e7180acc80e8acc7: Status 404 returned error can't find the container with id dc9014e89e7f6a2707c2da1399397405fc2cb5f872907126e7180acc80e8acc7
Jul 06 20:06:57.311455 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:06:57.311428    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaacf78fb_d069_415d_8c92_0b8ba5ca0edf.slice/crio-4a5d7de17aead3c1b8e8a50c1bd0d2ddbd9b132f17f70696cfdc162fcee4336d WatchSource:0}: Error finding container 4a5d7de17aead3c1b8e8a50c1bd0d2ddbd9b132f17f70696cfdc162fcee4336d: Status 404 returned error can't find the container with id 4a5d7de17aead3c1b8e8a50c1bd0d2ddbd9b132f17f70696cfdc162fcee4336d
Jul 06 20:06:57.315652 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.315626    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6957c578d5-5nrs6"]
Jul 06 20:06:57.372927 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.372887    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9m7jk" event={"ID":"9a1305d4-4c41-4579-8428-9ef08176ba4b","Type":"ContainerStarted","Data":"f9ece16a44b0889066f322e2ff31cfe3acbd6dd3c78f3cb149d20d4fc735e015"}
Jul 06 20:06:57.373916 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.373891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-thz5p" event={"ID":"07d190c2-2d5c-4c50-9e18-56b25a2d5ada","Type":"ContainerStarted","Data":"dc9014e89e7f6a2707c2da1399397405fc2cb5f872907126e7180acc80e8acc7"}
Jul 06 20:06:57.374875 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.374858    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rcrxc" event={"ID":"6cbd9b58-6895-4378-95dc-7541b9cab4b0","Type":"ContainerStarted","Data":"7b888f3683a096349ffbba60486becd1357a1b8a7947fc4327e508244d2ebf17"}
Jul 06 20:06:57.375945 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.375926    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5zv49" event={"ID":"b5063a29-75aa-4ba2-8891-3dcc53464f94","Type":"ContainerStarted","Data":"018982b1cb7ce3823ee902ca0268479bb9daea0ada02c30ec92d7bf4086b8e5f"}
Jul 06 20:06:57.376966 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.376948    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wsxpw" event={"ID":"d7078019-dd34-434c-81b1-bf5685ff76ed","Type":"ContainerStarted","Data":"51e2e4e28f366c50181e90bc9b1c3aa6f71a603895d5fa85957bd6172865d09a"}
Jul 06 20:06:57.377975 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.377957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6" event={"ID":"9cf44281-2754-4a48-b05d-d9260651fc08","Type":"ContainerStarted","Data":"f279e20c4246c0610dda5ca3515b5c6f2836e5a707b07c8f47e7b5a252ede9f4"}
Jul 06 20:06:57.379012 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.378989    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6957c578d5-5nrs6" event={"ID":"aacf78fb-d069-415d-8c92-0b8ba5ca0edf","Type":"ContainerStarted","Data":"4a5d7de17aead3c1b8e8a50c1bd0d2ddbd9b132f17f70696cfdc162fcee4336d"}
Jul 06 20:06:57.380367 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.380343    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-988f549c8-frzk4" event={"ID":"f81738e4-4dc5-4744-8133-e6bcee225405","Type":"ContainerStarted","Data":"13d01c0110d7838078fae50865c35649454daee02731e61fb4260ca5ff51397e"}
Jul 06 20:06:57.380447 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.380375    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-988f549c8-frzk4" event={"ID":"f81738e4-4dc5-4744-8133-e6bcee225405","Type":"ContainerStarted","Data":"bfac5bf8d840da24a2aa08471cdcaba9f12636d4918154b852cdd15e1f5da9a3"}
Jul 06 20:06:57.380447 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.380411    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:06:57.407236 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.407176    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9m7jk" podStartSLOduration=17.909556154 podStartE2EDuration="24.407160517s" totalImagesPullingTime="6.497604363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:06:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:57.406515369 +0000 UTC m=+66.947926363" watchObservedRunningTime="2026-07-06 20:06:57.407160517 +0000 UTC m=+66.948571509"
Jul 06 20:06:57.429664 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:57.429618    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-988f549c8-frzk4" podStartSLOduration=2.429603183 podStartE2EDuration="2.429603183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:57.428273407 +0000 UTC m=+66.969684399" watchObservedRunningTime="2026-07-06 20:06:57.429603183 +0000 UTC m=+66.971014153"
Jul 06 20:06:58.341653 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:06:58.341621    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tlx2b"
Jul 06 20:07:03.371318 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:03.371282    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8"]
Jul 06 20:07:03.396823 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:03.396778    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8"]
Jul 06 20:07:03.396994 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:03.396897    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8"
Jul 06 20:07:03.402746 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:03.402675    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-p99w2\""
Jul 06 20:07:03.403676 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:03.403651    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 20:07:03.462291 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:03.462250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c06c3b05-aa9c-48dd-b92b-aa82aae306dd-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-5w7f8\" (UID: \"c06c3b05-aa9c-48dd-b92b-aa82aae306dd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8"
Jul 06 20:07:03.563331 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:03.563294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c06c3b05-aa9c-48dd-b92b-aa82aae306dd-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-5w7f8\" (UID: \"c06c3b05-aa9c-48dd-b92b-aa82aae306dd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8"
Jul 06 20:07:03.565768 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:03.565744    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c06c3b05-aa9c-48dd-b92b-aa82aae306dd-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-5w7f8\" (UID: \"c06c3b05-aa9c-48dd-b92b-aa82aae306dd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8"
Jul 06 20:07:03.709927 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:03.709834    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8"
Jul 06 20:07:06.222168 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.222110    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8"]
Jul 06 20:07:06.225284 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:07:06.225253    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06c3b05_aa9c_48dd_b92b_aa82aae306dd.slice/crio-deae16deefa0b3756700ee0a6ee76b37879c52dd18e4f0987e4c346c570b19ff WatchSource:0}: Error finding container deae16deefa0b3756700ee0a6ee76b37879c52dd18e4f0987e4c346c570b19ff: Status 404 returned error can't find the container with id deae16deefa0b3756700ee0a6ee76b37879c52dd18e4f0987e4c346c570b19ff
Jul 06 20:07:06.422025 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.421951    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6957c578d5-5nrs6" event={"ID":"aacf78fb-d069-415d-8c92-0b8ba5ca0edf","Type":"ContainerStarted","Data":"6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6"}
Jul 06 20:07:06.423591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.423531    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8" event={"ID":"c06c3b05-aa9c-48dd-b92b-aa82aae306dd","Type":"ContainerStarted","Data":"deae16deefa0b3756700ee0a6ee76b37879c52dd18e4f0987e4c346c570b19ff"}
Jul 06 20:07:06.426364 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.426325    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-thz5p" event={"ID":"07d190c2-2d5c-4c50-9e18-56b25a2d5ada","Type":"ContainerStarted","Data":"fe55262354f06d099a3b567f724348b68a20e6514d091a46cb9b3310d4dc182f"}
Jul 06 20:07:06.427762 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.427741    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rcrxc" event={"ID":"6cbd9b58-6895-4378-95dc-7541b9cab4b0","Type":"ContainerStarted","Data":"32a57ba9335caa9ab4e51052987ff266b6657e396b1d1da621edcff60ecdbe70"}
Jul 06 20:07:06.428012 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.427968    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:07:06.429782 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.429756    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wsxpw" event={"ID":"d7078019-dd34-434c-81b1-bf5685ff76ed","Type":"ContainerStarted","Data":"5f80a7fb6c3148c824d2dae27bea27928ebbce2ef9ee61215d37416b8eb865f9"}
Jul 06 20:07:06.432230 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.431909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6" event={"ID":"9cf44281-2754-4a48-b05d-d9260651fc08","Type":"ContainerStarted","Data":"97d9fd0c190977e7ce6b8784777e10bdb425be9462f5329ed4d6349b4da45e42"}
Jul 06 20:07:06.447542 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.447484    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6957c578d5-5nrs6" podStartSLOduration=1.699979301 podStartE2EDuration="10.447463914s" totalImagesPullingTime="8.747484613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:06.445159504 +0000 UTC m=+75.986570500" watchObservedRunningTime="2026-07-06 20:07:06.447463914 +0000 UTC m=+75.988874907"
Jul 06 20:07:06.465928 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.465874    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wsxpw" podStartSLOduration=66.61873192 podStartE2EDuration="1m15.465858199s" totalImagesPullingTime="8.847126279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:06.464183405 +0000 UTC m=+76.005594398" watchObservedRunningTime="2026-07-06 20:07:06.465858199 +0000 UTC m=+76.007269169"
Jul 06 20:07:06.486196 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.486151    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rcrxc" podStartSLOduration=66.61349814 podStartE2EDuration="1m15.486140645s" totalImagesPullingTime="8.872642505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:06.485642898 +0000 UTC m=+76.027053893" watchObservedRunningTime="2026-07-06 20:07:06.486140645 +0000 UTC m=+76.027551636"
Jul 06 20:07:06.509534 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:06.509477    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76d8f88b8b-4mdg6" podStartSLOduration=3.011899735 podStartE2EDuration="12.509453524s" totalImagesPullingTime="9.497553789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:06.507292942 +0000 UTC m=+76.048703939" watchObservedRunningTime="2026-07-06 20:07:06.509453524 +0000 UTC m=+76.050864519"
Jul 06 20:07:07.136896 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:07.136852    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:07:07.137082 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:07.136917    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:07:07.143285 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:07.143259    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:07:07.439336 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:07.439180    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-thz5p" event={"ID":"07d190c2-2d5c-4c50-9e18-56b25a2d5ada","Type":"ContainerStarted","Data":"fe6615ef94360396707d9fa48b3659eba2638db7c72e85e1c25d3f650de10527"}
Jul 06 20:07:07.444490 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:07.444462    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:07:07.460277 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:07.460192    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-thz5p" podStartSLOduration=67.720609641 podStartE2EDuration="1m16.460169601s" totalImagesPullingTime="8.73955996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:07.457909916 +0000 UTC m=+76.999320913" watchObservedRunningTime="2026-07-06 20:07:07.460169601 +0000 UTC m=+77.001580595"
Jul 06 20:07:08.445082 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:08.445040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8" event={"ID":"c06c3b05-aa9c-48dd-b92b-aa82aae306dd","Type":"ContainerStarted","Data":"1bdfe42cb71503f4d4385cf8c7c9c3fdf39f677d99e0fb28b1819892f7da8b2c"}
Jul 06 20:07:08.445567 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:08.445546    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8"
Jul 06 20:07:08.453258 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:08.451000    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8"
Jul 06 20:07:08.518180 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:08.518123    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-5w7f8" podStartSLOduration=3.976416154 podStartE2EDuration="5.518101869s" totalImagesPullingTime="1.541685715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:08.476702657 +0000 UTC m=+78.018113651" watchObservedRunningTime="2026-07-06 20:07:08.518101869 +0000 UTC m=+78.059512862"
Jul 06 20:07:09.469347 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.469296    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"]
Jul 06 20:07:09.472470 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.472450    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.475021 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.474985    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 20:07:09.476026 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.475984    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 20:07:09.476155 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.476093    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zngwk\""
Jul 06 20:07:09.476155 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.476116    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 20:07:09.476313 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.476194    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 20:07:09.476496 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.476466    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 20:07:09.490104 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.490081    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"]
Jul 06 20:07:09.509865 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.509832    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4defa085-b69e-40cb-9d1c-b4316ee823af-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.509865 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.509865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmm87\" (UniqueName: \"kubernetes.io/projected/4defa085-b69e-40cb-9d1c-b4316ee823af-kube-api-access-gmm87\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.510075 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.509997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4defa085-b69e-40cb-9d1c-b4316ee823af-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.510075 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.510029    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4defa085-b69e-40cb-9d1c-b4316ee823af-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.611404 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.611358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4defa085-b69e-40cb-9d1c-b4316ee823af-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.611404 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.611412    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4defa085-b69e-40cb-9d1c-b4316ee823af-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.611644 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.611473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4defa085-b69e-40cb-9d1c-b4316ee823af-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.611644 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.611508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmm87\" (UniqueName: \"kubernetes.io/projected/4defa085-b69e-40cb-9d1c-b4316ee823af-kube-api-access-gmm87\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.612288 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.612262    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4defa085-b69e-40cb-9d1c-b4316ee823af-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.614422 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.614394    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4defa085-b69e-40cb-9d1c-b4316ee823af-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.614790 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.614764    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4defa085-b69e-40cb-9d1c-b4316ee823af-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.628780 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.628753    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmm87\" (UniqueName: \"kubernetes.io/projected/4defa085-b69e-40cb-9d1c-b4316ee823af-kube-api-access-gmm87\") pod \"prometheus-operator-567f7b8b7c-kffwh\" (UID: \"4defa085-b69e-40cb-9d1c-b4316ee823af\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.783478 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.783393    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"
Jul 06 20:07:09.935405 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:09.935359    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh"]
Jul 06 20:07:09.938179 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:07:09.938151    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4defa085_b69e_40cb_9d1c_b4316ee823af.slice/crio-f4f3768abcb194315e90934d80e8b2f1cd98213747eb89aba16e435e769fdd92 WatchSource:0}: Error finding container f4f3768abcb194315e90934d80e8b2f1cd98213747eb89aba16e435e769fdd92: Status 404 returned error can't find the container with id f4f3768abcb194315e90934d80e8b2f1cd98213747eb89aba16e435e769fdd92
Jul 06 20:07:10.453777 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:10.453738    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh" event={"ID":"4defa085-b69e-40cb-9d1c-b4316ee823af","Type":"ContainerStarted","Data":"f4f3768abcb194315e90934d80e8b2f1cd98213747eb89aba16e435e769fdd92"}
Jul 06 20:07:18.155529 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:18.155413    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6957c578d5-5nrs6"]
Jul 06 20:07:18.393451 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:18.393424    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-988f549c8-frzk4"
Jul 06 20:07:19.488686 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:19.488644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5zv49" event={"ID":"b5063a29-75aa-4ba2-8891-3dcc53464f94","Type":"ContainerStarted","Data":"df39c9a787db5f08c4390e76236dfe10130ffdd1442520cee00d3d938e98ab1a"}
Jul 06 20:07:19.489689 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:19.488924    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-5zv49"
Jul 06 20:07:19.491547 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:19.491021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh" event={"ID":"4defa085-b69e-40cb-9d1c-b4316ee823af","Type":"ContainerStarted","Data":"89c8c201f739c2731e9579b10ef5ddb968a40f1b5255f42339ff6b7fcc58df57"}
Jul 06 20:07:19.491547 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:19.491071    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh" event={"ID":"4defa085-b69e-40cb-9d1c-b4316ee823af","Type":"ContainerStarted","Data":"ade1ab28aa1deab2dd8bb10a55c99fe18cd0b85e0e6f53f987899f13299676d6"}
Jul 06 20:07:19.502016 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:19.501989    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-5zv49"
Jul 06 20:07:19.520927 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:19.520870    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-5zv49" podStartSLOduration=2.611904341 podStartE2EDuration="24.520848467s" totalImagesPullingTime="21.908944126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:19.520516542 +0000 UTC m=+89.061927542" watchObservedRunningTime="2026-07-06 20:07:19.520848467 +0000 UTC m=+89.062259464"
Jul 06 20:07:22.057183 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.057123    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kffwh" podStartSLOduration=4.544966185 podStartE2EDuration="13.057099035s" totalImagesPullingTime="8.51213285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:19.604770235 +0000 UTC m=+89.146181231" watchObservedRunningTime="2026-07-06 20:07:22.057099035 +0000 UTC m=+91.598510031"
Jul 06 20:07:22.059382 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.059360    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vs29m"]
Jul 06 20:07:22.079879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.079850    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.083062 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.083033    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lbch4\""
Jul 06 20:07:22.083221 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.083074    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 20:07:22.083385 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.083344    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 20:07:22.084944 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.084768    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 20:07:22.219392 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.219350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-accelerators-collector-config\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.219586 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.219407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.219586 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.219438    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-metrics-client-ca\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.219586 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.219502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-tls\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.219586 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.219557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp29k\" (UniqueName: \"kubernetes.io/projected/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-kube-api-access-jp29k\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.219794 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.219633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-textfile\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.219794 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.219665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-wtmp\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.219794 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.219697    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-root\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.219794 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.219756    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-sys\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.320693 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.320653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp29k\" (UniqueName: \"kubernetes.io/projected/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-kube-api-access-jp29k\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.320879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.320728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-textfile\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.320879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.320750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-wtmp\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.320879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.320774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-root\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.320879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.320803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-sys\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.320879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.320836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-accelerators-collector-config\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.320879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.320865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.321230 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.320893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-metrics-client-ca\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.321230 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.320918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-tls\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.321230 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.320992    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-sys\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.321230 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.321081    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-wtmp\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.321230 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.321123    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-textfile\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.321477 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.321450    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-root\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.321944 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.321921    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-metrics-client-ca\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.322060 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.322039    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-accelerators-collector-config\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.323597 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.323571    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.323880 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.323854    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-node-exporter-tls\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.330490 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.330444    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp29k\" (UniqueName: \"kubernetes.io/projected/0dbe89b2-1ec2-486e-bfe6-488bd818dfe4-kube-api-access-jp29k\") pod \"node-exporter-vs29m\" (UID: \"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4\") " pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.393358 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.393322    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vs29m"
Jul 06 20:07:22.427997 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:07:22.427965    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbe89b2_1ec2_486e_bfe6_488bd818dfe4.slice/crio-5c94df0da5ba2f1f0894dbc4f851f7773597de189ed667879a6b5e8b2f5d4a34 WatchSource:0}: Error finding container 5c94df0da5ba2f1f0894dbc4f851f7773597de189ed667879a6b5e8b2f5d4a34: Status 404 returned error can't find the container with id 5c94df0da5ba2f1f0894dbc4f851f7773597de189ed667879a6b5e8b2f5d4a34
Jul 06 20:07:22.504804 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:22.504761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vs29m" event={"ID":"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4","Type":"ContainerStarted","Data":"5c94df0da5ba2f1f0894dbc4f851f7773597de189ed667879a6b5e8b2f5d4a34"}
Jul 06 20:07:24.516142 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:24.516105    2582 generic.go:356] "Generic (PLEG): container finished" podID="0dbe89b2-1ec2-486e-bfe6-488bd818dfe4" containerID="448ecafa1b3ae2f1a11e46aeb178d9d888722dd19426ab4b2ce24e51d7399eac" exitCode=0
Jul 06 20:07:24.516673 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:24.516215    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vs29m" event={"ID":"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4","Type":"ContainerDied","Data":"448ecafa1b3ae2f1a11e46aeb178d9d888722dd19426ab4b2ce24e51d7399eac"}
Jul 06 20:07:25.038838 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.038761    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"]
Jul 06 20:07:25.063460 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.063182    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"]
Jul 06 20:07:25.063460 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.063321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.066049 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.066022    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8fttl6njised\""
Jul 06 20:07:25.066732 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.066712    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 20:07:25.067097 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.067078    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lsfxd\""
Jul 06 20:07:25.067763 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.067348    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 20:07:25.067763 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.067431    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 20:07:25.067763 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.067574    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 20:07:25.067763 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.067642    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 20:07:25.146225 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.146168    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc7q9\" (UniqueName: \"kubernetes.io/projected/d932eb97-316a-4fe3-8aad-c5ec74eef369-kube-api-access-zc7q9\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.146393 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.146265    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.146393 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.146301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-tls\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.146393 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.146333    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d932eb97-316a-4fe3-8aad-c5ec74eef369-metrics-client-ca\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.146393 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.146364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-grpc-tls\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.146571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.146407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.146571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.146432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.146571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.146486    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.247302 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.247258    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.247484 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.247317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7q9\" (UniqueName: \"kubernetes.io/projected/d932eb97-316a-4fe3-8aad-c5ec74eef369-kube-api-access-zc7q9\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.247484 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.247369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.247484 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.247394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-tls\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.247484 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.247429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d932eb97-316a-4fe3-8aad-c5ec74eef369-metrics-client-ca\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.247484 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.247463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-grpc-tls\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.247730 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.247517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.247730 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.247555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.249044 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.249011    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d932eb97-316a-4fe3-8aad-c5ec74eef369-metrics-client-ca\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.250691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.250627    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.250691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.250632    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.251237 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.251197    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-tls\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.251624 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.251575    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.251624 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.251570    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.253546 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.253523    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d932eb97-316a-4fe3-8aad-c5ec74eef369-secret-grpc-tls\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.260158 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.260135    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc7q9\" (UniqueName: \"kubernetes.io/projected/d932eb97-316a-4fe3-8aad-c5ec74eef369-kube-api-access-zc7q9\") pod \"thanos-querier-54d74fc4fb-5zsld\" (UID: \"d932eb97-316a-4fe3-8aad-c5ec74eef369\") " pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.378657 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.378570    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:25.525243 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.524749    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vs29m" event={"ID":"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4","Type":"ContainerStarted","Data":"fb3b632d7f6d0c563a4e3a0efaa52580be3c31edd3f356cd548a3808ffe4281e"}
Jul 06 20:07:25.525243 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.524820    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vs29m" event={"ID":"0dbe89b2-1ec2-486e-bfe6-488bd818dfe4","Type":"ContainerStarted","Data":"05cf080be79b612e8af7034260a5e5dc506f8931dd0aad8fad46d70d581f2af1"}
Jul 06 20:07:25.551686 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.551621    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vs29m" podStartSLOduration=2.002001149 podStartE2EDuration="3.551600746s" totalImagesPullingTime="1.444458043s" totalInitContainerRuntime="105.141554ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:25.548266971 +0000 UTC m=+95.089677966" watchObservedRunningTime="2026-07-06 20:07:25.551600746 +0000 UTC m=+95.093011739"
Jul 06 20:07:25.567493 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:25.566861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"]
Jul 06 20:07:25.569861 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:07:25.569829    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd932eb97_316a_4fe3_8aad_c5ec74eef369.slice/crio-fce1b610ccbaff281b72fbb056213be5a230e868d16fb639ba7a9de4d775f2e1 WatchSource:0}: Error finding container fce1b610ccbaff281b72fbb056213be5a230e868d16fb639ba7a9de4d775f2e1: Status 404 returned error can't find the container with id fce1b610ccbaff281b72fbb056213be5a230e868d16fb639ba7a9de4d775f2e1
Jul 06 20:07:26.531224 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.531156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld" event={"ID":"d932eb97-316a-4fe3-8aad-c5ec74eef369","Type":"ContainerStarted","Data":"fce1b610ccbaff281b72fbb056213be5a230e868d16fb639ba7a9de4d775f2e1"}
Jul 06 20:07:26.591669 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.591435    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"]
Jul 06 20:07:26.617256 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.617216    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.620987 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.620926    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ssvwc\""
Jul 06 20:07:26.623185 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.623154    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 20:07:26.624979 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.624920    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"]
Jul 06 20:07:26.628404 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.628391    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 20:07:26.629373 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.629326    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dk57obvi0d8kr\""
Jul 06 20:07:26.629556 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.629401    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 20:07:26.629670 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.629660    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 20:07:26.761079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.761042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c0836167-2735-442c-962f-990d42f262c5-audit-log\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.761287 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.761102    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c0836167-2735-442c-962f-990d42f262c5-secret-metrics-server-client-certs\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.761287 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.761135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c0836167-2735-442c-962f-990d42f262c5-metrics-server-audit-profiles\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.761287 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.761180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0836167-2735-442c-962f-990d42f262c5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.761450 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.761286    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c0836167-2735-442c-962f-990d42f262c5-secret-metrics-server-tls\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.761450 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.761399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0836167-2735-442c-962f-990d42f262c5-client-ca-bundle\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.761450 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.761430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zmqr\" (UniqueName: \"kubernetes.io/projected/c0836167-2735-442c-962f-990d42f262c5-kube-api-access-4zmqr\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.862245 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.862188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c0836167-2735-442c-962f-990d42f262c5-secret-metrics-server-tls\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.862434 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.862274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0836167-2735-442c-962f-990d42f262c5-client-ca-bundle\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.862434 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.862300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zmqr\" (UniqueName: \"kubernetes.io/projected/c0836167-2735-442c-962f-990d42f262c5-kube-api-access-4zmqr\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.862434 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.862334    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c0836167-2735-442c-962f-990d42f262c5-audit-log\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.863291 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.862658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c0836167-2735-442c-962f-990d42f262c5-secret-metrics-server-client-certs\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.863291 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.862707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c0836167-2735-442c-962f-990d42f262c5-metrics-server-audit-profiles\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.863291 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.862765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0836167-2735-442c-962f-990d42f262c5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.864750 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.863886    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c0836167-2735-442c-962f-990d42f262c5-metrics-server-audit-profiles\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.864750 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.864365    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0836167-2735-442c-962f-990d42f262c5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.865745 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.865467    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c0836167-2735-442c-962f-990d42f262c5-audit-log\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.866647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.866152    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c0836167-2735-442c-962f-990d42f262c5-secret-metrics-server-tls\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.866647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.866612    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0836167-2735-442c-962f-990d42f262c5-client-ca-bundle\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.868085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.868061    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c0836167-2735-442c-962f-990d42f262c5-secret-metrics-server-client-certs\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.879716 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.879667    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zmqr\" (UniqueName: \"kubernetes.io/projected/c0836167-2735-442c-962f-990d42f262c5-kube-api-access-4zmqr\") pod \"metrics-server-5f9fb8d564-9g2cr\" (UID: \"c0836167-2735-442c-962f-990d42f262c5\") " pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:26.932624 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:26.932582    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:27.122628 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.122601    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"]
Jul 06 20:07:27.125344 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:07:27.125312    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0836167_2735_442c_962f_990d42f262c5.slice/crio-8f42bbbd3302b73475f4e6866043b3753591d094abfc73fbbcb237747bcb43e1 WatchSource:0}: Error finding container 8f42bbbd3302b73475f4e6866043b3753591d094abfc73fbbcb237747bcb43e1: Status 404 returned error can't find the container with id 8f42bbbd3302b73475f4e6866043b3753591d094abfc73fbbcb237747bcb43e1
Jul 06 20:07:27.351455 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.351417    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"]
Jul 06 20:07:27.375495 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.375405    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"]
Jul 06 20:07:27.375645 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.375505    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.379743 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.379535    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5fqzf\""
Jul 06 20:07:27.379743 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.379659    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 20:07:27.379743 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.379546    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 20:07:27.380166 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.380136    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 20:07:27.380841 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.380574    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 20:07:27.380971 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.380929    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 20:07:27.400512 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.400486    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 20:07:27.467539 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.467508    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-telemeter-client-tls\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.467706 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.467557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dqrs\" (UniqueName: \"kubernetes.io/projected/3f3c299b-6bd5-4851-b298-32571600be12-kube-api-access-9dqrs\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.467706 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.467580    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-federate-client-tls\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.467706 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.467642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3c299b-6bd5-4851-b298-32571600be12-serving-certs-ca-bundle\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.467830 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.467723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3c299b-6bd5-4851-b298-32571600be12-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.467830 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.467754    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-secret-telemeter-client\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.467830 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.467791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f3c299b-6bd5-4851-b298-32571600be12-metrics-client-ca\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.467830 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.467814    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.538964 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.538921    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr" event={"ID":"c0836167-2735-442c-962f-990d42f262c5","Type":"ContainerStarted","Data":"8f42bbbd3302b73475f4e6866043b3753591d094abfc73fbbcb237747bcb43e1"}
Jul 06 20:07:27.568916 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.568886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3c299b-6bd5-4851-b298-32571600be12-serving-certs-ca-bundle\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.569091 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.568936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3c299b-6bd5-4851-b298-32571600be12-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.569091 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.568959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-secret-telemeter-client\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.569091 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.568991    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f3c299b-6bd5-4851-b298-32571600be12-metrics-client-ca\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.569091 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.569023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.569091 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.569064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-telemeter-client-tls\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.569345 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.569098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dqrs\" (UniqueName: \"kubernetes.io/projected/3f3c299b-6bd5-4851-b298-32571600be12-kube-api-access-9dqrs\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.569345 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.569131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-federate-client-tls\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.569925 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.569873    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f3c299b-6bd5-4851-b298-32571600be12-metrics-client-ca\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.569925 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.569888    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3c299b-6bd5-4851-b298-32571600be12-serving-certs-ca-bundle\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.570098 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.569994    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3c299b-6bd5-4851-b298-32571600be12-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.572234 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.572197    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.572430 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.572410    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-federate-client-tls\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.572492 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.572419    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-telemeter-client-tls\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.573888 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.573862    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f3c299b-6bd5-4851-b298-32571600be12-secret-telemeter-client\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.581320 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.581294    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dqrs\" (UniqueName: \"kubernetes.io/projected/3f3c299b-6bd5-4851-b298-32571600be12-kube-api-access-9dqrs\") pod \"telemeter-client-6dffdd7bcc-b4jrh\" (UID: \"3f3c299b-6bd5-4851-b298-32571600be12\") " pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:27.689521 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:27.689427    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"
Jul 06 20:07:28.013472 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.013443    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67474755d6-x62jb"]
Jul 06 20:07:28.029061 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.029034    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.029867 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.029071    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67474755d6-x62jb"]
Jul 06 20:07:28.037363 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.036959    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 20:07:28.070440 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.070138    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh"]
Jul 06 20:07:28.074692 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:07:28.074658    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3c299b_6bd5_4851_b298_32571600be12.slice/crio-0092fa7af55270d36bb4e2084aec52667868f76c5fab3fee60bfe0fa444f08df WatchSource:0}: Error finding container 0092fa7af55270d36bb4e2084aec52667868f76c5fab3fee60bfe0fa444f08df: Status 404 returned error can't find the container with id 0092fa7af55270d36bb4e2084aec52667868f76c5fab3fee60bfe0fa444f08df
Jul 06 20:07:28.176047 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.176009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-oauth-serving-cert\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.177085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.176343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-console-config\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.177085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.176386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-oauth-config\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.177085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.176436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-trusted-ca-bundle\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.177085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.176531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-serving-cert\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.177085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.176555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-service-ca\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.177085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.176577    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kb4k\" (UniqueName: \"kubernetes.io/projected/eacf10c4-48af-42cd-b7da-7364333b81fa-kube-api-access-7kb4k\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.277801 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.277719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-trusted-ca-bundle\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.277801 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.277793    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-serving-cert\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.278009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.277820    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-service-ca\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.278009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.277844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kb4k\" (UniqueName: \"kubernetes.io/projected/eacf10c4-48af-42cd-b7da-7364333b81fa-kube-api-access-7kb4k\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.278009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.277879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-oauth-serving-cert\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.278009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.277912    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-console-config\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.278009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.277936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-oauth-config\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.278740 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.278711    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-oauth-serving-cert\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.278851 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.278742    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-trusted-ca-bundle\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.278851 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.278711    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-console-config\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.278851 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.278820    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-service-ca\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.280615 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.280591    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-oauth-config\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.280763 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.280591    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-serving-cert\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.289364 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.289345    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kb4k\" (UniqueName: \"kubernetes.io/projected/eacf10c4-48af-42cd-b7da-7364333b81fa-kube-api-access-7kb4k\") pod \"console-67474755d6-x62jb\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") " pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.340592 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.340566    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:28.553401 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.553371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld" event={"ID":"d932eb97-316a-4fe3-8aad-c5ec74eef369","Type":"ContainerStarted","Data":"b2fbe36d3b2aa8dc64c2fe31860e5e68acf120d6701ad21102babfcf94809328"}
Jul 06 20:07:28.555458 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.555427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh" event={"ID":"3f3c299b-6bd5-4851-b298-32571600be12","Type":"ContainerStarted","Data":"0092fa7af55270d36bb4e2084aec52667868f76c5fab3fee60bfe0fa444f08df"}
Jul 06 20:07:28.565294 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:28.565271    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67474755d6-x62jb"]
Jul 06 20:07:28.567499 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:07:28.567475    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeacf10c4_48af_42cd_b7da_7364333b81fa.slice/crio-55dcc07e8bbb3537977db468e77bd995079bda7c984280de025b6bb82d13f407 WatchSource:0}: Error finding container 55dcc07e8bbb3537977db468e77bd995079bda7c984280de025b6bb82d13f407: Status 404 returned error can't find the container with id 55dcc07e8bbb3537977db468e77bd995079bda7c984280de025b6bb82d13f407
Jul 06 20:07:29.560894 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:29.560859    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67474755d6-x62jb" event={"ID":"eacf10c4-48af-42cd-b7da-7364333b81fa","Type":"ContainerStarted","Data":"51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922"}
Jul 06 20:07:29.561477 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:29.560920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67474755d6-x62jb" event={"ID":"eacf10c4-48af-42cd-b7da-7364333b81fa","Type":"ContainerStarted","Data":"55dcc07e8bbb3537977db468e77bd995079bda7c984280de025b6bb82d13f407"}
Jul 06 20:07:29.563057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:29.563035    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld" event={"ID":"d932eb97-316a-4fe3-8aad-c5ec74eef369","Type":"ContainerStarted","Data":"0f6a399e0a800afd6c092efb61fadb60bcf8760325000cf0b71e5496fa78f6ee"}
Jul 06 20:07:29.563163 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:29.563087    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld" event={"ID":"d932eb97-316a-4fe3-8aad-c5ec74eef369","Type":"ContainerStarted","Data":"8e2046e71e4eafc6c43a4e0ec146163b7108c1634ea4774d6f0ca8aaeeee8c8b"}
Jul 06 20:07:29.594518 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:29.594464    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67474755d6-x62jb" podStartSLOduration=2.594447657 podStartE2EDuration="2.594447657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:29.593599509 +0000 UTC m=+99.135010501" watchObservedRunningTime="2026-07-06 20:07:29.594447657 +0000 UTC m=+99.135858698"
Jul 06 20:07:31.571865 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:31.571829    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr" event={"ID":"c0836167-2735-442c-962f-990d42f262c5","Type":"ContainerStarted","Data":"c0becc85bbf170be9d3f56f3ad33fe34935eaf6ab219be5682588b72f2955403"}
Jul 06 20:07:31.573308 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:31.573287    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh" event={"ID":"3f3c299b-6bd5-4851-b298-32571600be12","Type":"ContainerStarted","Data":"e65b761beb2f1e1a42c2ec5b3ab1dc6778dd3484910b5810c43a8fd94ea35bb2"}
Jul 06 20:07:31.575959 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:31.575935    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld" event={"ID":"d932eb97-316a-4fe3-8aad-c5ec74eef369","Type":"ContainerStarted","Data":"e680ac10ad1be4739872ec2f6c913334418a48ee636efa809cf7c6f0d916638b"}
Jul 06 20:07:31.576170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:31.575986    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld" event={"ID":"d932eb97-316a-4fe3-8aad-c5ec74eef369","Type":"ContainerStarted","Data":"dfdd2fc26c1705e1073bc6b14f0589e4eb0250a99dd68694fc1a60bbda40d882"}
Jul 06 20:07:31.576170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:31.576021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld" event={"ID":"d932eb97-316a-4fe3-8aad-c5ec74eef369","Type":"ContainerStarted","Data":"c66b1fc3d7fbf5a6ca49bb5bb9d1d278dbad54d4c7d3cc4ed649ce238b2ff272"}
Jul 06 20:07:31.576170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:31.576089    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:31.598098 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:31.598058    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr" podStartSLOduration=2.00502904 podStartE2EDuration="5.59804609s" totalImagesPullingTime="3.59301705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:31.597919396 +0000 UTC m=+101.139330390" watchObservedRunningTime="2026-07-06 20:07:31.59804609 +0000 UTC m=+101.139457083"
Jul 06 20:07:31.648924 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:31.648865    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld" podStartSLOduration=1.879746146 podStartE2EDuration="6.648846698s" totalImagesPullingTime="4.769100552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:31.647259921 +0000 UTC m=+101.188670913" watchObservedRunningTime="2026-07-06 20:07:31.648846698 +0000 UTC m=+101.190257692"
Jul 06 20:07:33.587448 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:33.587410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh" event={"ID":"3f3c299b-6bd5-4851-b298-32571600be12","Type":"ContainerStarted","Data":"926d8f61ec4d4eaa60725677ef28f38b9d98bd45d42cb0ca60e399be76baa662"}
Jul 06 20:07:33.587860 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:33.587473    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh" event={"ID":"3f3c299b-6bd5-4851-b298-32571600be12","Type":"ContainerStarted","Data":"a5ba83b5664225c7ee0ce21b9ffa0c4f2c80d2f2c8b5c4501521472fc0669333"}
Jul 06 20:07:33.620009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:33.619949    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6dffdd7bcc-b4jrh" podStartSLOduration=2.007332296 podStartE2EDuration="6.619928299s" totalImagesPullingTime="4.612596003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:33.618028471 +0000 UTC m=+103.159439476" watchObservedRunningTime="2026-07-06 20:07:33.619928299 +0000 UTC m=+103.161339293"
Jul 06 20:07:34.612387 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.612356    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67474755d6-x62jb"]
Jul 06 20:07:34.658067 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.658033    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fc6475df8-6plm2"]
Jul 06 20:07:34.680112 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.680085    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc6475df8-6plm2"]
Jul 06 20:07:34.680275 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.680176    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.838324 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.838283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-oauth-config\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.838509 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.838339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-console-config\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.838509 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.838356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lffsx\" (UniqueName: \"kubernetes.io/projected/6e634349-22e5-47c1-8218-db82434530a1-kube-api-access-lffsx\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.838509 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.838429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-serving-cert\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.838509 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.838447    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-service-ca\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.838509 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.838475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-trusted-ca-bundle\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.838509 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.838497    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-oauth-serving-cert\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.939282 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.939160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-console-config\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.939282 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.939227    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lffsx\" (UniqueName: \"kubernetes.io/projected/6e634349-22e5-47c1-8218-db82434530a1-kube-api-access-lffsx\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.939282 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.939252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-serving-cert\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.939282 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.939274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-service-ca\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.939611 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.939312    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-trusted-ca-bundle\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.939611 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.939347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-oauth-serving-cert\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.939611 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.939420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-oauth-config\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.940054 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.940025    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-oauth-serving-cert\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.940172 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.940049    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-service-ca\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.940266 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.940238    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-console-config\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.940266 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.940236    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-trusted-ca-bundle\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.941799 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.941772    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-oauth-config\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.941894 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.941875    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-serving-cert\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.951872 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.951852    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lffsx\" (UniqueName: \"kubernetes.io/projected/6e634349-22e5-47c1-8218-db82434530a1-kube-api-access-lffsx\") pod \"console-6fc6475df8-6plm2\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") " pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:34.988911 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:34.988878    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:35.152042 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:35.152017    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc6475df8-6plm2"]
Jul 06 20:07:35.153918 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:07:35.153891    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e634349_22e5_47c1_8218_db82434530a1.slice/crio-5e19e6ee73dc4ce2ff668c3daee31dc9cde1d0160fc02f863bc9ea7a7930133f WatchSource:0}: Error finding container 5e19e6ee73dc4ce2ff668c3daee31dc9cde1d0160fc02f863bc9ea7a7930133f: Status 404 returned error can't find the container with id 5e19e6ee73dc4ce2ff668c3daee31dc9cde1d0160fc02f863bc9ea7a7930133f
Jul 06 20:07:35.596520 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:35.596485    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc6475df8-6plm2" event={"ID":"6e634349-22e5-47c1-8218-db82434530a1","Type":"ContainerStarted","Data":"350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3"}
Jul 06 20:07:35.596693 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:35.596535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc6475df8-6plm2" event={"ID":"6e634349-22e5-47c1-8218-db82434530a1","Type":"ContainerStarted","Data":"5e19e6ee73dc4ce2ff668c3daee31dc9cde1d0160fc02f863bc9ea7a7930133f"}
Jul 06 20:07:35.622288 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:35.622243    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fc6475df8-6plm2" podStartSLOduration=1.622228281 podStartE2EDuration="1.622228281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:35.620455384 +0000 UTC m=+105.161866388" watchObservedRunningTime="2026-07-06 20:07:35.622228281 +0000 UTC m=+105.163639270"
Jul 06 20:07:37.442240 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:37.442191    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rcrxc"
Jul 06 20:07:37.586593 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:37.586566    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54d74fc4fb-5zsld"
Jul 06 20:07:38.340992 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:38.340946    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:43.175595 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.175554    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6957c578d5-5nrs6" podUID="aacf78fb-d069-415d-8c92-0b8ba5ca0edf" containerName="console" containerID="cri-o://6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6" gracePeriod=15
Jul 06 20:07:43.448354 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.448288    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:07:43.507930 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.507890    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-config\") pod \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") "
Jul 06 20:07:43.507930 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.507930    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-serving-cert\") pod \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") "
Jul 06 20:07:43.508143 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.507959    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88qcx\" (UniqueName: \"kubernetes.io/projected/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-kube-api-access-88qcx\") pod \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") "
Jul 06 20:07:43.508143 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.508067    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-oauth-config\") pod \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") "
Jul 06 20:07:43.508143 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.508107    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-oauth-serving-cert\") pod \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") "
Jul 06 20:07:43.508431 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.508393    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-config" (OuterVolumeSpecName: "console-config") pod "aacf78fb-d069-415d-8c92-0b8ba5ca0edf" (UID: "aacf78fb-d069-415d-8c92-0b8ba5ca0edf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:07:43.508503 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.508484    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aacf78fb-d069-415d-8c92-0b8ba5ca0edf" (UID: "aacf78fb-d069-415d-8c92-0b8ba5ca0edf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:07:43.510458 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.510432    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aacf78fb-d069-415d-8c92-0b8ba5ca0edf" (UID: "aacf78fb-d069-415d-8c92-0b8ba5ca0edf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:07:43.510562 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.510481    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aacf78fb-d069-415d-8c92-0b8ba5ca0edf" (UID: "aacf78fb-d069-415d-8c92-0b8ba5ca0edf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:07:43.510562 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.510516    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-kube-api-access-88qcx" (OuterVolumeSpecName: "kube-api-access-88qcx") pod "aacf78fb-d069-415d-8c92-0b8ba5ca0edf" (UID: "aacf78fb-d069-415d-8c92-0b8ba5ca0edf"). InnerVolumeSpecName "kube-api-access-88qcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:07:43.609004 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.608972    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-service-ca\") pod \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\" (UID: \"aacf78fb-d069-415d-8c92-0b8ba5ca0edf\") "
Jul 06 20:07:43.609184 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.609128    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:07:43.609184 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.609139    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-serving-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:07:43.609184 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.609148    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88qcx\" (UniqueName: \"kubernetes.io/projected/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-kube-api-access-88qcx\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:07:43.609184 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.609157    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-console-oauth-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:07:43.609184 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.609166    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-oauth-serving-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:07:43.609380 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.609350    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-service-ca" (OuterVolumeSpecName: "service-ca") pod "aacf78fb-d069-415d-8c92-0b8ba5ca0edf" (UID: "aacf78fb-d069-415d-8c92-0b8ba5ca0edf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:07:43.627421 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.627390    2582 generic.go:356] "Generic (PLEG): container finished" podID="aacf78fb-d069-415d-8c92-0b8ba5ca0edf" containerID="6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6" exitCode=0
Jul 06 20:07:43.627572 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.627437    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6957c578d5-5nrs6"
Jul 06 20:07:43.627572 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.627469    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6957c578d5-5nrs6" event={"ID":"aacf78fb-d069-415d-8c92-0b8ba5ca0edf","Type":"ContainerDied","Data":"6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6"}
Jul 06 20:07:43.627572 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.627508    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6957c578d5-5nrs6" event={"ID":"aacf78fb-d069-415d-8c92-0b8ba5ca0edf","Type":"ContainerDied","Data":"4a5d7de17aead3c1b8e8a50c1bd0d2ddbd9b132f17f70696cfdc162fcee4336d"}
Jul 06 20:07:43.627572 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.627526    2582 scope.go:117] "RemoveContainer" containerID="6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6"
Jul 06 20:07:43.638628 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.638605    2582 scope.go:117] "RemoveContainer" containerID="6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6"
Jul 06 20:07:43.638991 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:07:43.638964    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6\": container with ID starting with 6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6 not found: ID does not exist" containerID="6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6"
Jul 06 20:07:43.639074 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.639003    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6"} err="failed to get container status \"6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6\": rpc error: code = NotFound desc = could not find container \"6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6\": container with ID starting with 6aee9712206f8412a2eedf0d9dcff0d59a79a610b4475c5b6e03bbbe079da6e6 not found: ID does not exist"
Jul 06 20:07:43.657082 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.657027    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6957c578d5-5nrs6"]
Jul 06 20:07:43.665877 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.665851    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6957c578d5-5nrs6"]
Jul 06 20:07:43.709615 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:43.709539    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aacf78fb-d069-415d-8c92-0b8ba5ca0edf-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:07:44.989383 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:44.989349    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:44.989898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:44.989400    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:44.994021 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:44.994002    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:45.065127 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:45.065098    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aacf78fb-d069-415d-8c92-0b8ba5ca0edf" path="/var/lib/kubelet/pods/aacf78fb-d069-415d-8c92-0b8ba5ca0edf/volumes"
Jul 06 20:07:45.639557 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:45.639530    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:07:46.933748 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:46.933710    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:46.934139 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:46.933780    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:07:59.634836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.634787    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67474755d6-x62jb" podUID="eacf10c4-48af-42cd-b7da-7364333b81fa" containerName="console" containerID="cri-o://51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922" gracePeriod=15
Jul 06 20:07:59.907446 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.907377    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:07:59.940483 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.940456    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kb4k\" (UniqueName: \"kubernetes.io/projected/eacf10c4-48af-42cd-b7da-7364333b81fa-kube-api-access-7kb4k\") pod \"eacf10c4-48af-42cd-b7da-7364333b81fa\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") "
Jul 06 20:07:59.940483 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.940487    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-oauth-config\") pod \"eacf10c4-48af-42cd-b7da-7364333b81fa\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") "
Jul 06 20:07:59.940715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.940515    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-trusted-ca-bundle\") pod \"eacf10c4-48af-42cd-b7da-7364333b81fa\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") "
Jul 06 20:07:59.940715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.940538    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-oauth-serving-cert\") pod \"eacf10c4-48af-42cd-b7da-7364333b81fa\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") "
Jul 06 20:07:59.940715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.940558    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-serving-cert\") pod \"eacf10c4-48af-42cd-b7da-7364333b81fa\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") "
Jul 06 20:07:59.940715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.940613    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-service-ca\") pod \"eacf10c4-48af-42cd-b7da-7364333b81fa\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") "
Jul 06 20:07:59.940715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.940694    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-console-config\") pod \"eacf10c4-48af-42cd-b7da-7364333b81fa\" (UID: \"eacf10c4-48af-42cd-b7da-7364333b81fa\") "
Jul 06 20:07:59.940972 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.940923    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eacf10c4-48af-42cd-b7da-7364333b81fa" (UID: "eacf10c4-48af-42cd-b7da-7364333b81fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:07:59.940972 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.940947    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eacf10c4-48af-42cd-b7da-7364333b81fa" (UID: "eacf10c4-48af-42cd-b7da-7364333b81fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:07:59.941293 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.941268    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-console-config" (OuterVolumeSpecName: "console-config") pod "eacf10c4-48af-42cd-b7da-7364333b81fa" (UID: "eacf10c4-48af-42cd-b7da-7364333b81fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:07:59.941393 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.941325    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "eacf10c4-48af-42cd-b7da-7364333b81fa" (UID: "eacf10c4-48af-42cd-b7da-7364333b81fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:07:59.942668 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.942640    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eacf10c4-48af-42cd-b7da-7364333b81fa" (UID: "eacf10c4-48af-42cd-b7da-7364333b81fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:07:59.943027 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.943008    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eacf10c4-48af-42cd-b7da-7364333b81fa-kube-api-access-7kb4k" (OuterVolumeSpecName: "kube-api-access-7kb4k") pod "eacf10c4-48af-42cd-b7da-7364333b81fa" (UID: "eacf10c4-48af-42cd-b7da-7364333b81fa"). InnerVolumeSpecName "kube-api-access-7kb4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:07:59.943084 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:07:59.943021    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eacf10c4-48af-42cd-b7da-7364333b81fa" (UID: "eacf10c4-48af-42cd-b7da-7364333b81fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:08:00.042193 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.042157    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-console-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.042193 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.042187    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kb4k\" (UniqueName: \"kubernetes.io/projected/eacf10c4-48af-42cd-b7da-7364333b81fa-kube-api-access-7kb4k\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.042193 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.042198    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-oauth-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.042193 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.042225    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-trusted-ca-bundle\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.042457 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.042234    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-oauth-serving-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.042457 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.042242    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eacf10c4-48af-42cd-b7da-7364333b81fa-console-serving-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.042457 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.042250    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eacf10c4-48af-42cd-b7da-7364333b81fa-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:08:00.692552 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.692518    2582 generic.go:356] "Generic (PLEG): container finished" podID="eacf10c4-48af-42cd-b7da-7364333b81fa" containerID="51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922" exitCode=0
Jul 06 20:08:00.693010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.692569    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67474755d6-x62jb"
Jul 06 20:08:00.693010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.692615    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67474755d6-x62jb" event={"ID":"eacf10c4-48af-42cd-b7da-7364333b81fa","Type":"ContainerDied","Data":"51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922"}
Jul 06 20:08:00.693010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.692670    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67474755d6-x62jb" event={"ID":"eacf10c4-48af-42cd-b7da-7364333b81fa","Type":"ContainerDied","Data":"55dcc07e8bbb3537977db468e77bd995079bda7c984280de025b6bb82d13f407"}
Jul 06 20:08:00.693010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.692699    2582 scope.go:117] "RemoveContainer" containerID="51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922"
Jul 06 20:08:00.712560 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.712510    2582 scope.go:117] "RemoveContainer" containerID="51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922"
Jul 06 20:08:00.712937 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:08:00.712918    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922\": container with ID starting with 51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922 not found: ID does not exist" containerID="51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922"
Jul 06 20:08:00.713022 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.712951    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922"} err="failed to get container status \"51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922\": rpc error: code = NotFound desc = could not find container \"51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922\": container with ID starting with 51c0e9d29c53079ef10bf10e73d46b005d419e1fd974dc05c76c8a2e5a4f9922 not found: ID does not exist"
Jul 06 20:08:00.718915 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.718888    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67474755d6-x62jb"]
Jul 06 20:08:00.724298 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:00.724280    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67474755d6-x62jb"]
Jul 06 20:08:01.065018 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:01.064946    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eacf10c4-48af-42cd-b7da-7364333b81fa" path="/var/lib/kubelet/pods/eacf10c4-48af-42cd-b7da-7364333b81fa/volumes"
Jul 06 20:08:06.938894 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:06.938860    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:08:06.942648 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:06.942625    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f9fb8d564-9g2cr"
Jul 06 20:08:59.579360 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:08:59.579323    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc6475df8-6plm2"]
Jul 06 20:09:24.601928 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.601863    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fc6475df8-6plm2" podUID="6e634349-22e5-47c1-8218-db82434530a1" containerName="console" containerID="cri-o://350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3" gracePeriod=15
Jul 06 20:09:24.843619 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.843596    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:09:24.938057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.937984    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-serving-cert\") pod \"6e634349-22e5-47c1-8218-db82434530a1\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") "
Jul 06 20:09:24.938057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.938018    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-oauth-serving-cert\") pod \"6e634349-22e5-47c1-8218-db82434530a1\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") "
Jul 06 20:09:24.938057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.938049    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-console-config\") pod \"6e634349-22e5-47c1-8218-db82434530a1\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") "
Jul 06 20:09:24.938340 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.938067    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-service-ca\") pod \"6e634349-22e5-47c1-8218-db82434530a1\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") "
Jul 06 20:09:24.938340 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.938082    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-trusted-ca-bundle\") pod \"6e634349-22e5-47c1-8218-db82434530a1\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") "
Jul 06 20:09:24.938340 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.938145    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lffsx\" (UniqueName: \"kubernetes.io/projected/6e634349-22e5-47c1-8218-db82434530a1-kube-api-access-lffsx\") pod \"6e634349-22e5-47c1-8218-db82434530a1\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") "
Jul 06 20:09:24.938340 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.938165    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-oauth-config\") pod \"6e634349-22e5-47c1-8218-db82434530a1\" (UID: \"6e634349-22e5-47c1-8218-db82434530a1\") "
Jul 06 20:09:24.938609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.938561    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e634349-22e5-47c1-8218-db82434530a1" (UID: "6e634349-22e5-47c1-8218-db82434530a1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:09:24.938609 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.938586    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e634349-22e5-47c1-8218-db82434530a1" (UID: "6e634349-22e5-47c1-8218-db82434530a1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:09:24.938764 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.938617    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e634349-22e5-47c1-8218-db82434530a1" (UID: "6e634349-22e5-47c1-8218-db82434530a1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:09:24.938764 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.938640    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-console-config" (OuterVolumeSpecName: "console-config") pod "6e634349-22e5-47c1-8218-db82434530a1" (UID: "6e634349-22e5-47c1-8218-db82434530a1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:09:24.940215 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.940177    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e634349-22e5-47c1-8218-db82434530a1" (UID: "6e634349-22e5-47c1-8218-db82434530a1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:09:24.940303 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.940237    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e634349-22e5-47c1-8218-db82434530a1-kube-api-access-lffsx" (OuterVolumeSpecName: "kube-api-access-lffsx") pod "6e634349-22e5-47c1-8218-db82434530a1" (UID: "6e634349-22e5-47c1-8218-db82434530a1"). InnerVolumeSpecName "kube-api-access-lffsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:09:24.940364 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:24.940312    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e634349-22e5-47c1-8218-db82434530a1" (UID: "6e634349-22e5-47c1-8218-db82434530a1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:09:25.001833 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.001801    2582 generic.go:356] "Generic (PLEG): container finished" podID="6e634349-22e5-47c1-8218-db82434530a1" containerID="350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3" exitCode=0
Jul 06 20:09:25.001983 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.001855    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc6475df8-6plm2"
Jul 06 20:09:25.001983 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.001879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc6475df8-6plm2" event={"ID":"6e634349-22e5-47c1-8218-db82434530a1","Type":"ContainerDied","Data":"350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3"}
Jul 06 20:09:25.001983 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.001929    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc6475df8-6plm2" event={"ID":"6e634349-22e5-47c1-8218-db82434530a1","Type":"ContainerDied","Data":"5e19e6ee73dc4ce2ff668c3daee31dc9cde1d0160fc02f863bc9ea7a7930133f"}
Jul 06 20:09:25.001983 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.001950    2582 scope.go:117] "RemoveContainer" containerID="350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3"
Jul 06 20:09:25.009740 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.009634    2582 scope.go:117] "RemoveContainer" containerID="350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3"
Jul 06 20:09:25.009932 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:09:25.009893    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3\": container with ID starting with 350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3 not found: ID does not exist" containerID="350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3"
Jul 06 20:09:25.010068 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.009932    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3"} err="failed to get container status \"350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3\": rpc error: code = NotFound desc = could not find container \"350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3\": container with ID starting with 350d577af4fd8f09278aa4aa0aa5035c6ef8bb884322201ce0064608626802e3 not found: ID does not exist"
Jul 06 20:09:25.027253 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.027231    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc6475df8-6plm2"]
Jul 06 20:09:25.037713 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.037691    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fc6475df8-6plm2"]
Jul 06 20:09:25.038636 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.038618    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-serving-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:09:25.038691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.038638    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-oauth-serving-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:09:25.038691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.038648    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-console-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:09:25.038691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.038657    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:09:25.038691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.038664    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e634349-22e5-47c1-8218-db82434530a1-trusted-ca-bundle\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:09:25.038691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.038673    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lffsx\" (UniqueName: \"kubernetes.io/projected/6e634349-22e5-47c1-8218-db82434530a1-kube-api-access-lffsx\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:09:25.038691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.038682    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e634349-22e5-47c1-8218-db82434530a1-console-oauth-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:09:25.064293 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:25.064274    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e634349-22e5-47c1-8218-db82434530a1" path="/var/lib/kubelet/pods/6e634349-22e5-47c1-8218-db82434530a1/volumes"
Jul 06 20:09:42.926594 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.926562    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5"]
Jul 06 20:09:42.927052 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.926851    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e634349-22e5-47c1-8218-db82434530a1" containerName="console"
Jul 06 20:09:42.927052 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.926862    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e634349-22e5-47c1-8218-db82434530a1" containerName="console"
Jul 06 20:09:42.927052 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.926873    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eacf10c4-48af-42cd-b7da-7364333b81fa" containerName="console"
Jul 06 20:09:42.927052 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.926878    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eacf10c4-48af-42cd-b7da-7364333b81fa" containerName="console"
Jul 06 20:09:42.927052 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.926888    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aacf78fb-d069-415d-8c92-0b8ba5ca0edf" containerName="console"
Jul 06 20:09:42.927052 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.926894    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aacf78fb-d069-415d-8c92-0b8ba5ca0edf" containerName="console"
Jul 06 20:09:42.927052 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.926951    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e634349-22e5-47c1-8218-db82434530a1" containerName="console"
Jul 06 20:09:42.927052 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.926961    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aacf78fb-d069-415d-8c92-0b8ba5ca0edf" containerName="console"
Jul 06 20:09:42.927052 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.926967    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eacf10c4-48af-42cd-b7da-7364333b81fa" containerName="console"
Jul 06 20:09:42.929015 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.929000    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5"
Jul 06 20:09:42.931598 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.931574    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2g9lv\""
Jul 06 20:09:42.931697 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.931593    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 06 20:09:42.931697 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.931599    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 06 20:09:42.944489 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.943056    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5"]
Jul 06 20:09:42.969438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.969406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2xzf\" (UniqueName: \"kubernetes.io/projected/862aeb96-c53a-4f63-afb7-e19fa1b863f7-kube-api-access-b2xzf\") pod \"cert-manager-operator-controller-manager-55c444bf86-swdw5\" (UID: \"862aeb96-c53a-4f63-afb7-e19fa1b863f7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5"
Jul 06 20:09:42.969560 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:42.969442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/862aeb96-c53a-4f63-afb7-e19fa1b863f7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-swdw5\" (UID: \"862aeb96-c53a-4f63-afb7-e19fa1b863f7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5"
Jul 06 20:09:43.070044 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:43.070006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2xzf\" (UniqueName: \"kubernetes.io/projected/862aeb96-c53a-4f63-afb7-e19fa1b863f7-kube-api-access-b2xzf\") pod \"cert-manager-operator-controller-manager-55c444bf86-swdw5\" (UID: \"862aeb96-c53a-4f63-afb7-e19fa1b863f7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5"
Jul 06 20:09:43.070173 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:43.070091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/862aeb96-c53a-4f63-afb7-e19fa1b863f7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-swdw5\" (UID: \"862aeb96-c53a-4f63-afb7-e19fa1b863f7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5"
Jul 06 20:09:43.070494 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:43.070477    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/862aeb96-c53a-4f63-afb7-e19fa1b863f7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-swdw5\" (UID: \"862aeb96-c53a-4f63-afb7-e19fa1b863f7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5"
Jul 06 20:09:43.082103 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:43.082078    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2xzf\" (UniqueName: \"kubernetes.io/projected/862aeb96-c53a-4f63-afb7-e19fa1b863f7-kube-api-access-b2xzf\") pod \"cert-manager-operator-controller-manager-55c444bf86-swdw5\" (UID: \"862aeb96-c53a-4f63-afb7-e19fa1b863f7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5"
Jul 06 20:09:43.238247 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:43.238163    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5"
Jul 06 20:09:43.367288 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:43.367263    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5"]
Jul 06 20:09:43.369821 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:09:43.369797    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862aeb96_c53a_4f63_afb7_e19fa1b863f7.slice/crio-ac491b55d354b6923f3652f9e26a46bbf31aac9bea199fdbd1c87254f781ffc4 WatchSource:0}: Error finding container ac491b55d354b6923f3652f9e26a46bbf31aac9bea199fdbd1c87254f781ffc4: Status 404 returned error can't find the container with id ac491b55d354b6923f3652f9e26a46bbf31aac9bea199fdbd1c87254f781ffc4
Jul 06 20:09:44.072408 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:44.072366    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5" event={"ID":"862aeb96-c53a-4f63-afb7-e19fa1b863f7","Type":"ContainerStarted","Data":"ac491b55d354b6923f3652f9e26a46bbf31aac9bea199fdbd1c87254f781ffc4"}
Jul 06 20:09:46.081918 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:46.081883    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5" event={"ID":"862aeb96-c53a-4f63-afb7-e19fa1b863f7","Type":"ContainerStarted","Data":"77a30e8a6d6fbb1ec128598ae8f5818fbab1febe1faec23c151ca9f7f788adba"}
Jul 06 20:09:46.112037 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:46.111980    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-swdw5" podStartSLOduration=1.755861071 podStartE2EDuration="4.111961656s" totalImagesPullingTime="2.356100585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:09:46.110443163 +0000 UTC m=+235.651854171" watchObservedRunningTime="2026-07-06 20:09:46.111961656 +0000 UTC m=+235.653372649"
Jul 06 20:09:49.261985 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.261948    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp"]
Jul 06 20:09:49.264280 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.264263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp"
Jul 06 20:09:49.266751 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.266729    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 20:09:49.267612 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.267592    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 20:09:49.267685 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.267660    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-twvvh\""
Jul 06 20:09:49.273398 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.273379    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp"]
Jul 06 20:09:49.317965 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.317917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48knr\" (UniqueName: \"kubernetes.io/projected/b678c143-4cb2-41f4-855a-a2434dbf775e-kube-api-access-48knr\") pod \"cert-manager-cainjector-559cdd8c87-6wwmp\" (UID: \"b678c143-4cb2-41f4-855a-a2434dbf775e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp"
Jul 06 20:09:49.318130 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.317997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b678c143-4cb2-41f4-855a-a2434dbf775e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6wwmp\" (UID: \"b678c143-4cb2-41f4-855a-a2434dbf775e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp"
Jul 06 20:09:49.418866 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.418827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48knr\" (UniqueName: \"kubernetes.io/projected/b678c143-4cb2-41f4-855a-a2434dbf775e-kube-api-access-48knr\") pod \"cert-manager-cainjector-559cdd8c87-6wwmp\" (UID: \"b678c143-4cb2-41f4-855a-a2434dbf775e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp"
Jul 06 20:09:49.419039 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.418899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b678c143-4cb2-41f4-855a-a2434dbf775e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6wwmp\" (UID: \"b678c143-4cb2-41f4-855a-a2434dbf775e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp"
Jul 06 20:09:49.428655 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.428628    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b678c143-4cb2-41f4-855a-a2434dbf775e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6wwmp\" (UID: \"b678c143-4cb2-41f4-855a-a2434dbf775e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp"
Jul 06 20:09:49.428776 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.428758    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48knr\" (UniqueName: \"kubernetes.io/projected/b678c143-4cb2-41f4-855a-a2434dbf775e-kube-api-access-48knr\") pod \"cert-manager-cainjector-559cdd8c87-6wwmp\" (UID: \"b678c143-4cb2-41f4-855a-a2434dbf775e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp"
Jul 06 20:09:49.573015 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.572980    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp"
Jul 06 20:09:49.701134 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:49.701106    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp"]
Jul 06 20:09:49.703775 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:09:49.703750    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb678c143_4cb2_41f4_855a_a2434dbf775e.slice/crio-de4ec9351f20ed8b0e34ba7d89c843c5234f52078f3e8c201c031fb2d52e2383 WatchSource:0}: Error finding container de4ec9351f20ed8b0e34ba7d89c843c5234f52078f3e8c201c031fb2d52e2383: Status 404 returned error can't find the container with id de4ec9351f20ed8b0e34ba7d89c843c5234f52078f3e8c201c031fb2d52e2383
Jul 06 20:09:50.099237 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:50.099184    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp" event={"ID":"b678c143-4cb2-41f4-855a-a2434dbf775e","Type":"ContainerStarted","Data":"de4ec9351f20ed8b0e34ba7d89c843c5234f52078f3e8c201c031fb2d52e2383"}
Jul 06 20:09:53.112897 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:53.112858    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp" event={"ID":"b678c143-4cb2-41f4-855a-a2434dbf775e","Type":"ContainerStarted","Data":"bf13e75e3ed62e6197af3eb2584ad143bc332bd5ba366cb66a6aed3804997325"}
Jul 06 20:09:53.138345 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:09:53.138281    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6wwmp" podStartSLOduration=1.697368727 podStartE2EDuration="4.138260327s" totalImagesPullingTime="2.4408916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:09:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:09:53.132198028 +0000 UTC m=+242.673609033" watchObservedRunningTime="2026-07-06 20:09:53.138260327 +0000 UTC m=+242.679671320"
Jul 06 20:10:07.191825 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.191791    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pl6gl"]
Jul 06 20:10:07.193983 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.193965    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pl6gl"
Jul 06 20:10:07.196491 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.196471    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4frx9\""
Jul 06 20:10:07.207035 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.207013    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pl6gl"]
Jul 06 20:10:07.262792 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.262765    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfaf246e-3314-49d5-ac25-246f4de64ac0-bound-sa-token\") pod \"cert-manager-55b4d954d5-pl6gl\" (UID: \"bfaf246e-3314-49d5-ac25-246f4de64ac0\") " pod="cert-manager/cert-manager-55b4d954d5-pl6gl"
Jul 06 20:10:07.262936 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.262822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wwn8\" (UniqueName: \"kubernetes.io/projected/bfaf246e-3314-49d5-ac25-246f4de64ac0-kube-api-access-4wwn8\") pod \"cert-manager-55b4d954d5-pl6gl\" (UID: \"bfaf246e-3314-49d5-ac25-246f4de64ac0\") " pod="cert-manager/cert-manager-55b4d954d5-pl6gl"
Jul 06 20:10:07.364140 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.364104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wwn8\" (UniqueName: \"kubernetes.io/projected/bfaf246e-3314-49d5-ac25-246f4de64ac0-kube-api-access-4wwn8\") pod \"cert-manager-55b4d954d5-pl6gl\" (UID: \"bfaf246e-3314-49d5-ac25-246f4de64ac0\") " pod="cert-manager/cert-manager-55b4d954d5-pl6gl"
Jul 06 20:10:07.364365 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.364180    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfaf246e-3314-49d5-ac25-246f4de64ac0-bound-sa-token\") pod \"cert-manager-55b4d954d5-pl6gl\" (UID: \"bfaf246e-3314-49d5-ac25-246f4de64ac0\") " pod="cert-manager/cert-manager-55b4d954d5-pl6gl"
Jul 06 20:10:07.375102 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.375071    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfaf246e-3314-49d5-ac25-246f4de64ac0-bound-sa-token\") pod \"cert-manager-55b4d954d5-pl6gl\" (UID: \"bfaf246e-3314-49d5-ac25-246f4de64ac0\") " pod="cert-manager/cert-manager-55b4d954d5-pl6gl"
Jul 06 20:10:07.375263 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.375223    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wwn8\" (UniqueName: \"kubernetes.io/projected/bfaf246e-3314-49d5-ac25-246f4de64ac0-kube-api-access-4wwn8\") pod \"cert-manager-55b4d954d5-pl6gl\" (UID: \"bfaf246e-3314-49d5-ac25-246f4de64ac0\") " pod="cert-manager/cert-manager-55b4d954d5-pl6gl"
Jul 06 20:10:07.503013 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.502922    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pl6gl"
Jul 06 20:10:07.643660 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:07.643594    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pl6gl"]
Jul 06 20:10:07.646309 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:10:07.646280    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfaf246e_3314_49d5_ac25_246f4de64ac0.slice/crio-91529f27f30ff65489e56401c153863e1fb8e13900f542e535bba61fb40e9c7a WatchSource:0}: Error finding container 91529f27f30ff65489e56401c153863e1fb8e13900f542e535bba61fb40e9c7a: Status 404 returned error can't find the container with id 91529f27f30ff65489e56401c153863e1fb8e13900f542e535bba61fb40e9c7a
Jul 06 20:10:08.173108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:08.173070    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pl6gl" event={"ID":"bfaf246e-3314-49d5-ac25-246f4de64ac0","Type":"ContainerStarted","Data":"6c6a3650a40b573694f13d57fc2c6c5aa032e563d7736019d62888bb42593a14"}
Jul 06 20:10:08.173108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:08.173110    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pl6gl" event={"ID":"bfaf246e-3314-49d5-ac25-246f4de64ac0","Type":"ContainerStarted","Data":"91529f27f30ff65489e56401c153863e1fb8e13900f542e535bba61fb40e9c7a"}
Jul 06 20:10:08.191020 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:08.190961    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pl6gl" podStartSLOduration=1.190945723 podStartE2EDuration="1.190945723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:10:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:08.190596956 +0000 UTC m=+257.732007950" watchObservedRunningTime="2026-07-06 20:10:08.190945723 +0000 UTC m=+257.732356714"
Jul 06 20:10:27.841137 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.841104    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"]
Jul 06 20:10:27.846490 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.846473    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:27.849027 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.849005    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 20:10:27.849213 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.849182    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-crnc6\""
Jul 06 20:10:27.849312 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.849294    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 20:10:27.849378 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.849307    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 20:10:27.849438 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.849402    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 20:10:27.869789 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.869757    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"]
Jul 06 20:10:27.930907 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.930876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-tmp\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:27.931065 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.930927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-manifests\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:27.931065 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.930968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:27.931065 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.931023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tck4\" (UniqueName: \"kubernetes.io/projected/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-kube-api-access-7tck4\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:27.931065 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:27.931060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-webhook-cert\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.032250 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.032183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-tmp\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.032426 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.032283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-manifests\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.032426 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.032318    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.032426 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.032340    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tck4\" (UniqueName: \"kubernetes.io/projected/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-kube-api-access-7tck4\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.032426 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.032370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-webhook-cert\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.032710 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.032685    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-manifests\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.034526 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.034499    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-tmp\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.034655 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.034636    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.034718 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.034702    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-webhook-cert\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.055866 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.055841    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tck4\" (UniqueName: \"kubernetes.io/projected/e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac-kube-api-access-7tck4\") pod \"opendatahub-operator-controller-manager-68cbf59454-jkmmc\" (UID: \"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac\") " pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.157140 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.157061    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:28.307762 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:28.307738    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"]
Jul 06 20:10:28.309848 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:10:28.309824    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode302b8bd_2c7c_4fc1_9dbd_cd35879d2eac.slice/crio-1149f4264761411f12e4856dfdfae99b5636e684334ab8f7195dc5f669d1e135 WatchSource:0}: Error finding container 1149f4264761411f12e4856dfdfae99b5636e684334ab8f7195dc5f669d1e135: Status 404 returned error can't find the container with id 1149f4264761411f12e4856dfdfae99b5636e684334ab8f7195dc5f669d1e135
Jul 06 20:10:29.259196 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:29.259139    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc" event={"ID":"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac","Type":"ContainerStarted","Data":"1149f4264761411f12e4856dfdfae99b5636e684334ab8f7195dc5f669d1e135"}
Jul 06 20:10:32.275628 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:32.275587    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc" event={"ID":"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac","Type":"ContainerStarted","Data":"a3154c00acc36cb8b1b1014ae55b4af88f03d419d9edd4a6c2010ff395335569"}
Jul 06 20:10:33.280937 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:33.280890    2582 generic.go:356] "Generic (PLEG): container finished" podID="e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac" containerID="a3154c00acc36cb8b1b1014ae55b4af88f03d419d9edd4a6c2010ff395335569" exitCode=0
Jul 06 20:10:33.280937 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:33.280931    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc" event={"ID":"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac","Type":"ContainerDied","Data":"a3154c00acc36cb8b1b1014ae55b4af88f03d419d9edd4a6c2010ff395335569"}
Jul 06 20:10:34.287422 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:34.287378    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc" event={"ID":"e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac","Type":"ContainerStarted","Data":"fce2b38aaf7d3e3455eeddddd45ad8eed9f9c6036cd1877b0087b1756122ced7"}
Jul 06 20:10:34.287819 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:34.287533    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:34.323576 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:34.323526    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc" podStartSLOduration=2.895463196 podStartE2EDuration="7.323508931s" totalImagesPullingTime="3.425992468s" totalInitContainerRuntime="1.002053267s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:10:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:34.321448221 +0000 UTC m=+283.862859213" watchObservedRunningTime="2026-07-06 20:10:34.323508931 +0000 UTC m=+283.864919928"
Jul 06 20:10:45.294229 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:45.294181    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68cbf59454-jkmmc"
Jul 06 20:10:47.774066 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.774023    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"]
Jul 06 20:10:47.777429 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.777400    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"
Jul 06 20:10:47.780955 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.780883    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 20:10:47.780955 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.780909    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tsrxb\""
Jul 06 20:10:47.781711 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.781694    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 20:10:47.781818 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.781728    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 20:10:47.784936 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.784914    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 20:10:47.816873 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.816850    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"]
Jul 06 20:10:47.896630 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.896592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc6c43c8-9a10-4fdd-a499-1aa7c972ee90-tls-certs\") pod \"kube-auth-proxy-64f5c756bf-gpflb\" (UID: \"bc6c43c8-9a10-4fdd-a499-1aa7c972ee90\") " pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"
Jul 06 20:10:47.896798 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.896644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc6c43c8-9a10-4fdd-a499-1aa7c972ee90-tmp\") pod \"kube-auth-proxy-64f5c756bf-gpflb\" (UID: \"bc6c43c8-9a10-4fdd-a499-1aa7c972ee90\") " pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"
Jul 06 20:10:47.896798 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.896761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsx72\" (UniqueName: \"kubernetes.io/projected/bc6c43c8-9a10-4fdd-a499-1aa7c972ee90-kube-api-access-fsx72\") pod \"kube-auth-proxy-64f5c756bf-gpflb\" (UID: \"bc6c43c8-9a10-4fdd-a499-1aa7c972ee90\") " pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"
Jul 06 20:10:47.997731 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.997692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsx72\" (UniqueName: \"kubernetes.io/projected/bc6c43c8-9a10-4fdd-a499-1aa7c972ee90-kube-api-access-fsx72\") pod \"kube-auth-proxy-64f5c756bf-gpflb\" (UID: \"bc6c43c8-9a10-4fdd-a499-1aa7c972ee90\") " pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"
Jul 06 20:10:47.997731 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.997736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc6c43c8-9a10-4fdd-a499-1aa7c972ee90-tls-certs\") pod \"kube-auth-proxy-64f5c756bf-gpflb\" (UID: \"bc6c43c8-9a10-4fdd-a499-1aa7c972ee90\") " pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"
Jul 06 20:10:47.997935 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.997755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc6c43c8-9a10-4fdd-a499-1aa7c972ee90-tmp\") pod \"kube-auth-proxy-64f5c756bf-gpflb\" (UID: \"bc6c43c8-9a10-4fdd-a499-1aa7c972ee90\") " pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"
Jul 06 20:10:47.999948 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:47.999927    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc6c43c8-9a10-4fdd-a499-1aa7c972ee90-tmp\") pod \"kube-auth-proxy-64f5c756bf-gpflb\" (UID: \"bc6c43c8-9a10-4fdd-a499-1aa7c972ee90\") " pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"
Jul 06 20:10:48.000269 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:48.000253    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc6c43c8-9a10-4fdd-a499-1aa7c972ee90-tls-certs\") pod \"kube-auth-proxy-64f5c756bf-gpflb\" (UID: \"bc6c43c8-9a10-4fdd-a499-1aa7c972ee90\") " pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"
Jul 06 20:10:48.017479 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:48.017456    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsx72\" (UniqueName: \"kubernetes.io/projected/bc6c43c8-9a10-4fdd-a499-1aa7c972ee90-kube-api-access-fsx72\") pod \"kube-auth-proxy-64f5c756bf-gpflb\" (UID: \"bc6c43c8-9a10-4fdd-a499-1aa7c972ee90\") " pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"
Jul 06 20:10:48.087172 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:48.087144    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"
Jul 06 20:10:48.234765 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:48.234740    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb"]
Jul 06 20:10:48.236820 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:10:48.236796    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6c43c8_9a10_4fdd_a499_1aa7c972ee90.slice/crio-16244e7418d416c86e27104ac2758938bd7f29afcf43f4eb88c092724696b6b5 WatchSource:0}: Error finding container 16244e7418d416c86e27104ac2758938bd7f29afcf43f4eb88c092724696b6b5: Status 404 returned error can't find the container with id 16244e7418d416c86e27104ac2758938bd7f29afcf43f4eb88c092724696b6b5
Jul 06 20:10:48.348984 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:48.348897    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb" event={"ID":"bc6c43c8-9a10-4fdd-a499-1aa7c972ee90","Type":"ContainerStarted","Data":"16244e7418d416c86e27104ac2758938bd7f29afcf43f4eb88c092724696b6b5"}
Jul 06 20:10:49.443118 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.443078    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d5rlp"]
Jul 06 20:10:49.446164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.446148    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp"
Jul 06 20:10:49.449691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.449672    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 20:10:49.456024 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.456003    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d5rlp"]
Jul 06 20:10:49.508413 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.508381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8fd394-85bd-4da5-9ecd-3f5eca652e23-tls-certs\") pod \"model-serving-api-54d89bd5fc-d5rlp\" (UID: \"aa8fd394-85bd-4da5-9ecd-3f5eca652e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp"
Jul 06 20:10:49.508588 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.508431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fqvq\" (UniqueName: \"kubernetes.io/projected/aa8fd394-85bd-4da5-9ecd-3f5eca652e23-kube-api-access-8fqvq\") pod \"model-serving-api-54d89bd5fc-d5rlp\" (UID: \"aa8fd394-85bd-4da5-9ecd-3f5eca652e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp"
Jul 06 20:10:49.609414 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.609376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fqvq\" (UniqueName: \"kubernetes.io/projected/aa8fd394-85bd-4da5-9ecd-3f5eca652e23-kube-api-access-8fqvq\") pod \"model-serving-api-54d89bd5fc-d5rlp\" (UID: \"aa8fd394-85bd-4da5-9ecd-3f5eca652e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp"
Jul 06 20:10:49.609570 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.609473    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8fd394-85bd-4da5-9ecd-3f5eca652e23-tls-certs\") pod \"model-serving-api-54d89bd5fc-d5rlp\" (UID: \"aa8fd394-85bd-4da5-9ecd-3f5eca652e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp"
Jul 06 20:10:49.611829 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.611807    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8fd394-85bd-4da5-9ecd-3f5eca652e23-tls-certs\") pod \"model-serving-api-54d89bd5fc-d5rlp\" (UID: \"aa8fd394-85bd-4da5-9ecd-3f5eca652e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp"
Jul 06 20:10:49.628424 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.628395    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fqvq\" (UniqueName: \"kubernetes.io/projected/aa8fd394-85bd-4da5-9ecd-3f5eca652e23-kube-api-access-8fqvq\") pod \"model-serving-api-54d89bd5fc-d5rlp\" (UID: \"aa8fd394-85bd-4da5-9ecd-3f5eca652e23\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp"
Jul 06 20:10:49.757447 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.757350    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp"
Jul 06 20:10:49.888637 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:49.888608    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d5rlp"]
Jul 06 20:10:49.890328 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:10:49.890300    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8fd394_85bd_4da5_9ecd_3f5eca652e23.slice/crio-8aeee21d5b94d9db8451e9b26b824681f1b442a736cacc7ad65634f6863b5f40 WatchSource:0}: Error finding container 8aeee21d5b94d9db8451e9b26b824681f1b442a736cacc7ad65634f6863b5f40: Status 404 returned error can't find the container with id 8aeee21d5b94d9db8451e9b26b824681f1b442a736cacc7ad65634f6863b5f40
Jul 06 20:10:50.360004 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:50.359962    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp" event={"ID":"aa8fd394-85bd-4da5-9ecd-3f5eca652e23","Type":"ContainerStarted","Data":"8aeee21d5b94d9db8451e9b26b824681f1b442a736cacc7ad65634f6863b5f40"}
Jul 06 20:10:50.918472 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:50.918439    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:10:50.922686 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:50.922659    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 20:10:50.925918 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:50.925896    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:10:52.322827 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:52.322807    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 20:10:53.387906 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:53.387869    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb" event={"ID":"bc6c43c8-9a10-4fdd-a499-1aa7c972ee90","Type":"ContainerStarted","Data":"da5c27c36855e11a3a244a17e16533c69568029781fea4a596793bcae8faf63a"}
Jul 06 20:10:53.389367 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:53.389340    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp" event={"ID":"aa8fd394-85bd-4da5-9ecd-3f5eca652e23","Type":"ContainerStarted","Data":"edac304e6cfcac0551155f9f0fd572cb9f02f025aa1b70cde5c34a13e484b346"}
Jul 06 20:10:53.389472 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:53.389418    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp"
Jul 06 20:10:53.433129 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:53.433075    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64f5c756bf-gpflb" podStartSLOduration=2.351586261 podStartE2EDuration="6.433057194s" totalImagesPullingTime="4.081470933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:53.410024578 +0000 UTC m=+302.951435570" watchObservedRunningTime="2026-07-06 20:10:53.433057194 +0000 UTC m=+302.974468190"
Jul 06 20:10:53.433397 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:53.433368    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp" podStartSLOduration=2.005613287 podStartE2EDuration="4.433357748s" totalImagesPullingTime="2.427744461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:53.432058885 +0000 UTC m=+302.973469877" watchObservedRunningTime="2026-07-06 20:10:53.433357748 +0000 UTC m=+302.974768739"
Jul 06 20:10:55.317614 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.317585    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"]
Jul 06 20:10:55.327261 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.327237    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.330360 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.330334    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 20:10:55.330510 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.330452    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lmwph\""
Jul 06 20:10:55.340218 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.340182    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"]
Jul 06 20:10:55.351516 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.351488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/407169ca-ddb6-433a-a0d5-96c26841cd15-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.351618 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.351527    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.351618 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.351563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.351618 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.351601    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.351776 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.351629    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.351776 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.351688    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.351776 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.351752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.351906 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.351790    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dtwn\" (UniqueName: \"kubernetes.io/projected/407169ca-ddb6-433a-a0d5-96c26841cd15-kube-api-access-7dtwn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.351906 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.351819    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.452893 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.452863    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453078 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.452909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtwn\" (UniqueName: \"kubernetes.io/projected/407169ca-ddb6-433a-a0d5-96c26841cd15-kube-api-access-7dtwn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453078 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.452929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453078 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.452945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/407169ca-ddb6-433a-a0d5-96c26841cd15-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453078 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.452967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453078 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.453005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453078 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.453032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453078 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.453062    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453514 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.453103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453514 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.453411    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453514 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.453449    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453648 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.453511    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453648 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.453583    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.453864 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.453844    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/407169ca-ddb6-433a-a0d5-96c26841cd15-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.455395 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.455371    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.455592 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.455575    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.467669 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.467639    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dtwn\" (UniqueName: \"kubernetes.io/projected/407169ca-ddb6-433a-a0d5-96c26841cd15-kube-api-access-7dtwn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.468164 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.468142    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/407169ca-ddb6-433a-a0d5-96c26841cd15-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tzj\" (UID: \"407169ca-ddb6-433a-a0d5-96c26841cd15\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.639296 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.639189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:55.777087 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.777063    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"]
Jul 06 20:10:55.779528 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:10:55.779503    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407169ca_ddb6_433a_a0d5_96c26841cd15.slice/crio-face3dcae94020520e0dd0cf1d6a5239af1841fc63a74237ef4b4920379e6ab3 WatchSource:0}: Error finding container face3dcae94020520e0dd0cf1d6a5239af1841fc63a74237ef4b4920379e6ab3: Status 404 returned error can't find the container with id face3dcae94020520e0dd0cf1d6a5239af1841fc63a74237ef4b4920379e6ab3
Jul 06 20:10:55.781745 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:55.781722    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:10:56.406706 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:56.406667    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj" event={"ID":"407169ca-ddb6-433a-a0d5-96c26841cd15","Type":"ContainerStarted","Data":"face3dcae94020520e0dd0cf1d6a5239af1841fc63a74237ef4b4920379e6ab3"}
Jul 06 20:10:57.637479 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.637440    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"]
Jul 06 20:10:57.644931 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.644908    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.649676 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.649656    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 20:10:57.649814 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.649782    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 20:10:57.650888 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.650834    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 20:10:57.650888 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.650885    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b4fsp\""
Jul 06 20:10:57.651247 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.651230    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 20:10:57.662948 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.662924    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 20:10:57.669736 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.669713    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"]
Jul 06 20:10:57.673941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.673913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8j2s\" (UniqueName: \"kubernetes.io/projected/137cc1f2-eab1-4a42-bc4f-1343254d408b-kube-api-access-j8j2s\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.674068 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.673964    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/137cc1f2-eab1-4a42-bc4f-1343254d408b-cert\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.674128 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.674107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/137cc1f2-eab1-4a42-bc4f-1343254d408b-manager-config\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.674182 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.674157    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/137cc1f2-eab1-4a42-bc4f-1343254d408b-metrics-cert\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.775095 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.775055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/137cc1f2-eab1-4a42-bc4f-1343254d408b-manager-config\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.775329 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.775109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/137cc1f2-eab1-4a42-bc4f-1343254d408b-metrics-cert\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.775329 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.775149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8j2s\" (UniqueName: \"kubernetes.io/projected/137cc1f2-eab1-4a42-bc4f-1343254d408b-kube-api-access-j8j2s\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.775329 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.775230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/137cc1f2-eab1-4a42-bc4f-1343254d408b-cert\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.775908 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.775881    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/137cc1f2-eab1-4a42-bc4f-1343254d408b-manager-config\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.778433 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.778385    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/137cc1f2-eab1-4a42-bc4f-1343254d408b-cert\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.778614 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.778594    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/137cc1f2-eab1-4a42-bc4f-1343254d408b-metrics-cert\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.788236 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.788188    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8j2s\" (UniqueName: \"kubernetes.io/projected/137cc1f2-eab1-4a42-bc4f-1343254d408b-kube-api-access-j8j2s\") pod \"lws-controller-manager-79c95fdbc9-zblsd\" (UID: \"137cc1f2-eab1-4a42-bc4f-1343254d408b\") " pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:57.957902 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:57.957809    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:10:58.434187 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:58.434154    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:10:58.434299 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:58.434233    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:10:58.434299 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:58.434260    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:10:58.510198 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:58.510176    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"]
Jul 06 20:10:58.513172 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:10:58.513147    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137cc1f2_eab1_4a42_bc4f_1343254d408b.slice/crio-29d51f0bd3e237fa7755d7e7172876c939af4505b866ca29f440050ddd8d0e15 WatchSource:0}: Error finding container 29d51f0bd3e237fa7755d7e7172876c939af4505b866ca29f440050ddd8d0e15: Status 404 returned error can't find the container with id 29d51f0bd3e237fa7755d7e7172876c939af4505b866ca29f440050ddd8d0e15
Jul 06 20:10:59.433414 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:59.433374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj" event={"ID":"407169ca-ddb6-433a-a0d5-96c26841cd15","Type":"ContainerStarted","Data":"bd5269862cc5b69abdf054b125f7d90353dea32e056a8f44ed65cd891334794e"}
Jul 06 20:10:59.434514 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:59.434491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd" event={"ID":"137cc1f2-eab1-4a42-bc4f-1343254d408b","Type":"ContainerStarted","Data":"29d51f0bd3e237fa7755d7e7172876c939af4505b866ca29f440050ddd8d0e15"}
Jul 06 20:10:59.467066 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:59.467011    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj" podStartSLOduration=1.8149907280000002 podStartE2EDuration="4.466994886s" totalImagesPullingTime="2.652004158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:59.464952895 +0000 UTC m=+309.006363887" watchObservedRunningTime="2026-07-06 20:10:59.466994886 +0000 UTC m=+309.008405928"
Jul 06 20:10:59.639968 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:59.639933    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:10:59.644398 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:10:59.644370    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:11:00.439262 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:11:00.439232    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:11:00.440173 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:11:00.440153    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tzj"
Jul 06 20:11:03.454535 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:11:03.454496    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd" event={"ID":"137cc1f2-eab1-4a42-bc4f-1343254d408b","Type":"ContainerStarted","Data":"d1cea3a4cffa40f64a5264453c6e4f3a16a7cac14faccf767eff5b162ea0d28f"}
Jul 06 20:11:03.454972 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:11:03.454636    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:11:03.483641 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:11:03.483588    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd" podStartSLOduration=2.447790352 podStartE2EDuration="6.483571122s" totalImagesPullingTime="4.03578077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:11:03.482097861 +0000 UTC m=+313.023508853" watchObservedRunningTime="2026-07-06 20:11:03.483571122 +0000 UTC m=+313.024982114"
Jul 06 20:11:04.397819 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:11:04.397793    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-d5rlp"
Jul 06 20:11:14.461008 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:11:14.460978    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79c95fdbc9-zblsd"
Jul 06 20:13:21.356168 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.356078    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9hzm6"]
Jul 06 20:13:21.359553 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.359531    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9hzm6"
Jul 06 20:13:21.362046 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.362025    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dcbv8\""
Jul 06 20:13:21.362316 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.362294    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 20:13:21.362935 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.362921    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 20:13:21.382114 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.382070    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9hzm6"]
Jul 06 20:13:21.485198 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.485162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds5tw\" (UniqueName: \"kubernetes.io/projected/6722515a-5dac-449d-83ee-c18d5027a5f6-kube-api-access-ds5tw\") pod \"authorino-58cd955675-9hzm6\" (UID: \"6722515a-5dac-449d-83ee-c18d5027a5f6\") " pod="kuadrant-system/authorino-58cd955675-9hzm6"
Jul 06 20:13:21.586498 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.586459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds5tw\" (UniqueName: \"kubernetes.io/projected/6722515a-5dac-449d-83ee-c18d5027a5f6-kube-api-access-ds5tw\") pod \"authorino-58cd955675-9hzm6\" (UID: \"6722515a-5dac-449d-83ee-c18d5027a5f6\") " pod="kuadrant-system/authorino-58cd955675-9hzm6"
Jul 06 20:13:21.596628 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.596605    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds5tw\" (UniqueName: \"kubernetes.io/projected/6722515a-5dac-449d-83ee-c18d5027a5f6-kube-api-access-ds5tw\") pod \"authorino-58cd955675-9hzm6\" (UID: \"6722515a-5dac-449d-83ee-c18d5027a5f6\") " pod="kuadrant-system/authorino-58cd955675-9hzm6"
Jul 06 20:13:21.668711 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.668623    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9hzm6"
Jul 06 20:13:21.774514 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.774479    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-jmnm7"]
Jul 06 20:13:21.778014 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.777977    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jmnm7"
Jul 06 20:13:21.787876 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.787850    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jmnm7"]
Jul 06 20:13:21.807421 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.807394    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9hzm6"]
Jul 06 20:13:21.810849 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:13:21.810811    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6722515a_5dac_449d_83ee_c18d5027a5f6.slice/crio-5699ba3b38594bc3e8138dfe00691483dc1534b1d434b2d0fea989b71f608440 WatchSource:0}: Error finding container 5699ba3b38594bc3e8138dfe00691483dc1534b1d434b2d0fea989b71f608440: Status 404 returned error can't find the container with id 5699ba3b38594bc3e8138dfe00691483dc1534b1d434b2d0fea989b71f608440
Jul 06 20:13:21.889045 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.889010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsplw\" (UniqueName: \"kubernetes.io/projected/d77b75c0-778c-402f-975d-f6a14939bfb4-kube-api-access-rsplw\") pod \"authorino-75d556bd77-jmnm7\" (UID: \"d77b75c0-778c-402f-975d-f6a14939bfb4\") " pod="kuadrant-system/authorino-75d556bd77-jmnm7"
Jul 06 20:13:21.990379 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:21.990300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsplw\" (UniqueName: \"kubernetes.io/projected/d77b75c0-778c-402f-975d-f6a14939bfb4-kube-api-access-rsplw\") pod \"authorino-75d556bd77-jmnm7\" (UID: \"d77b75c0-778c-402f-975d-f6a14939bfb4\") " pod="kuadrant-system/authorino-75d556bd77-jmnm7"
Jul 06 20:13:22.002181 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:22.002147    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsplw\" (UniqueName: \"kubernetes.io/projected/d77b75c0-778c-402f-975d-f6a14939bfb4-kube-api-access-rsplw\") pod \"authorino-75d556bd77-jmnm7\" (UID: \"d77b75c0-778c-402f-975d-f6a14939bfb4\") " pod="kuadrant-system/authorino-75d556bd77-jmnm7"
Jul 06 20:13:22.068246 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:22.068198    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9hzm6" event={"ID":"6722515a-5dac-449d-83ee-c18d5027a5f6","Type":"ContainerStarted","Data":"5699ba3b38594bc3e8138dfe00691483dc1534b1d434b2d0fea989b71f608440"}
Jul 06 20:13:22.088296 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:22.088273    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jmnm7"
Jul 06 20:13:22.233214 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:22.233177    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jmnm7"]
Jul 06 20:13:22.235731 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:13:22.235704    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd77b75c0_778c_402f_975d_f6a14939bfb4.slice/crio-242391baca9f67cdf8f6119fe73811193c9d829788106001306f2c43f83dd3c2 WatchSource:0}: Error finding container 242391baca9f67cdf8f6119fe73811193c9d829788106001306f2c43f83dd3c2: Status 404 returned error can't find the container with id 242391baca9f67cdf8f6119fe73811193c9d829788106001306f2c43f83dd3c2
Jul 06 20:13:23.075179 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:23.075136    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jmnm7" event={"ID":"d77b75c0-778c-402f-975d-f6a14939bfb4","Type":"ContainerStarted","Data":"242391baca9f67cdf8f6119fe73811193c9d829788106001306f2c43f83dd3c2"}
Jul 06 20:13:27.094272 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:27.094229    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jmnm7" event={"ID":"d77b75c0-778c-402f-975d-f6a14939bfb4","Type":"ContainerStarted","Data":"45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169"}
Jul 06 20:13:27.095710 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:27.095685    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9hzm6" event={"ID":"6722515a-5dac-449d-83ee-c18d5027a5f6","Type":"ContainerStarted","Data":"5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a"}
Jul 06 20:13:27.114038 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:27.113998    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-jmnm7" podStartSLOduration=2.273501827 podStartE2EDuration="6.113984006s" totalImagesPullingTime="3.840482179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:13:27.113575301 +0000 UTC m=+456.654986297" watchObservedRunningTime="2026-07-06 20:13:27.113984006 +0000 UTC m=+456.655394999"
Jul 06 20:13:27.133223 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:27.133156    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9hzm6" podStartSLOduration=1.8567024220000001 podStartE2EDuration="6.133136779s" totalImagesPullingTime="4.276434357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:13:27.132834022 +0000 UTC m=+456.674245018" watchObservedRunningTime="2026-07-06 20:13:27.133136779 +0000 UTC m=+456.674547773"
Jul 06 20:13:27.175595 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:27.175558    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9hzm6"]
Jul 06 20:13:29.103922 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:29.103867    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9hzm6" podUID="6722515a-5dac-449d-83ee-c18d5027a5f6" containerName="authorino" containerID="cri-o://5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a" gracePeriod=30
Jul 06 20:13:29.357730 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:29.357673    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9hzm6"
Jul 06 20:13:29.462909 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:29.462879    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds5tw\" (UniqueName: \"kubernetes.io/projected/6722515a-5dac-449d-83ee-c18d5027a5f6-kube-api-access-ds5tw\") pod \"6722515a-5dac-449d-83ee-c18d5027a5f6\" (UID: \"6722515a-5dac-449d-83ee-c18d5027a5f6\") "
Jul 06 20:13:29.465084 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:29.465062    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6722515a-5dac-449d-83ee-c18d5027a5f6-kube-api-access-ds5tw" (OuterVolumeSpecName: "kube-api-access-ds5tw") pod "6722515a-5dac-449d-83ee-c18d5027a5f6" (UID: "6722515a-5dac-449d-83ee-c18d5027a5f6"). InnerVolumeSpecName "kube-api-access-ds5tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:13:29.563658 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:29.563624    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds5tw\" (UniqueName: \"kubernetes.io/projected/6722515a-5dac-449d-83ee-c18d5027a5f6-kube-api-access-ds5tw\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:13:30.109887 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:30.109851    2582 generic.go:356] "Generic (PLEG): container finished" podID="6722515a-5dac-449d-83ee-c18d5027a5f6" containerID="5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a" exitCode=0
Jul 06 20:13:30.109887 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:30.109890    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9hzm6"
Jul 06 20:13:30.110405 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:30.109942    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9hzm6" event={"ID":"6722515a-5dac-449d-83ee-c18d5027a5f6","Type":"ContainerDied","Data":"5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a"}
Jul 06 20:13:30.110405 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:30.109991    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9hzm6" event={"ID":"6722515a-5dac-449d-83ee-c18d5027a5f6","Type":"ContainerDied","Data":"5699ba3b38594bc3e8138dfe00691483dc1534b1d434b2d0fea989b71f608440"}
Jul 06 20:13:30.110405 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:30.110015    2582 scope.go:117] "RemoveContainer" containerID="5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a"
Jul 06 20:13:30.118511 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:30.118494    2582 scope.go:117] "RemoveContainer" containerID="5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a"
Jul 06 20:13:30.118736 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:13:30.118717    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a\": container with ID starting with 5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a not found: ID does not exist" containerID="5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a"
Jul 06 20:13:30.118799 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:30.118747    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a"} err="failed to get container status \"5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a\": rpc error: code = NotFound desc = could not find container \"5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a\": container with ID starting with 5399fe277cc54977314d9df887f6675522a2c2dab35d91eab7edca1e2287ff5a not found: ID does not exist"
Jul 06 20:13:30.133982 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:30.133954    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9hzm6"]
Jul 06 20:13:30.139507 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:30.139487    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9hzm6"]
Jul 06 20:13:31.065843 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:31.065801    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6722515a-5dac-449d-83ee-c18d5027a5f6" path="/var/lib/kubelet/pods/6722515a-5dac-449d-83ee-c18d5027a5f6/volumes"
Jul 06 20:13:54.712242 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:54.712191    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rmrws"]
Jul 06 20:13:54.712710 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:54.712538    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6722515a-5dac-449d-83ee-c18d5027a5f6" containerName="authorino"
Jul 06 20:13:54.712710 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:54.712549    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6722515a-5dac-449d-83ee-c18d5027a5f6" containerName="authorino"
Jul 06 20:13:54.712710 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:54.712610    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6722515a-5dac-449d-83ee-c18d5027a5f6" containerName="authorino"
Jul 06 20:13:54.716745 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:54.716727    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rmrws"
Jul 06 20:13:54.731978 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:54.731946    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rmrws"]
Jul 06 20:13:54.759787 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:54.759750    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lnfk\" (UniqueName: \"kubernetes.io/projected/1c5bc0c9-93bf-498f-9c40-5ff09ff580df-kube-api-access-6lnfk\") pod \"authorino-5d4b67c446-rmrws\" (UID: \"1c5bc0c9-93bf-498f-9c40-5ff09ff580df\") " pod="kuadrant-system/authorino-5d4b67c446-rmrws"
Jul 06 20:13:54.860733 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:54.860693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lnfk\" (UniqueName: \"kubernetes.io/projected/1c5bc0c9-93bf-498f-9c40-5ff09ff580df-kube-api-access-6lnfk\") pod \"authorino-5d4b67c446-rmrws\" (UID: \"1c5bc0c9-93bf-498f-9c40-5ff09ff580df\") " pod="kuadrant-system/authorino-5d4b67c446-rmrws"
Jul 06 20:13:54.871029 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:54.871002    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lnfk\" (UniqueName: \"kubernetes.io/projected/1c5bc0c9-93bf-498f-9c40-5ff09ff580df-kube-api-access-6lnfk\") pod \"authorino-5d4b67c446-rmrws\" (UID: \"1c5bc0c9-93bf-498f-9c40-5ff09ff580df\") " pod="kuadrant-system/authorino-5d4b67c446-rmrws"
Jul 06 20:13:54.968571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:54.968487    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rmrws"]
Jul 06 20:13:54.968746 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:54.968734    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rmrws"
Jul 06 20:13:55.001319 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:55.001288    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65f54bf78f-95p6v"]
Jul 06 20:13:55.004776 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:55.004758    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65f54bf78f-95p6v"
Jul 06 20:13:55.015870 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:55.015842    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65f54bf78f-95p6v"]
Jul 06 20:13:55.062077 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:55.062043    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76flr\" (UniqueName: \"kubernetes.io/projected/7a0d3ea0-357a-4292-9f3c-ee8804e15811-kube-api-access-76flr\") pod \"authorino-65f54bf78f-95p6v\" (UID: \"7a0d3ea0-357a-4292-9f3c-ee8804e15811\") " pod="kuadrant-system/authorino-65f54bf78f-95p6v"
Jul 06 20:13:55.105492 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:55.105466    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rmrws"]
Jul 06 20:13:55.107842 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:13:55.107811    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c5bc0c9_93bf_498f_9c40_5ff09ff580df.slice/crio-f2c7a11838611d56c08809841682a0571e7caa9d73b639e0a5b38d557325e9bf WatchSource:0}: Error finding container f2c7a11838611d56c08809841682a0571e7caa9d73b639e0a5b38d557325e9bf: Status 404 returned error can't find the container with id f2c7a11838611d56c08809841682a0571e7caa9d73b639e0a5b38d557325e9bf
Jul 06 20:13:55.163306 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:55.163267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76flr\" (UniqueName: \"kubernetes.io/projected/7a0d3ea0-357a-4292-9f3c-ee8804e15811-kube-api-access-76flr\") pod \"authorino-65f54bf78f-95p6v\" (UID: \"7a0d3ea0-357a-4292-9f3c-ee8804e15811\") " pod="kuadrant-system/authorino-65f54bf78f-95p6v"
Jul 06 20:13:55.173490 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:55.173451    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76flr\" (UniqueName: \"kubernetes.io/projected/7a0d3ea0-357a-4292-9f3c-ee8804e15811-kube-api-access-76flr\") pod \"authorino-65f54bf78f-95p6v\" (UID: \"7a0d3ea0-357a-4292-9f3c-ee8804e15811\") " pod="kuadrant-system/authorino-65f54bf78f-95p6v"
Jul 06 20:13:55.225478 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:55.225389    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65f54bf78f-95p6v"]
Jul 06 20:13:55.225735 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:55.225720    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65f54bf78f-95p6v"
Jul 06 20:13:55.227495 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:55.227469    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rmrws" event={"ID":"1c5bc0c9-93bf-498f-9c40-5ff09ff580df","Type":"ContainerStarted","Data":"f2c7a11838611d56c08809841682a0571e7caa9d73b639e0a5b38d557325e9bf"}
Jul 06 20:13:55.361161 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:55.361026    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65f54bf78f-95p6v"]
Jul 06 20:13:55.363170 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:13:55.363144    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a0d3ea0_357a_4292_9f3c_ee8804e15811.slice/crio-f7e971f736d0c7f9621867d8182ea4ebd3b9aacabe22d6ba0c7dbbde8f91b35d WatchSource:0}: Error finding container f7e971f736d0c7f9621867d8182ea4ebd3b9aacabe22d6ba0c7dbbde8f91b35d: Status 404 returned error can't find the container with id f7e971f736d0c7f9621867d8182ea4ebd3b9aacabe22d6ba0c7dbbde8f91b35d
Jul 06 20:13:56.233122 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.233083    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65f54bf78f-95p6v" event={"ID":"7a0d3ea0-357a-4292-9f3c-ee8804e15811","Type":"ContainerStarted","Data":"a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61"}
Jul 06 20:13:56.233122 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.233109    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-65f54bf78f-95p6v" podUID="7a0d3ea0-357a-4292-9f3c-ee8804e15811" containerName="authorino" containerID="cri-o://a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61" gracePeriod=30
Jul 06 20:13:56.233676 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.233136    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65f54bf78f-95p6v" event={"ID":"7a0d3ea0-357a-4292-9f3c-ee8804e15811","Type":"ContainerStarted","Data":"f7e971f736d0c7f9621867d8182ea4ebd3b9aacabe22d6ba0c7dbbde8f91b35d"}
Jul 06 20:13:56.234612 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.234585    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rmrws" event={"ID":"1c5bc0c9-93bf-498f-9c40-5ff09ff580df","Type":"ContainerStarted","Data":"b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f"}
Jul 06 20:13:56.234707 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.234654    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-rmrws" podUID="1c5bc0c9-93bf-498f-9c40-5ff09ff580df" containerName="authorino" containerID="cri-o://b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f" gracePeriod=30
Jul 06 20:13:56.253554 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.253510    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65f54bf78f-95p6v" podStartSLOduration=1.87703554 podStartE2EDuration="2.253492728s" totalImagesPullingTime="376.457188ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:13:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:13:56.252124394 +0000 UTC m=+485.793535387" watchObservedRunningTime="2026-07-06 20:13:56.253492728 +0000 UTC m=+485.794903712"
Jul 06 20:13:56.270984 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.270930    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-rmrws" podStartSLOduration=1.899730218 podStartE2EDuration="2.270913586s" totalImagesPullingTime="371.183368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:13:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:13:56.26960356 +0000 UTC m=+485.811014556" watchObservedRunningTime="2026-07-06 20:13:56.270913586 +0000 UTC m=+485.812324578"
Jul 06 20:13:56.503645 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.503619    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rmrws"
Jul 06 20:13:56.506287 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.506267    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65f54bf78f-95p6v"
Jul 06 20:13:56.573592 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.573548    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lnfk\" (UniqueName: \"kubernetes.io/projected/1c5bc0c9-93bf-498f-9c40-5ff09ff580df-kube-api-access-6lnfk\") pod \"1c5bc0c9-93bf-498f-9c40-5ff09ff580df\" (UID: \"1c5bc0c9-93bf-498f-9c40-5ff09ff580df\") "
Jul 06 20:13:56.573789 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.573640    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76flr\" (UniqueName: \"kubernetes.io/projected/7a0d3ea0-357a-4292-9f3c-ee8804e15811-kube-api-access-76flr\") pod \"7a0d3ea0-357a-4292-9f3c-ee8804e15811\" (UID: \"7a0d3ea0-357a-4292-9f3c-ee8804e15811\") "
Jul 06 20:13:56.575688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.575663    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c5bc0c9-93bf-498f-9c40-5ff09ff580df-kube-api-access-6lnfk" (OuterVolumeSpecName: "kube-api-access-6lnfk") pod "1c5bc0c9-93bf-498f-9c40-5ff09ff580df" (UID: "1c5bc0c9-93bf-498f-9c40-5ff09ff580df"). InnerVolumeSpecName "kube-api-access-6lnfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:13:56.575781 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.575717    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0d3ea0-357a-4292-9f3c-ee8804e15811-kube-api-access-76flr" (OuterVolumeSpecName: "kube-api-access-76flr") pod "7a0d3ea0-357a-4292-9f3c-ee8804e15811" (UID: "7a0d3ea0-357a-4292-9f3c-ee8804e15811"). InnerVolumeSpecName "kube-api-access-76flr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:13:56.674279 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.674244    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lnfk\" (UniqueName: \"kubernetes.io/projected/1c5bc0c9-93bf-498f-9c40-5ff09ff580df-kube-api-access-6lnfk\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:13:56.674279 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:56.674276    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76flr\" (UniqueName: \"kubernetes.io/projected/7a0d3ea0-357a-4292-9f3c-ee8804e15811-kube-api-access-76flr\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:13:57.240457 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.240360    2582 generic.go:356] "Generic (PLEG): container finished" podID="7a0d3ea0-357a-4292-9f3c-ee8804e15811" containerID="a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61" exitCode=0
Jul 06 20:13:57.240457 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.240406    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65f54bf78f-95p6v" event={"ID":"7a0d3ea0-357a-4292-9f3c-ee8804e15811","Type":"ContainerDied","Data":"a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61"}
Jul 06 20:13:57.240457 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.240455    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65f54bf78f-95p6v" event={"ID":"7a0d3ea0-357a-4292-9f3c-ee8804e15811","Type":"ContainerDied","Data":"f7e971f736d0c7f9621867d8182ea4ebd3b9aacabe22d6ba0c7dbbde8f91b35d"}
Jul 06 20:13:57.240965 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.240472    2582 scope.go:117] "RemoveContainer" containerID="a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61"
Jul 06 20:13:57.240965 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.240420    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65f54bf78f-95p6v"
Jul 06 20:13:57.241919 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.241805    2582 generic.go:356] "Generic (PLEG): container finished" podID="1c5bc0c9-93bf-498f-9c40-5ff09ff580df" containerID="b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f" exitCode=0
Jul 06 20:13:57.241919 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.241848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rmrws" event={"ID":"1c5bc0c9-93bf-498f-9c40-5ff09ff580df","Type":"ContainerDied","Data":"b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f"}
Jul 06 20:13:57.241919 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.241870    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rmrws"
Jul 06 20:13:57.242077 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.241875    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rmrws" event={"ID":"1c5bc0c9-93bf-498f-9c40-5ff09ff580df","Type":"ContainerDied","Data":"f2c7a11838611d56c08809841682a0571e7caa9d73b639e0a5b38d557325e9bf"}
Jul 06 20:13:57.249028 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.249008    2582 scope.go:117] "RemoveContainer" containerID="a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61"
Jul 06 20:13:57.249343 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:13:57.249322    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61\": container with ID starting with a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61 not found: ID does not exist" containerID="a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61"
Jul 06 20:13:57.249401 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.249352    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61"} err="failed to get container status \"a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61\": rpc error: code = NotFound desc = could not find container \"a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61\": container with ID starting with a38272347f259c8fad4c8fa00bcb80a6177c001d91561e6978759347ace00e61 not found: ID does not exist"
Jul 06 20:13:57.249401 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.249370    2582 scope.go:117] "RemoveContainer" containerID="b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f"
Jul 06 20:13:57.256734 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.256715    2582 scope.go:117] "RemoveContainer" containerID="b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f"
Jul 06 20:13:57.256999 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:13:57.256980    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f\": container with ID starting with b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f not found: ID does not exist" containerID="b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f"
Jul 06 20:13:57.257062 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.257013    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f"} err="failed to get container status \"b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f\": rpc error: code = NotFound desc = could not find container \"b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f\": container with ID starting with b44e39ad7f8905afa91ca61f30697e182d39b7950aa4ce00fbf9fee0b401d13f not found: ID does not exist"
Jul 06 20:13:57.264167 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.264143    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rmrws"]
Jul 06 20:13:57.272071 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.272050    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rmrws"]
Jul 06 20:13:57.291783 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.291760    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65f54bf78f-95p6v"]
Jul 06 20:13:57.301007 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:57.300985    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-65f54bf78f-95p6v"]
Jul 06 20:13:59.065751 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:59.065718    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c5bc0c9-93bf-498f-9c40-5ff09ff580df" path="/var/lib/kubelet/pods/1c5bc0c9-93bf-498f-9c40-5ff09ff580df/volumes"
Jul 06 20:13:59.066124 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:13:59.066028    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a0d3ea0-357a-4292-9f3c-ee8804e15811" path="/var/lib/kubelet/pods/7a0d3ea0-357a-4292-9f3c-ee8804e15811/volumes"
Jul 06 20:14:00.283258 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:00.283226    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jmnm7"]
Jul 06 20:14:00.283688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:00.283397    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-jmnm7" podUID="d77b75c0-778c-402f-975d-f6a14939bfb4" containerName="authorino" containerID="cri-o://45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169" gracePeriod=30
Jul 06 20:14:00.530751 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:00.530726    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jmnm7"
Jul 06 20:14:00.602359 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:00.602327    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsplw\" (UniqueName: \"kubernetes.io/projected/d77b75c0-778c-402f-975d-f6a14939bfb4-kube-api-access-rsplw\") pod \"d77b75c0-778c-402f-975d-f6a14939bfb4\" (UID: \"d77b75c0-778c-402f-975d-f6a14939bfb4\") "
Jul 06 20:14:00.604366 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:00.604342    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d77b75c0-778c-402f-975d-f6a14939bfb4-kube-api-access-rsplw" (OuterVolumeSpecName: "kube-api-access-rsplw") pod "d77b75c0-778c-402f-975d-f6a14939bfb4" (UID: "d77b75c0-778c-402f-975d-f6a14939bfb4"). InnerVolumeSpecName "kube-api-access-rsplw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:14:00.703708 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:00.703656    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsplw\" (UniqueName: \"kubernetes.io/projected/d77b75c0-778c-402f-975d-f6a14939bfb4-kube-api-access-rsplw\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:14:01.261259 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:01.261197    2582 generic.go:356] "Generic (PLEG): container finished" podID="d77b75c0-778c-402f-975d-f6a14939bfb4" containerID="45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169" exitCode=0
Jul 06 20:14:01.261259 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:01.261259    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jmnm7"
Jul 06 20:14:01.261494 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:01.261301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jmnm7" event={"ID":"d77b75c0-778c-402f-975d-f6a14939bfb4","Type":"ContainerDied","Data":"45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169"}
Jul 06 20:14:01.261494 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:01.261340    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jmnm7" event={"ID":"d77b75c0-778c-402f-975d-f6a14939bfb4","Type":"ContainerDied","Data":"242391baca9f67cdf8f6119fe73811193c9d829788106001306f2c43f83dd3c2"}
Jul 06 20:14:01.261494 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:01.261359    2582 scope.go:117] "RemoveContainer" containerID="45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169"
Jul 06 20:14:01.269591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:01.269573    2582 scope.go:117] "RemoveContainer" containerID="45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169"
Jul 06 20:14:01.269885 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:14:01.269866    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169\": container with ID starting with 45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169 not found: ID does not exist" containerID="45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169"
Jul 06 20:14:01.269934 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:01.269895    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169"} err="failed to get container status \"45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169\": rpc error: code = NotFound desc = could not find container \"45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169\": container with ID starting with 45396cb45ca809954f419a271dd13ed133a3e6bd37a599301c9ca58f61ae9169 not found: ID does not exist"
Jul 06 20:14:01.285586 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:01.285554    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jmnm7"]
Jul 06 20:14:01.295706 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:01.295680    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jmnm7"]
Jul 06 20:14:03.066126 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:14:03.066090    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d77b75c0-778c-402f-975d-f6a14939bfb4" path="/var/lib/kubelet/pods/d77b75c0-778c-402f-975d-f6a14939bfb4/volumes"
Jul 06 20:15:00.156898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.156863    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"]
Jul 06 20:15:00.157435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.157185    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c5bc0c9-93bf-498f-9c40-5ff09ff580df" containerName="authorino"
Jul 06 20:15:00.157435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.157196    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5bc0c9-93bf-498f-9c40-5ff09ff580df" containerName="authorino"
Jul 06 20:15:00.157435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.157218    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0d3ea0-357a-4292-9f3c-ee8804e15811" containerName="authorino"
Jul 06 20:15:00.157435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.157224    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0d3ea0-357a-4292-9f3c-ee8804e15811" containerName="authorino"
Jul 06 20:15:00.157435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.157232    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d77b75c0-778c-402f-975d-f6a14939bfb4" containerName="authorino"
Jul 06 20:15:00.157435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.157237    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d77b75c0-778c-402f-975d-f6a14939bfb4" containerName="authorino"
Jul 06 20:15:00.157435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.157298    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d77b75c0-778c-402f-975d-f6a14939bfb4" containerName="authorino"
Jul 06 20:15:00.157435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.157306    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c5bc0c9-93bf-498f-9c40-5ff09ff580df" containerName="authorino"
Jul 06 20:15:00.157435 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.157315    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a0d3ea0-357a-4292-9f3c-ee8804e15811" containerName="authorino"
Jul 06 20:15:00.159951 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.159934    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"
Jul 06 20:15:00.162827 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.162804    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 06 20:15:00.163868 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.163850    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 06 20:15:00.163959 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.163851    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hsq27\""
Jul 06 20:15:00.170793 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.170769    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"]
Jul 06 20:15:00.208070 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.208035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt4wv\" (UniqueName: \"kubernetes.io/projected/3f468bbe-2ea0-4eff-9135-8af8abfb6e6b-kube-api-access-nt4wv\") pod \"maas-api-key-cleanup-29722815-8plpb\" (UID: \"3f468bbe-2ea0-4eff-9135-8af8abfb6e6b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"
Jul 06 20:15:00.308731 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.308680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt4wv\" (UniqueName: \"kubernetes.io/projected/3f468bbe-2ea0-4eff-9135-8af8abfb6e6b-kube-api-access-nt4wv\") pod \"maas-api-key-cleanup-29722815-8plpb\" (UID: \"3f468bbe-2ea0-4eff-9135-8af8abfb6e6b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"
Jul 06 20:15:00.322291 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.322260    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt4wv\" (UniqueName: \"kubernetes.io/projected/3f468bbe-2ea0-4eff-9135-8af8abfb6e6b-kube-api-access-nt4wv\") pod \"maas-api-key-cleanup-29722815-8plpb\" (UID: \"3f468bbe-2ea0-4eff-9135-8af8abfb6e6b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"
Jul 06 20:15:00.470568 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.470472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"
Jul 06 20:15:00.611563 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:00.611521    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"]
Jul 06 20:15:00.614774 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:15:00.614743    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f468bbe_2ea0_4eff_9135_8af8abfb6e6b.slice/crio-22345a8195bd6ec1209d0be22fb0d4a622402d2eb90505485a84e71363e5d29e WatchSource:0}: Error finding container 22345a8195bd6ec1209d0be22fb0d4a622402d2eb90505485a84e71363e5d29e: Status 404 returned error can't find the container with id 22345a8195bd6ec1209d0be22fb0d4a622402d2eb90505485a84e71363e5d29e
Jul 06 20:15:01.534758 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:01.534712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb" event={"ID":"3f468bbe-2ea0-4eff-9135-8af8abfb6e6b","Type":"ContainerStarted","Data":"22345a8195bd6ec1209d0be22fb0d4a622402d2eb90505485a84e71363e5d29e"}
Jul 06 20:15:03.545981 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:03.545939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb" event={"ID":"3f468bbe-2ea0-4eff-9135-8af8abfb6e6b","Type":"ContainerStarted","Data":"8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8"}
Jul 06 20:15:03.563493 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:03.563441    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb" podStartSLOduration=1.464732125 podStartE2EDuration="3.563425348s" totalImagesPullingTime="2.098693223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:03.563325714 +0000 UTC m=+553.104736707" watchObservedRunningTime="2026-07-06 20:15:03.563425348 +0000 UTC m=+553.104836340"
Jul 06 20:15:16.204280 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.204246    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"]
Jul 06 20:15:16.206652 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.206627    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.210658 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.210637    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 20:15:16.211406 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.211392    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 20:15:16.211714 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.211699    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-66n6v\""
Jul 06 20:15:16.211757 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.211743    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 20:15:16.224243 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.224198    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"]
Jul 06 20:15:16.250934 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.250903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.250934 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.250937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.251171 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.251014    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2qtt\" (UniqueName: \"kubernetes.io/projected/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-kube-api-access-m2qtt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.251171 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.251113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.251171 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.251152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.251309 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.251183    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.352016 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.351975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.352016 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.352015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.352250 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.352132    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.352250 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.352192    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.352250 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.352245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.352358 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.352332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2qtt\" (UniqueName: \"kubernetes.io/projected/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-kube-api-access-m2qtt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.352460 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.352433    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.352551 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.352530    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.352603 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.352563    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.354518 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.354492    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.354628 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.354598    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.362847 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.362824    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2qtt\" (UniqueName: \"kubernetes.io/projected/eafb4a8b-18cf-47e2-beb0-691cc370e3a3-kube-api-access-m2qtt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wmvhc\" (UID: \"eafb4a8b-18cf-47e2-beb0-691cc370e3a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.516813 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.516714    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:16.657943 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:16.657914    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"]
Jul 06 20:15:16.659631 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:15:16.659605    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeafb4a8b_18cf_47e2_beb0_691cc370e3a3.slice/crio-c4b6723b7f3fdcd04a84ddffde8f14a24803ae602ebca59fc126c70a51d4cbbc WatchSource:0}: Error finding container c4b6723b7f3fdcd04a84ddffde8f14a24803ae602ebca59fc126c70a51d4cbbc: Status 404 returned error can't find the container with id c4b6723b7f3fdcd04a84ddffde8f14a24803ae602ebca59fc126c70a51d4cbbc
Jul 06 20:15:17.612664 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:17.612623    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc" event={"ID":"eafb4a8b-18cf-47e2-beb0-691cc370e3a3","Type":"ContainerStarted","Data":"c4b6723b7f3fdcd04a84ddffde8f14a24803ae602ebca59fc126c70a51d4cbbc"}
Jul 06 20:15:18.619406 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:18.619367    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc" event={"ID":"eafb4a8b-18cf-47e2-beb0-691cc370e3a3","Type":"ContainerStarted","Data":"56fac0c64a5aab5af775aade6f52ed30a1120a347fc64b33821db7db821c2343"}
Jul 06 20:15:18.646162 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:18.646103    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc" podStartSLOduration=1.6237064559999999 podStartE2EDuration="2.646086058s" totalImagesPullingTime="1.022379602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:18.64348963 +0000 UTC m=+568.184900623" watchObservedRunningTime="2026-07-06 20:15:18.646086058 +0000 UTC m=+568.187497050"
Jul 06 20:15:26.209242 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.209195    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"]
Jul 06 20:15:26.211577 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.211561    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.215349 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.215329    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 20:15:26.225117 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.225090    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"]
Jul 06 20:15:26.342897 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.342851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.343082 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.342909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.343082 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.342925    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.343082 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.342978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.343082 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.343009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c569158-7e01-48ce-8437-66ef33a1634f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.343247 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.343098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfpjw\" (UniqueName: \"kubernetes.io/projected/8c569158-7e01-48ce-8437-66ef33a1634f-kube-api-access-nfpjw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.444243 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.444180    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.444421 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.444269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.444421 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.444296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.444421 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.444321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.444421 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.444343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c569158-7e01-48ce-8437-66ef33a1634f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.444632 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.444434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfpjw\" (UniqueName: \"kubernetes.io/projected/8c569158-7e01-48ce-8437-66ef33a1634f-kube-api-access-nfpjw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.444702 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.444677    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.444760 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.444693    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.444760 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.444743    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.446622 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.446601    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c569158-7e01-48ce-8437-66ef33a1634f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.446793 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.446774    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c569158-7e01-48ce-8437-66ef33a1634f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.456099 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.456076    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfpjw\" (UniqueName: \"kubernetes.io/projected/8c569158-7e01-48ce-8437-66ef33a1634f-kube-api-access-nfpjw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pj97q\" (UID: \"8c569158-7e01-48ce-8437-66ef33a1634f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.517595 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.517484    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:26.517595 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.517576    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:26.521237 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.521197    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:26.533107 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.533021    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:26.670019 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.669983    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"]
Jul 06 20:15:26.670683 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:15:26.670656    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c569158_7e01_48ce_8437_66ef33a1634f.slice/crio-0fe398c344a80418ac6a9bfd95c8af63cae8da3e64c008a1c522bdd05f6ad0f4 WatchSource:0}: Error finding container 0fe398c344a80418ac6a9bfd95c8af63cae8da3e64c008a1c522bdd05f6ad0f4: Status 404 returned error can't find the container with id 0fe398c344a80418ac6a9bfd95c8af63cae8da3e64c008a1c522bdd05f6ad0f4
Jul 06 20:15:26.671413 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:26.671392    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wmvhc"
Jul 06 20:15:27.662396 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:27.662356    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q" event={"ID":"8c569158-7e01-48ce-8437-66ef33a1634f","Type":"ContainerStarted","Data":"c8f0c5f6a35a8b9c7c2536e18f0bdc00c16cfb9d6fb72a65cd3fa797bd205454"}
Jul 06 20:15:27.662760 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:27.662413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q" event={"ID":"8c569158-7e01-48ce-8437-66ef33a1634f","Type":"ContainerStarted","Data":"0fe398c344a80418ac6a9bfd95c8af63cae8da3e64c008a1c522bdd05f6ad0f4"}
Jul 06 20:15:27.685125 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:27.685074    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q" podStartSLOduration=1.509393471 podStartE2EDuration="1.685059227s" totalImagesPullingTime="175.665756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:27.683297156 +0000 UTC m=+577.224708153" watchObservedRunningTime="2026-07-06 20:15:27.685059227 +0000 UTC m=+577.226470220"
Jul 06 20:15:36.521841 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:36.521796    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:36.522498 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:36.521875    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:36.534790 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:36.534756    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:36.718954 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:36.718920    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pj97q"
Jul 06 20:15:46.456379 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.456337    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"]
Jul 06 20:15:46.459676 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.459654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.478836 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.478806    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 20:15:46.489535 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.489498    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"]
Jul 06 20:15:46.516255 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.516216    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.516255 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.516255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.516483 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.516306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8psk\" (UniqueName: \"kubernetes.io/projected/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-kube-api-access-m8psk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.516483 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.516331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.516483 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.516368    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.516483 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.516384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.617053 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.617002    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8psk\" (UniqueName: \"kubernetes.io/projected/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-kube-api-access-m8psk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.617053 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.617056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.617361 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.617087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.617361 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.617103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.617361 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.617139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.617361 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.617159    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.617563 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.617530    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.617621 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.617595    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.617667 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.617635    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.619587 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.619567    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.619759 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.619743    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.632023 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.631991    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8psk\" (UniqueName: \"kubernetes.io/projected/6110c2a2-3f3b-4bc4-b7ed-222395b81a8f-kube-api-access-m8psk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hp57m\" (UID: \"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.770590 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.770491    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:46.919403 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:46.919377    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"]
Jul 06 20:15:46.921469 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:15:46.921436    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6110c2a2_3f3b_4bc4_b7ed_222395b81a8f.slice/crio-0238d197e69bcc55f567ad0b2525b8588be27599746f403bd17498e8daeabe23 WatchSource:0}: Error finding container 0238d197e69bcc55f567ad0b2525b8588be27599746f403bd17498e8daeabe23: Status 404 returned error can't find the container with id 0238d197e69bcc55f567ad0b2525b8588be27599746f403bd17498e8daeabe23
Jul 06 20:15:47.764513 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:47.764479    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m" event={"ID":"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f","Type":"ContainerStarted","Data":"967de62bdb8a2745e3a9227e1c4c9cad1e762cbaa5638f0d7eba89988dca2539"}
Jul 06 20:15:47.764901 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:47.764534    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m" event={"ID":"6110c2a2-3f3b-4bc4-b7ed-222395b81a8f","Type":"ContainerStarted","Data":"0238d197e69bcc55f567ad0b2525b8588be27599746f403bd17498e8daeabe23"}
Jul 06 20:15:47.801907 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:47.801855    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m" podStartSLOduration=1.6056114689999998 podStartE2EDuration="1.801839167s" totalImagesPullingTime="196.227698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:47.800549569 +0000 UTC m=+597.341960562" watchObservedRunningTime="2026-07-06 20:15:47.801839167 +0000 UTC m=+597.343250156"
Jul 06 20:15:50.949875 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:50.949848    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:15:50.954065 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:50.954046    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:15:56.771338 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:56.771290    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:56.773733 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:56.771365    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:56.783992 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:56.783965    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:15:56.817221 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:15:56.817177    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hp57m"
Jul 06 20:16:00.018675 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:00.018634    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"]
Jul 06 20:16:00.019153 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:00.018862    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb" podUID="3f468bbe-2ea0-4eff-9135-8af8abfb6e6b" containerName="cleanup" containerID="cri-o://8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8" gracePeriod=30
Jul 06 20:16:07.323323 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.323281    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"]
Jul 06 20:16:07.326840 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.326811    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.330558 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.330529    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 20:16:07.340729 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.340697    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"]
Jul 06 20:16:07.387813 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.387771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.387813 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.387819    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.388161 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.387887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.388161 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.387935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.388161 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.388020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaabc46c-9d10-4c33-a2ed-8fd857a958af-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.388161 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.388053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc8ww\" (UniqueName: \"kubernetes.io/projected/eaabc46c-9d10-4c33-a2ed-8fd857a958af-kube-api-access-cc8ww\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.489467 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.489429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaabc46c-9d10-4c33-a2ed-8fd857a958af-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.489467 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.489470    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc8ww\" (UniqueName: \"kubernetes.io/projected/eaabc46c-9d10-4c33-a2ed-8fd857a958af-kube-api-access-cc8ww\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.489727 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.489607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.489727 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.489657    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.489727 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.489723    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.489872 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.489775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.490067 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.490031    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.490188 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.490112    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.490274 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.490234    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.491843 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.491822    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaabc46c-9d10-4c33-a2ed-8fd857a958af-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.491973 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.491956    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaabc46c-9d10-4c33-a2ed-8fd857a958af-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.516693 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.516653    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc8ww\" (UniqueName: \"kubernetes.io/projected/eaabc46c-9d10-4c33-a2ed-8fd857a958af-kube-api-access-cc8ww\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6\" (UID: \"eaabc46c-9d10-4c33-a2ed-8fd857a958af\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.636601 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.636516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:07.791255 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.791228    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"]
Jul 06 20:16:07.793564 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:16:07.793541    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeaabc46c_9d10_4c33_a2ed_8fd857a958af.slice/crio-e8ed66b0fb4803f6fd71f8ec6efa6b7eebec1dc4a30ace471b8a0cb6646fb4bf WatchSource:0}: Error finding container e8ed66b0fb4803f6fd71f8ec6efa6b7eebec1dc4a30ace471b8a0cb6646fb4bf: Status 404 returned error can't find the container with id e8ed66b0fb4803f6fd71f8ec6efa6b7eebec1dc4a30ace471b8a0cb6646fb4bf
Jul 06 20:16:07.794914 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.794896    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:16:07.860703 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:07.860661    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6" event={"ID":"eaabc46c-9d10-4c33-a2ed-8fd857a958af","Type":"ContainerStarted","Data":"e8ed66b0fb4803f6fd71f8ec6efa6b7eebec1dc4a30ace471b8a0cb6646fb4bf"}
Jul 06 20:16:08.867540 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:08.867497    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6" event={"ID":"eaabc46c-9d10-4c33-a2ed-8fd857a958af","Type":"ContainerStarted","Data":"1d6d29d37765b8db07f0e0d3f1413cec994d0f036fafb744890503547367f808"}
Jul 06 20:16:08.899393 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:08.899334    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6" podStartSLOduration=1.688051617 podStartE2EDuration="1.899316808s" totalImagesPullingTime="211.265191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:16:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:16:08.89856828 +0000 UTC m=+618.439979277" watchObservedRunningTime="2026-07-06 20:16:08.899316808 +0000 UTC m=+618.440727801"
Jul 06 20:16:17.637032 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:17.636939    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:17.637032 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:17.637000    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:17.649935 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:17.649902    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:17.923330 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:17.923237    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6"
Jul 06 20:16:30.202661 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.202631    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"
Jul 06 20:16:30.297525 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.297431    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt4wv\" (UniqueName: \"kubernetes.io/projected/3f468bbe-2ea0-4eff-9135-8af8abfb6e6b-kube-api-access-nt4wv\") pod \"3f468bbe-2ea0-4eff-9135-8af8abfb6e6b\" (UID: \"3f468bbe-2ea0-4eff-9135-8af8abfb6e6b\") "
Jul 06 20:16:30.299625 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.299590    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f468bbe-2ea0-4eff-9135-8af8abfb6e6b-kube-api-access-nt4wv" (OuterVolumeSpecName: "kube-api-access-nt4wv") pod "3f468bbe-2ea0-4eff-9135-8af8abfb6e6b" (UID: "3f468bbe-2ea0-4eff-9135-8af8abfb6e6b"). InnerVolumeSpecName "kube-api-access-nt4wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:16:30.398626 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.398583    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt4wv\" (UniqueName: \"kubernetes.io/projected/3f468bbe-2ea0-4eff-9135-8af8abfb6e6b-kube-api-access-nt4wv\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:16:30.972020 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.971984    2582 generic.go:356] "Generic (PLEG): container finished" podID="3f468bbe-2ea0-4eff-9135-8af8abfb6e6b" containerID="8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8" exitCode=137
Jul 06 20:16:30.972241 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.972029    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"
Jul 06 20:16:30.972241 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.972041    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb" event={"ID":"3f468bbe-2ea0-4eff-9135-8af8abfb6e6b","Type":"ContainerDied","Data":"8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8"}
Jul 06 20:16:30.972241 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.972096    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb" event={"ID":"3f468bbe-2ea0-4eff-9135-8af8abfb6e6b","Type":"ContainerDied","Data":"22345a8195bd6ec1209d0be22fb0d4a622402d2eb90505485a84e71363e5d29e"}
Jul 06 20:16:30.972241 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.972124    2582 scope.go:117] "RemoveContainer" containerID="8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8"
Jul 06 20:16:30.980988 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.980960    2582 scope.go:117] "RemoveContainer" containerID="8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8"
Jul 06 20:16:30.981273 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:16:30.981248    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8\": container with ID starting with 8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8 not found: ID does not exist" containerID="8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8"
Jul 06 20:16:30.981344 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.981285    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8"} err="failed to get container status \"8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8\": rpc error: code = NotFound desc = could not find container \"8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8\": container with ID starting with 8e962b4a58c3e9ef636e135adf99c5480859f041bfaa40b4fd1601dab75315b8 not found: ID does not exist"
Jul 06 20:16:30.999808 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:30.999771    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"]
Jul 06 20:16:31.007815 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:31.007786    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722815-8plpb"]
Jul 06 20:16:31.066016 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:16:31.065981    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f468bbe-2ea0-4eff-9135-8af8abfb6e6b" path="/var/lib/kubelet/pods/3f468bbe-2ea0-4eff-9135-8af8abfb6e6b/volumes"
Jul 06 20:20:50.978179 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:20:50.978149    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:20:50.979571 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:20:50.979548    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:25:51.011804 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:25:51.011776    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:25:51.012297 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:25:51.012157    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:30:44.529684 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:30:44.529627    2582 controller.go:195] "Failed to update lease" err="Put \"https://ab9f98892658242508f171bd05a809f2-b2773de990c4921d.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-9.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 06 20:30:47.526427 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:30:47.526390    2582 controller.go:195] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"ip-10-0-136-9.ec2.internal\": the object has been modified; please apply your changes to the latest version and try again"
Jul 06 20:30:51.038194 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:30:51.038161    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:30:51.041070 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:30:51.041051    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:34:46.605608 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.605576    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"]
Jul 06 20:34:46.606172 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.606086    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f468bbe-2ea0-4eff-9135-8af8abfb6e6b" containerName="cleanup"
Jul 06 20:34:46.606172 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.606106    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f468bbe-2ea0-4eff-9135-8af8abfb6e6b" containerName="cleanup"
Jul 06 20:34:46.606314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.606239    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f468bbe-2ea0-4eff-9135-8af8abfb6e6b" containerName="cleanup"
Jul 06 20:34:46.609118 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.609099    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.611556 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.611536    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-080e3c37\"/\"kube-root-ca.crt\""
Jul 06 20:34:46.611650 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.611551    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-080e3c37\"/\"openshift-service-ca.crt\""
Jul 06 20:34:46.612545 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.612521    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-080e3c37\"/\"default-dockercfg-rnqx7\""
Jul 06 20:34:46.612849 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.612616    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-080e3c37\"/\"e2e-lifecycle-model-080e3c37-kserve-self-signed-certs\""
Jul 06 20:34:46.623387 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.623364    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"]
Jul 06 20:34:46.793953 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.793915    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-home\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.793953 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.793956    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56pjv\" (UniqueName: \"kubernetes.io/projected/73e5d92f-1aea-493c-9b38-34cd36be6f2f-kube-api-access-56pjv\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.794244 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.794058    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-dshm\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.794244 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.794100    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tmp-dir\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.794244 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.794128    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tls-certs\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.794244 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.794185    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-model-cache\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.895705 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.895616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-model-cache\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.895705 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.895687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-home\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.895923 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.895715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56pjv\" (UniqueName: \"kubernetes.io/projected/73e5d92f-1aea-493c-9b38-34cd36be6f2f-kube-api-access-56pjv\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.895923 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.895775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-dshm\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.895923 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.895804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tmp-dir\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.895923 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.895830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tls-certs\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.896113 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.896095    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-model-cache\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.896160 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.896117    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-home\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.896248 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.896166    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tmp-dir\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.898083 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.898061    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-dshm\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.898334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.898317    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tls-certs\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.906017 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.905991    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56pjv\" (UniqueName: \"kubernetes.io/projected/73e5d92f-1aea-493c-9b38-34cd36be6f2f-kube-api-access-56pjv\") pod \"e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") " pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:46.921780 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:46.921757    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:47.067608 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:34:47.067571    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73e5d92f_1aea_493c_9b38_34cd36be6f2f.slice/crio-d3a4e341d7ac0c647099eb570966fbfa0178b527a12252e3b90f835526efab56 WatchSource:0}: Error finding container d3a4e341d7ac0c647099eb570966fbfa0178b527a12252e3b90f835526efab56: Status 404 returned error can't find the container with id d3a4e341d7ac0c647099eb570966fbfa0178b527a12252e3b90f835526efab56
Jul 06 20:34:47.068983 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:47.068954    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"]
Jul 06 20:34:48.013505 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:48.013463    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc" event={"ID":"73e5d92f-1aea-493c-9b38-34cd36be6f2f","Type":"ContainerStarted","Data":"25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf"}
Jul 06 20:34:48.013505 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:48.013510    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc" event={"ID":"73e5d92f-1aea-493c-9b38-34cd36be6f2f","Type":"ContainerStarted","Data":"d3a4e341d7ac0c647099eb570966fbfa0178b527a12252e3b90f835526efab56"}
Jul 06 20:34:48.033069 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:48.033024    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc" podStartSLOduration=2.033009017 podStartE2EDuration="2.033009017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:34:48.031766993 +0000 UTC m=+1737.573177987" watchObservedRunningTime="2026-07-06 20:34:48.033009017 +0000 UTC m=+1737.574420010"
Jul 06 20:34:56.922129 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:56.922088    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:56.922549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:56.922172    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:56.934443 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:56.934411    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:34:57.067480 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:34:57.067455    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:35:24.253152 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:24.253119    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"]
Jul 06 20:35:39.272941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.272878    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc" podUID="73e5d92f-1aea-493c-9b38-34cd36be6f2f" containerName="main" containerID="cri-o://25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf" gracePeriod=45
Jul 06 20:35:39.512832 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.512807    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:35:39.556803 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.556714    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-model-cache\") pod \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") "
Jul 06 20:35:39.556803 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.556761    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-dshm\") pod \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") "
Jul 06 20:35:39.556803 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.556799    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56pjv\" (UniqueName: \"kubernetes.io/projected/73e5d92f-1aea-493c-9b38-34cd36be6f2f-kube-api-access-56pjv\") pod \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") "
Jul 06 20:35:39.557056 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.556827    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-home\") pod \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") "
Jul 06 20:35:39.557056 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.556849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tls-certs\") pod \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") "
Jul 06 20:35:39.557056 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.556878    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tmp-dir\") pod \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\" (UID: \"73e5d92f-1aea-493c-9b38-34cd36be6f2f\") "
Jul 06 20:35:39.557223 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.557034    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-model-cache" (OuterVolumeSpecName: "model-cache") pod "73e5d92f-1aea-493c-9b38-34cd36be6f2f" (UID: "73e5d92f-1aea-493c-9b38-34cd36be6f2f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:35:39.557223 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.557116    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-home" (OuterVolumeSpecName: "home") pod "73e5d92f-1aea-493c-9b38-34cd36be6f2f" (UID: "73e5d92f-1aea-493c-9b38-34cd36be6f2f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:35:39.557223 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.557170    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:35:39.557379 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.557240    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "73e5d92f-1aea-493c-9b38-34cd36be6f2f" (UID: "73e5d92f-1aea-493c-9b38-34cd36be6f2f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:35:39.559460 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.559429    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "73e5d92f-1aea-493c-9b38-34cd36be6f2f" (UID: "73e5d92f-1aea-493c-9b38-34cd36be6f2f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:35:39.559460 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.559443    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73e5d92f-1aea-493c-9b38-34cd36be6f2f-kube-api-access-56pjv" (OuterVolumeSpecName: "kube-api-access-56pjv") pod "73e5d92f-1aea-493c-9b38-34cd36be6f2f" (UID: "73e5d92f-1aea-493c-9b38-34cd36be6f2f"). InnerVolumeSpecName "kube-api-access-56pjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:35:39.559460 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.559435    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-dshm" (OuterVolumeSpecName: "dshm") pod "73e5d92f-1aea-493c-9b38-34cd36be6f2f" (UID: "73e5d92f-1aea-493c-9b38-34cd36be6f2f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:35:39.658074 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.658037    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:35:39.658074 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.658065    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56pjv\" (UniqueName: \"kubernetes.io/projected/73e5d92f-1aea-493c-9b38-34cd36be6f2f-kube-api-access-56pjv\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:35:39.658074 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.658075    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:35:39.658074 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.658083    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:35:39.658074 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:39.658092    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73e5d92f-1aea-493c-9b38-34cd36be6f2f-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:35:40.258349 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:40.258316    2582 generic.go:356] "Generic (PLEG): container finished" podID="73e5d92f-1aea-493c-9b38-34cd36be6f2f" containerID="25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf" exitCode=0
Jul 06 20:35:40.258529 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:40.258362    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"
Jul 06 20:35:40.258529 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:40.258379    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc" event={"ID":"73e5d92f-1aea-493c-9b38-34cd36be6f2f","Type":"ContainerDied","Data":"25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf"}
Jul 06 20:35:40.258529 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:40.258410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc" event={"ID":"73e5d92f-1aea-493c-9b38-34cd36be6f2f","Type":"ContainerDied","Data":"d3a4e341d7ac0c647099eb570966fbfa0178b527a12252e3b90f835526efab56"}
Jul 06 20:35:40.258529 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:40.258425    2582 scope.go:117] "RemoveContainer" containerID="25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf"
Jul 06 20:35:40.267271 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:40.267251    2582 scope.go:117] "RemoveContainer" containerID="25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf"
Jul 06 20:35:40.267543 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:35:40.267521    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf\": container with ID starting with 25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf not found: ID does not exist" containerID="25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf"
Jul 06 20:35:40.267614 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:40.267548    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf"} err="failed to get container status \"25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf\": rpc error: code = NotFound desc = could not find container \"25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf\": container with ID starting with 25f7a4c7fd03d7ce1e1347af3586bc4a13d5a529b8ce4b3a7013d1143be0fccf not found: ID does not exist"
Jul 06 20:35:40.286751 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:40.286726    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"]
Jul 06 20:35:40.292419 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:40.292392    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-080e3c37/e2e-lifecycle-model-080e3c37-kserve-7b66697847-wj2jc"]
Jul 06 20:35:41.065824 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:41.065793    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73e5d92f-1aea-493c-9b38-34cd36be6f2f" path="/var/lib/kubelet/pods/73e5d92f-1aea-493c-9b38-34cd36be6f2f/volumes"
Jul 06 20:35:51.066284 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:51.066259    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:35:51.069857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:35:51.069836    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:37:13.607467 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.607369    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"]
Jul 06 20:37:13.607946 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.607806    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73e5d92f-1aea-493c-9b38-34cd36be6f2f" containerName="main"
Jul 06 20:37:13.607946 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.607820    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="73e5d92f-1aea-493c-9b38-34cd36be6f2f" containerName="main"
Jul 06 20:37:13.607946 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.607885    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="73e5d92f-1aea-493c-9b38-34cd36be6f2f" containerName="main"
Jul 06 20:37:13.610785 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.610763    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.614075 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.614058    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-844a47-openshift-default-dockercfg-x429k\""
Jul 06 20:37:13.624561 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.624538    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"]
Jul 06 20:37:13.709267 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.709224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-envoy\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.709267 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.709273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-istio-token\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.709523 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.709295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d00f0163-6009-4b89-8624-42c58a46d662-istiod-ca-cert\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.709523 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.709342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-certs\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.709523 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.709369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d00f0163-6009-4b89-8624-42c58a46d662-istio-podinfo\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.709523 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.709437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-data\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.709523 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.709471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7blfl\" (UniqueName: \"kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-kube-api-access-7blfl\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.709720 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.709525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-socket\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.709720 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.709548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-credential-socket\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.810331 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.810293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-envoy\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.810512 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.810338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-istio-token\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.810512 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.810363    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d00f0163-6009-4b89-8624-42c58a46d662-istiod-ca-cert\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.810512 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.810407    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-certs\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.810512 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.810434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d00f0163-6009-4b89-8624-42c58a46d662-istio-podinfo\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.810512 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.810505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-data\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.810792 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.810544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7blfl\" (UniqueName: \"kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-kube-api-access-7blfl\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.810792 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.810579    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-socket\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.810792 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.810602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-credential-socket\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.811022 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.810865    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-certs\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.811022 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.811003    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-data\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.811110 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.811035    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-credential-socket\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.811145 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.811102    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-socket\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.811284 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.811266    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d00f0163-6009-4b89-8624-42c58a46d662-istiod-ca-cert\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.812645 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.812624    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-envoy\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.812897 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.812878    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d00f0163-6009-4b89-8624-42c58a46d662-istio-podinfo\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.819608 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.819587    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-istio-token\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.820704 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.820684    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7blfl\" (UniqueName: \"kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-kube-api-access-7blfl\") pod \"e2e-inf-b-844a47-openshift-default-64564678c-sfkqm\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") " pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:13.921659 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:13.921556    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:14.068440 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:14.068416    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"]
Jul 06 20:37:14.070288 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:37:14.070260    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd00f0163_6009_4b89_8624_42c58a46d662.slice/crio-81fa96e053c73fcf25d4d19d7775732d1414e8594896996b353c7bc245ea29bc WatchSource:0}: Error finding container 81fa96e053c73fcf25d4d19d7775732d1414e8594896996b353c7bc245ea29bc: Status 404 returned error can't find the container with id 81fa96e053c73fcf25d4d19d7775732d1414e8594896996b353c7bc245ea29bc
Jul 06 20:37:14.072239 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:14.072186    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:37:14.072314 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:14.072293    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:37:14.072351 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:14.072320    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:37:14.686945 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:14.686905    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" event={"ID":"d00f0163-6009-4b89-8624-42c58a46d662","Type":"ContainerStarted","Data":"3087f9816575d4a0d398f84614573f2d265a89477821b8cc6f241fb4514e6ec3"}
Jul 06 20:37:14.687410 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:14.686957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" event={"ID":"d00f0163-6009-4b89-8624-42c58a46d662","Type":"ContainerStarted","Data":"81fa96e053c73fcf25d4d19d7775732d1414e8594896996b353c7bc245ea29bc"}
Jul 06 20:37:14.712415 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:14.712358    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" podStartSLOduration=1.712341469 podStartE2EDuration="1.712341469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:37:14.710725383 +0000 UTC m=+1884.252136388" watchObservedRunningTime="2026-07-06 20:37:14.712341469 +0000 UTC m=+1884.253752534"
Jul 06 20:37:14.921850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:14.921805    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:15.926925 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:15.926894    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:16.697619 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:16.697591    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:16.698693 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:16.698667    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:30.762887 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:30.762792    2582 generic.go:356] "Generic (PLEG): container finished" podID="d00f0163-6009-4b89-8624-42c58a46d662" containerID="3087f9816575d4a0d398f84614573f2d265a89477821b8cc6f241fb4514e6ec3" exitCode=0
Jul 06 20:37:30.762887 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:30.762865    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" event={"ID":"d00f0163-6009-4b89-8624-42c58a46d662","Type":"ContainerDied","Data":"3087f9816575d4a0d398f84614573f2d265a89477821b8cc6f241fb4514e6ec3"}
Jul 06 20:37:30.763369 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:30.763351    2582 scope.go:117] "RemoveContainer" containerID="3087f9816575d4a0d398f84614573f2d265a89477821b8cc6f241fb4514e6ec3"
Jul 06 20:37:30.764422 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:30.764388    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:37:30.764524 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:30.764489    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:37:30.764567 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:30.764533    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:37:31.698330 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.698292    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:31.770443 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.770412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" event={"ID":"d00f0163-6009-4b89-8624-42c58a46d662","Type":"ContainerStarted","Data":"4cd06ddb90db2770b4413b3328a25ffef9143d1e7b241d41493b4fe599441792"}
Jul 06 20:37:31.808225 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.806772    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"]
Jul 06 20:37:31.822936 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.814023    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.830525 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.825491    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cb2bb9\"/\"default-dockercfg-sscvp\""
Jul 06 20:37:31.830525 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.825961    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cb2bb9\"/\"test-model-cb2bb9-kserve-self-signed-certs\""
Jul 06 20:37:31.830525 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.827430    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cb2bb9\"/\"openshift-service-ca.crt\""
Jul 06 20:37:31.841989 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.841962    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cb2bb9\"/\"kube-root-ca.crt\""
Jul 06 20:37:31.865742 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.865709    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"]
Jul 06 20:37:31.884902 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.884876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-home\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.885058 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.884910    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tls-certs\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.885058 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.884963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-model-cache\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.885173 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.885080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k427g\" (UniqueName: \"kubernetes.io/projected/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-kube-api-access-k427g\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.885173 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.885138    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tmp-dir\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.885301 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.885195    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-dshm\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.922507 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.922470    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:31.923514 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.923484    2582 patch_prober.go:28] interesting pod/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 06 20:37:31.923687 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.923539    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" podUID="d00f0163-6009-4b89-8624-42c58a46d662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 06 20:37:31.986668 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.986561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-home\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.986668 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.986616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tls-certs\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.986668 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.986661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-model-cache\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.986926 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.986694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k427g\" (UniqueName: \"kubernetes.io/projected/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-kube-api-access-k427g\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.986926 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.986744    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tmp-dir\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.986926 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.986792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-dshm\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.987056 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.987037    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-home\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.987107 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.987085    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-model-cache\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.987143 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.987125    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tmp-dir\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.989084 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.989057    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-dshm\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.989240 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.989192    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tls-certs\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:31.999302 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:31.997024    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k427g\" (UniqueName: \"kubernetes.io/projected/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-kube-api-access-k427g\") pod \"test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") " pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:32.135371 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:32.135332    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:32.324798 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:32.324762    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"]
Jul 06 20:37:32.325429 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:37:32.325399    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ddb0918_c636_48fe_a1c2_ef0d2ed3d845.slice/crio-b03a9b392b96e0ea3e1e79ffc6146b1f4ed1c6789c898fbd83bf9b2a2126c6e9 WatchSource:0}: Error finding container b03a9b392b96e0ea3e1e79ffc6146b1f4ed1c6789c898fbd83bf9b2a2126c6e9: Status 404 returned error can't find the container with id b03a9b392b96e0ea3e1e79ffc6146b1f4ed1c6789c898fbd83bf9b2a2126c6e9
Jul 06 20:37:32.777094 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:32.776984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q" event={"ID":"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845","Type":"ContainerStarted","Data":"81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17"}
Jul 06 20:37:32.777094 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:32.777033    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q" event={"ID":"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845","Type":"ContainerStarted","Data":"b03a9b392b96e0ea3e1e79ffc6146b1f4ed1c6789c898fbd83bf9b2a2126c6e9"}
Jul 06 20:37:32.922636 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:32.922595    2582 patch_prober.go:28] interesting pod/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 06 20:37:32.922835 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:32.922681    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" podUID="d00f0163-6009-4b89-8624-42c58a46d662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 06 20:37:33.922521 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:33.922481    2582 patch_prober.go:28] interesting pod/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 06 20:37:33.923040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:33.922541    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" podUID="d00f0163-6009-4b89-8624-42c58a46d662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 06 20:37:34.922921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:34.922878    2582 patch_prober.go:28] interesting pod/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 06 20:37:34.923368 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:34.922940    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" podUID="d00f0163-6009-4b89-8624-42c58a46d662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 06 20:37:35.926480 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:35.926444    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:35.926872 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:35.926690    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:35.927517 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:35.927498    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:37:35.956417 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:35.956365    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q" podStartSLOduration=4.956350091 podStartE2EDuration="4.956350091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:37:32.811007588 +0000 UTC m=+1902.352418583" watchObservedRunningTime="2026-07-06 20:37:35.956350091 +0000 UTC m=+1905.497761083"
Jul 06 20:37:42.135973 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:42.135924    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:42.135973 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:42.135975    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:42.148542 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:42.148514    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:42.838224 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:42.838176    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:37:58.842003 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.841965    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"]
Jul 06 20:37:58.844385 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.844366    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:58.848879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.848855    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-844a47\"/\"openshift-service-ca.crt\""
Jul 06 20:37:58.848995 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.848885    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-844a47\"/\"default-dockercfg-fcntc\""
Jul 06 20:37:58.850010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.849990    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-844a47\"/\"test-model-844a47-kserve-self-signed-certs\""
Jul 06 20:37:58.854052 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.854033    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-844a47\"/\"kube-root-ca.crt\""
Jul 06 20:37:58.866384 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.866363    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"]
Jul 06 20:37:58.944108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.944076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-model-cache\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:58.944324 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.944110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb667\" (UniqueName: \"kubernetes.io/projected/63902661-fb7d-4015-94df-415c23d7d433-kube-api-access-mb667\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:58.944324 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.944135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-home\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:58.944324 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.944152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63902661-fb7d-4015-94df-415c23d7d433-tls-certs\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:58.944324 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.944223    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-dshm\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:58.944324 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:58.944294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-tmp-dir\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.045558 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.045514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-tmp-dir\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.045739 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.045635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-model-cache\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.045739 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.045660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb667\" (UniqueName: \"kubernetes.io/projected/63902661-fb7d-4015-94df-415c23d7d433-kube-api-access-mb667\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.045739 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.045691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-home\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.045739 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.045713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63902661-fb7d-4015-94df-415c23d7d433-tls-certs\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.045924 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.045742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-dshm\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.046060 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.046039    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-tmp-dir\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.046124 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.046085    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-model-cache\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.046124 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.046097    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-home\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.047975 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.047948    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-dshm\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.048119 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.048103    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63902661-fb7d-4015-94df-415c23d7d433-tls-certs\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.055739 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.055717    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb667\" (UniqueName: \"kubernetes.io/projected/63902661-fb7d-4015-94df-415c23d7d433-kube-api-access-mb667\") pod \"test-model-844a47-kserve-5c5d84d5f7-k7sfm\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") " pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.153266 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.153160    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:37:59.289518 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.289492    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"]
Jul 06 20:37:59.291286 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:37:59.291258    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63902661_fb7d_4015_94df_415c23d7d433.slice/crio-e83e8c06d6a90f672f095ed87965d5457c2c12027ebb8c255cc7c411dbaa7b1b WatchSource:0}: Error finding container e83e8c06d6a90f672f095ed87965d5457c2c12027ebb8c255cc7c411dbaa7b1b: Status 404 returned error can't find the container with id e83e8c06d6a90f672f095ed87965d5457c2c12027ebb8c255cc7c411dbaa7b1b
Jul 06 20:37:59.908745 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.908707    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm" event={"ID":"63902661-fb7d-4015-94df-415c23d7d433","Type":"ContainerStarted","Data":"e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9"}
Jul 06 20:37:59.908745 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.908755    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm" event={"ID":"63902661-fb7d-4015-94df-415c23d7d433","Type":"ContainerStarted","Data":"e83e8c06d6a90f672f095ed87965d5457c2c12027ebb8c255cc7c411dbaa7b1b"}
Jul 06 20:37:59.930767 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:37:59.930718    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm" podStartSLOduration=1.930703153 podStartE2EDuration="1.930703153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:37:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:37:59.928984574 +0000 UTC m=+1929.470395566" watchObservedRunningTime="2026-07-06 20:37:59.930703153 +0000 UTC m=+1929.472114145"
Jul 06 20:38:09.153817 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:09.153782    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:38:09.154271 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:09.153831    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:38:09.166444 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:09.166405    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:38:09.966923 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:09.966892    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:38:19.722841 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:19.722806    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"]
Jul 06 20:38:20.681691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:20.681656    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"]
Jul 06 20:38:34.742365 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:34.742327    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q" podUID="8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" containerName="main" containerID="cri-o://81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17" gracePeriod=45
Jul 06 20:38:34.987843 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:34.987820    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:38:35.074779 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.074746    2582 generic.go:356] "Generic (PLEG): container finished" podID="8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" containerID="81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17" exitCode=0
Jul 06 20:38:35.074935 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.074790    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"
Jul 06 20:38:35.074935 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.074830    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q" event={"ID":"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845","Type":"ContainerDied","Data":"81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17"}
Jul 06 20:38:35.074935 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.074874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q" event={"ID":"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845","Type":"ContainerDied","Data":"b03a9b392b96e0ea3e1e79ffc6146b1f4ed1c6789c898fbd83bf9b2a2126c6e9"}
Jul 06 20:38:35.074935 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.074895    2582 scope.go:117] "RemoveContainer" containerID="81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17"
Jul 06 20:38:35.083095 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.083072    2582 scope.go:117] "RemoveContainer" containerID="81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17"
Jul 06 20:38:35.083361 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:38:35.083341    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17\": container with ID starting with 81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17 not found: ID does not exist" containerID="81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17"
Jul 06 20:38:35.083430 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.083373    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17"} err="failed to get container status \"81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17\": rpc error: code = NotFound desc = could not find container \"81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17\": container with ID starting with 81b5d72edd4cbc48421dbda3ddd2d5d4336874af301085ca670783a99e554a17 not found: ID does not exist"
Jul 06 20:38:35.084673 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.084657    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-dshm\") pod \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") "
Jul 06 20:38:35.084731 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.084719    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k427g\" (UniqueName: \"kubernetes.io/projected/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-kube-api-access-k427g\") pod \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") "
Jul 06 20:38:35.084782 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.084742    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-home\") pod \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") "
Jul 06 20:38:35.084782 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.084764    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-model-cache\") pod \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") "
Jul 06 20:38:35.084880 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.084794    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tls-certs\") pod \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") "
Jul 06 20:38:35.084880 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.084810    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tmp-dir\") pod \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\" (UID: \"8ddb0918-c636-48fe-a1c2-ef0d2ed3d845\") "
Jul 06 20:38:35.085039 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.085008    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-home" (OuterVolumeSpecName: "home") pod "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" (UID: "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:38:35.085145 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.085060    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-model-cache" (OuterVolumeSpecName: "model-cache") pod "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" (UID: "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:38:35.085145 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.085090    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" (UID: "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:38:35.085272 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.085149    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:35.085272 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.085162    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:35.086981 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.086958    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" (UID: "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:38:35.087109 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.087094    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-dshm" (OuterVolumeSpecName: "dshm") pod "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" (UID: "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:38:35.087155 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.087126    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-kube-api-access-k427g" (OuterVolumeSpecName: "kube-api-access-k427g") pod "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" (UID: "8ddb0918-c636-48fe-a1c2-ef0d2ed3d845"). InnerVolumeSpecName "kube-api-access-k427g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:38:35.186464 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.186433    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:35.186464 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.186461    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k427g\" (UniqueName: \"kubernetes.io/projected/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-kube-api-access-k427g\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:35.186464 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.186472    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:35.186690 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.186481    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:35.404516 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.404482    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"]
Jul 06 20:38:35.407840 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.407818    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-cb2bb9/test-model-cb2bb9-kserve-5c6cbbd77c-9gs4q"]
Jul 06 20:38:35.701297 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.701185    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm" podUID="63902661-fb7d-4015-94df-415c23d7d433" containerName="main" containerID="cri-o://e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9" gracePeriod=45
Jul 06 20:38:35.957986 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.957929    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:38:35.994958 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.994927    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb667\" (UniqueName: \"kubernetes.io/projected/63902661-fb7d-4015-94df-415c23d7d433-kube-api-access-mb667\") pod \"63902661-fb7d-4015-94df-415c23d7d433\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") "
Jul 06 20:38:35.995144 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.994990    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-tmp-dir\") pod \"63902661-fb7d-4015-94df-415c23d7d433\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") "
Jul 06 20:38:35.995144 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.995092    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-model-cache\") pod \"63902661-fb7d-4015-94df-415c23d7d433\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") "
Jul 06 20:38:35.995144 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.995113    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-home\") pod \"63902661-fb7d-4015-94df-415c23d7d433\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") "
Jul 06 20:38:35.995337 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.995171    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63902661-fb7d-4015-94df-415c23d7d433-tls-certs\") pod \"63902661-fb7d-4015-94df-415c23d7d433\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") "
Jul 06 20:38:35.995337 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.995193    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-dshm\") pod \"63902661-fb7d-4015-94df-415c23d7d433\" (UID: \"63902661-fb7d-4015-94df-415c23d7d433\") "
Jul 06 20:38:35.995337 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.995271    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63902661-fb7d-4015-94df-415c23d7d433" (UID: "63902661-fb7d-4015-94df-415c23d7d433"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:38:35.995485 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.995409    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-home" (OuterVolumeSpecName: "home") pod "63902661-fb7d-4015-94df-415c23d7d433" (UID: "63902661-fb7d-4015-94df-415c23d7d433"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:38:35.995578 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.995555    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-model-cache" (OuterVolumeSpecName: "model-cache") pod "63902661-fb7d-4015-94df-415c23d7d433" (UID: "63902661-fb7d-4015-94df-415c23d7d433"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:38:35.995647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.995571    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:35.995647 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.995591    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:35.997306 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.997282    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-dshm" (OuterVolumeSpecName: "dshm") pod "63902661-fb7d-4015-94df-415c23d7d433" (UID: "63902661-fb7d-4015-94df-415c23d7d433"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:38:35.997406 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.997318    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63902661-fb7d-4015-94df-415c23d7d433-kube-api-access-mb667" (OuterVolumeSpecName: "kube-api-access-mb667") pod "63902661-fb7d-4015-94df-415c23d7d433" (UID: "63902661-fb7d-4015-94df-415c23d7d433"). InnerVolumeSpecName "kube-api-access-mb667". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:38:35.997446 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:35.997412    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63902661-fb7d-4015-94df-415c23d7d433-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63902661-fb7d-4015-94df-415c23d7d433" (UID: "63902661-fb7d-4015-94df-415c23d7d433"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:38:36.080306 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.080274    2582 generic.go:356] "Generic (PLEG): container finished" podID="63902661-fb7d-4015-94df-415c23d7d433" containerID="e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9" exitCode=0
Jul 06 20:38:36.080445 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.080319    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"
Jul 06 20:38:36.080445 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.080362    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm" event={"ID":"63902661-fb7d-4015-94df-415c23d7d433","Type":"ContainerDied","Data":"e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9"}
Jul 06 20:38:36.080445 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.080414    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm" event={"ID":"63902661-fb7d-4015-94df-415c23d7d433","Type":"ContainerDied","Data":"e83e8c06d6a90f672f095ed87965d5457c2c12027ebb8c255cc7c411dbaa7b1b"}
Jul 06 20:38:36.080445 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.080439    2582 scope.go:117] "RemoveContainer" containerID="e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9"
Jul 06 20:38:36.089284 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.089247    2582 scope.go:117] "RemoveContainer" containerID="e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9"
Jul 06 20:38:36.089550 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:38:36.089528    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9\": container with ID starting with e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9 not found: ID does not exist" containerID="e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9"
Jul 06 20:38:36.089615 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.089556    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9"} err="failed to get container status \"e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9\": rpc error: code = NotFound desc = could not find container \"e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9\": container with ID starting with e492888fc3d2cba03ad96855a30641ce3eaa8f8c25284cce8302e71ede5864e9 not found: ID does not exist"
Jul 06 20:38:36.096390 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.096373    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63902661-fb7d-4015-94df-415c23d7d433-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:36.096390 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.096392    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:36.096504 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.096401    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb667\" (UniqueName: \"kubernetes.io/projected/63902661-fb7d-4015-94df-415c23d7d433-kube-api-access-mb667\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:36.096504 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.096412    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63902661-fb7d-4015-94df-415c23d7d433-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:38:36.110867 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.110845    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"]
Jul 06 20:38:36.118261 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:36.118236    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-844a47/test-model-844a47-kserve-5c5d84d5f7-k7sfm"]
Jul 06 20:38:37.065672 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:37.065636    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63902661-fb7d-4015-94df-415c23d7d433" path="/var/lib/kubelet/pods/63902661-fb7d-4015-94df-415c23d7d433/volumes"
Jul 06 20:38:37.066033 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:38:37.066023    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" path="/var/lib/kubelet/pods/8ddb0918-c636-48fe-a1c2-ef0d2ed3d845/volumes"
Jul 06 20:39:11.096808 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:11.096777    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"]
Jul 06 20:39:11.097324 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:11.096986    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" podUID="d00f0163-6009-4b89-8624-42c58a46d662" containerName="istio-proxy" containerID="cri-o://4cd06ddb90db2770b4413b3328a25ffef9143d1e7b241d41493b4fe599441792" gracePeriod=30
Jul 06 20:39:16.266066 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.266034    2582 generic.go:356] "Generic (PLEG): container finished" podID="d00f0163-6009-4b89-8624-42c58a46d662" containerID="4cd06ddb90db2770b4413b3328a25ffef9143d1e7b241d41493b4fe599441792" exitCode=0
Jul 06 20:39:16.266476 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.266076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" event={"ID":"d00f0163-6009-4b89-8624-42c58a46d662","Type":"ContainerDied","Data":"4cd06ddb90db2770b4413b3328a25ffef9143d1e7b241d41493b4fe599441792"}
Jul 06 20:39:16.266476 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.266121    2582 scope.go:117] "RemoveContainer" containerID="3087f9816575d4a0d398f84614573f2d265a89477821b8cc6f241fb4514e6ec3"
Jul 06 20:39:16.352073 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.352046    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:39:16.360482 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360417    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d00f0163-6009-4b89-8624-42c58a46d662-istiod-ca-cert\") pod \"d00f0163-6009-4b89-8624-42c58a46d662\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") "
Jul 06 20:39:16.360482 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360455    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-credential-socket\") pod \"d00f0163-6009-4b89-8624-42c58a46d662\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") "
Jul 06 20:39:16.360655 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360486    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-istio-token\") pod \"d00f0163-6009-4b89-8624-42c58a46d662\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") "
Jul 06 20:39:16.360655 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360503    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-envoy\") pod \"d00f0163-6009-4b89-8624-42c58a46d662\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") "
Jul 06 20:39:16.360762 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360696    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-socket\") pod \"d00f0163-6009-4b89-8624-42c58a46d662\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") "
Jul 06 20:39:16.360762 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360720    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d00f0163-6009-4b89-8624-42c58a46d662" (UID: "d00f0163-6009-4b89-8624-42c58a46d662"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:39:16.360762 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360743    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d00f0163-6009-4b89-8624-42c58a46d662-istio-podinfo\") pod \"d00f0163-6009-4b89-8624-42c58a46d662\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") "
Jul 06 20:39:16.360914 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360797    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-data\") pod \"d00f0163-6009-4b89-8624-42c58a46d662\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") "
Jul 06 20:39:16.360914 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360822    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d00f0163-6009-4b89-8624-42c58a46d662-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d00f0163-6009-4b89-8624-42c58a46d662" (UID: "d00f0163-6009-4b89-8624-42c58a46d662"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:39:16.360914 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360835    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7blfl\" (UniqueName: \"kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-kube-api-access-7blfl\") pod \"d00f0163-6009-4b89-8624-42c58a46d662\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") "
Jul 06 20:39:16.360914 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360861    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-certs\") pod \"d00f0163-6009-4b89-8624-42c58a46d662\" (UID: \"d00f0163-6009-4b89-8624-42c58a46d662\") "
Jul 06 20:39:16.361115 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.360940    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d00f0163-6009-4b89-8624-42c58a46d662" (UID: "d00f0163-6009-4b89-8624-42c58a46d662"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:39:16.361170 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.361150    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d00f0163-6009-4b89-8624-42c58a46d662-istiod-ca-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:16.361244 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.361163    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d00f0163-6009-4b89-8624-42c58a46d662" (UID: "d00f0163-6009-4b89-8624-42c58a46d662"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:39:16.361244 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.361171    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-credential-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:16.361244 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.361186    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:16.361911 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.361880    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-data" (OuterVolumeSpecName: "istio-data") pod "d00f0163-6009-4b89-8624-42c58a46d662" (UID: "d00f0163-6009-4b89-8624-42c58a46d662"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:39:16.363064 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.363039    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-istio-token" (OuterVolumeSpecName: "istio-token") pod "d00f0163-6009-4b89-8624-42c58a46d662" (UID: "d00f0163-6009-4b89-8624-42c58a46d662"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:39:16.363179 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.363092    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d00f0163-6009-4b89-8624-42c58a46d662-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d00f0163-6009-4b89-8624-42c58a46d662" (UID: "d00f0163-6009-4b89-8624-42c58a46d662"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:39:16.363270 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.363192    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d00f0163-6009-4b89-8624-42c58a46d662" (UID: "d00f0163-6009-4b89-8624-42c58a46d662"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:39:16.363270 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.363191    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-kube-api-access-7blfl" (OuterVolumeSpecName: "kube-api-access-7blfl") pod "d00f0163-6009-4b89-8624-42c58a46d662" (UID: "d00f0163-6009-4b89-8624-42c58a46d662"). InnerVolumeSpecName "kube-api-access-7blfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:39:16.461709 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.461670    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-data\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:16.461709 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.461703    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7blfl\" (UniqueName: \"kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-kube-api-access-7blfl\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:16.461709 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.461713    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-workload-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:16.461941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.461724    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d00f0163-6009-4b89-8624-42c58a46d662-istio-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:16.461941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.461734    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d00f0163-6009-4b89-8624-42c58a46d662-istio-envoy\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:16.461941 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:16.461741    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d00f0163-6009-4b89-8624-42c58a46d662-istio-podinfo\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:17.272362 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:17.272331    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"
Jul 06 20:39:17.272803 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:17.272361    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm" event={"ID":"d00f0163-6009-4b89-8624-42c58a46d662","Type":"ContainerDied","Data":"81fa96e053c73fcf25d4d19d7775732d1414e8594896996b353c7bc245ea29bc"}
Jul 06 20:39:17.272803 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:17.272418    2582 scope.go:117] "RemoveContainer" containerID="4cd06ddb90db2770b4413b3328a25ffef9143d1e7b241d41493b4fe599441792"
Jul 06 20:39:17.302005 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:17.301968    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"]
Jul 06 20:39:17.308131 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:17.308107    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-844a47-openshift-default-64564678c-sfkqm"]
Jul 06 20:39:19.066972 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:19.066937    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d00f0163-6009-4b89-8624-42c58a46d662" path="/var/lib/kubelet/pods/d00f0163-6009-4b89-8624-42c58a46d662/volumes"
Jul 06 20:39:20.505417 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.505377    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"]
Jul 06 20:39:20.505900 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.505885    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d00f0163-6009-4b89-8624-42c58a46d662" containerName="istio-proxy"
Jul 06 20:39:20.505943 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.505904    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d00f0163-6009-4b89-8624-42c58a46d662" containerName="istio-proxy"
Jul 06 20:39:20.505943 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.505933    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d00f0163-6009-4b89-8624-42c58a46d662" containerName="istio-proxy"
Jul 06 20:39:20.506012 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.505942    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d00f0163-6009-4b89-8624-42c58a46d662" containerName="istio-proxy"
Jul 06 20:39:20.506012 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.505960    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63902661-fb7d-4015-94df-415c23d7d433" containerName="main"
Jul 06 20:39:20.506012 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.505969    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="63902661-fb7d-4015-94df-415c23d7d433" containerName="main"
Jul 06 20:39:20.506012 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.505988    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" containerName="main"
Jul 06 20:39:20.506012 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.505998    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" containerName="main"
Jul 06 20:39:20.506147 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.506072    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ddb0918-c636-48fe-a1c2-ef0d2ed3d845" containerName="main"
Jul 06 20:39:20.506147 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.506086    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="63902661-fb7d-4015-94df-415c23d7d433" containerName="main"
Jul 06 20:39:20.506147 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.506096    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d00f0163-6009-4b89-8624-42c58a46d662" containerName="istio-proxy"
Jul 06 20:39:20.506147 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.506109    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d00f0163-6009-4b89-8624-42c58a46d662" containerName="istio-proxy"
Jul 06 20:39:20.510826 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.510807    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.514358 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.514335    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-86cb5d-openshift-default-dockercfg-h9scr\""
Jul 06 20:39:20.534685 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.534657    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"]
Jul 06 20:39:20.602747 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.602703    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59cef630-05f8-4634-a78e-ec1fa5bb977d-istiod-ca-cert\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.602747 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.602748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-certs\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.602973 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.602766    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mk5p\" (UniqueName: \"kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-kube-api-access-5mk5p\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.602973 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.602880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-socket\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.602973 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.602940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-data\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.602973 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.602969    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-podinfo\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.603173 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.603012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-credential-socket\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.603173 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.603113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-envoy\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.603295 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.603167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-token\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.703745 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.703707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-credential-socket\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.703940 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.703775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-envoy\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.703940 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.703817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-token\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.703940 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.703852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59cef630-05f8-4634-a78e-ec1fa5bb977d-istiod-ca-cert\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.703940 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.703885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-certs\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.703940 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.703906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mk5p\" (UniqueName: \"kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-kube-api-access-5mk5p\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.704240 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.703966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-socket\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.704240 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.704050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-data\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.704240 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.704084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-podinfo\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.704240 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.704174    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-credential-socket\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.704456 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.704366    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-certs\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.704658 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.704628    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59cef630-05f8-4634-a78e-ec1fa5bb977d-istiod-ca-cert\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.704658 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.704645    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-data\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.704799 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.704719    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-socket\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.706074 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.706054    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-envoy\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.706444 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.706428    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-podinfo\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.714599 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.714576    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mk5p\" (UniqueName: \"kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-kube-api-access-5mk5p\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.715949 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.715931    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-token\") pod \"e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") " pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.821403 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.821372    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:20.966376 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.966349    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"]
Jul 06 20:39:20.968360 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:39:20.968333    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59cef630_05f8_4634_a78e_ec1fa5bb977d.slice/crio-e2ef5dcc894dc17ec01c4333e4dd2c0b6f7795bc48d4dfc39c365da10f9743ad WatchSource:0}: Error finding container e2ef5dcc894dc17ec01c4333e4dd2c0b6f7795bc48d4dfc39c365da10f9743ad: Status 404 returned error can't find the container with id e2ef5dcc894dc17ec01c4333e4dd2c0b6f7795bc48d4dfc39c365da10f9743ad
Jul 06 20:39:20.970336 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.970305    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:39:20.970425 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.970389    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:39:20.970492 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:20.970435    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:39:21.292922 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:21.292819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" event={"ID":"59cef630-05f8-4634-a78e-ec1fa5bb977d","Type":"ContainerStarted","Data":"c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf"}
Jul 06 20:39:21.292922 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:21.292879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" event={"ID":"59cef630-05f8-4634-a78e-ec1fa5bb977d","Type":"ContainerStarted","Data":"e2ef5dcc894dc17ec01c4333e4dd2c0b6f7795bc48d4dfc39c365da10f9743ad"}
Jul 06 20:39:21.319076 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:21.319025    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" podStartSLOduration=1.319008046 podStartE2EDuration="1.319008046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:39:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:39:21.316696247 +0000 UTC m=+2010.858107241" watchObservedRunningTime="2026-07-06 20:39:21.319008046 +0000 UTC m=+2010.860419039"
Jul 06 20:39:21.821795 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:21.821737    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:22.826595 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:22.826563    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:23.303959 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:23.303866    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:23.304764 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:23.304746    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:35.362995 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:35.362961    2582 generic.go:356] "Generic (PLEG): container finished" podID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerID="c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf" exitCode=0
Jul 06 20:39:35.363433 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:35.363036    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" event={"ID":"59cef630-05f8-4634-a78e-ec1fa5bb977d","Type":"ContainerDied","Data":"c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf"}
Jul 06 20:39:35.363475 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:35.363457    2582 scope.go:117] "RemoveContainer" containerID="c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf"
Jul 06 20:39:35.364560 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:35.364533    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:39:35.364637 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:35.364620    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:39:35.364688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:35.364674    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:39:36.370925 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:36.370890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" event={"ID":"59cef630-05f8-4634-a78e-ec1fa5bb977d","Type":"ContainerStarted","Data":"61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb"}
Jul 06 20:39:36.824772 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:36.824720    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:36.826721 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:36.826679    2582 patch_prober.go:28] interesting pod/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 06 20:39:36.827475 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:36.827435    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 06 20:39:37.822728 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:37.822690    2582 patch_prober.go:28] interesting pod/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 06 20:39:37.823140 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:37.822746    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 06 20:39:38.304237 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:38.304120    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:38.821889 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:38.821844    2582 patch_prober.go:28] interesting pod/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 06 20:39:38.822100 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:38.821910    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 06 20:39:39.822869 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:39.822826    2582 patch_prober.go:28] interesting pod/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 06 20:39:39.823352 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:39.822889    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 06 20:39:40.825921 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:40.825889    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:40.826790 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:40.826772    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:50.682700 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:50.682658    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"]
Jul 06 20:39:50.683291 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:50.682905    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy" containerID="cri-o://61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb" gracePeriod=30
Jul 06 20:39:55.828252 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:55.828197    2582 patch_prober.go:28] interesting pod/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 06 20:39:55.828572 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:55.828291    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 06 20:39:55.938790 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:55.938764    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:56.034451 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034354    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-socket\") pod \"59cef630-05f8-4634-a78e-ec1fa5bb977d\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") "
Jul 06 20:39:56.034451 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034394    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-data\") pod \"59cef630-05f8-4634-a78e-ec1fa5bb977d\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") "
Jul 06 20:39:56.034451 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034418    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-credential-socket\") pod \"59cef630-05f8-4634-a78e-ec1fa5bb977d\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") "
Jul 06 20:39:56.034712 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034479    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-certs\") pod \"59cef630-05f8-4634-a78e-ec1fa5bb977d\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") "
Jul 06 20:39:56.034712 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034539    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mk5p\" (UniqueName: \"kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-kube-api-access-5mk5p\") pod \"59cef630-05f8-4634-a78e-ec1fa5bb977d\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") "
Jul 06 20:39:56.034712 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034585    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-podinfo\") pod \"59cef630-05f8-4634-a78e-ec1fa5bb977d\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") "
Jul 06 20:39:56.034712 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034617    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59cef630-05f8-4634-a78e-ec1fa5bb977d-istiod-ca-cert\") pod \"59cef630-05f8-4634-a78e-ec1fa5bb977d\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") "
Jul 06 20:39:56.034911 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034689    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59cef630-05f8-4634-a78e-ec1fa5bb977d" (UID: "59cef630-05f8-4634-a78e-ec1fa5bb977d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:39:56.034911 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034743    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-envoy\") pod \"59cef630-05f8-4634-a78e-ec1fa5bb977d\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") "
Jul 06 20:39:56.034911 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034779    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-token\") pod \"59cef630-05f8-4634-a78e-ec1fa5bb977d\" (UID: \"59cef630-05f8-4634-a78e-ec1fa5bb977d\") "
Jul 06 20:39:56.034911 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034780    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59cef630-05f8-4634-a78e-ec1fa5bb977d" (UID: "59cef630-05f8-4634-a78e-ec1fa5bb977d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:39:56.034911 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.034890    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59cef630-05f8-4634-a78e-ec1fa5bb977d" (UID: "59cef630-05f8-4634-a78e-ec1fa5bb977d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:39:56.035181 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.035144    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:56.035181 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.035161    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-credential-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:56.035181 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.035171    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-workload-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:56.035376 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.035256    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-data" (OuterVolumeSpecName: "istio-data") pod "59cef630-05f8-4634-a78e-ec1fa5bb977d" (UID: "59cef630-05f8-4634-a78e-ec1fa5bb977d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:39:56.035376 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.035355    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59cef630-05f8-4634-a78e-ec1fa5bb977d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59cef630-05f8-4634-a78e-ec1fa5bb977d" (UID: "59cef630-05f8-4634-a78e-ec1fa5bb977d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:39:56.036884 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.036858    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59cef630-05f8-4634-a78e-ec1fa5bb977d" (UID: "59cef630-05f8-4634-a78e-ec1fa5bb977d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:39:56.037024 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.036916    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-kube-api-access-5mk5p" (OuterVolumeSpecName: "kube-api-access-5mk5p") pod "59cef630-05f8-4634-a78e-ec1fa5bb977d" (UID: "59cef630-05f8-4634-a78e-ec1fa5bb977d"). InnerVolumeSpecName "kube-api-access-5mk5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:39:56.037252 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.037231    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59cef630-05f8-4634-a78e-ec1fa5bb977d" (UID: "59cef630-05f8-4634-a78e-ec1fa5bb977d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:39:56.037321 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.037259    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-token" (OuterVolumeSpecName: "istio-token") pod "59cef630-05f8-4634-a78e-ec1fa5bb977d" (UID: "59cef630-05f8-4634-a78e-ec1fa5bb977d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:39:56.136277 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.136242    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mk5p\" (UniqueName: \"kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-kube-api-access-5mk5p\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:56.136277 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.136271    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-podinfo\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:56.136277 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.136281    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59cef630-05f8-4634-a78e-ec1fa5bb977d-istiod-ca-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:56.136277 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.136289    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-envoy\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:56.136545 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.136297    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:56.136545 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.136304    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59cef630-05f8-4634-a78e-ec1fa5bb977d-istio-data\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:39:56.467356 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.467317    2582 generic.go:356] "Generic (PLEG): container finished" podID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerID="61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb" exitCode=0
Jul 06 20:39:56.467567 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.467375    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"
Jul 06 20:39:56.467567 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.467410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" event={"ID":"59cef630-05f8-4634-a78e-ec1fa5bb977d","Type":"ContainerDied","Data":"61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb"}
Jul 06 20:39:56.467567 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.467480    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg" event={"ID":"59cef630-05f8-4634-a78e-ec1fa5bb977d","Type":"ContainerDied","Data":"e2ef5dcc894dc17ec01c4333e4dd2c0b6f7795bc48d4dfc39c365da10f9743ad"}
Jul 06 20:39:56.467567 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.467512    2582 scope.go:117] "RemoveContainer" containerID="61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb"
Jul 06 20:39:56.476766 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.476752    2582 scope.go:117] "RemoveContainer" containerID="c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf"
Jul 06 20:39:56.484488 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.484470    2582 scope.go:117] "RemoveContainer" containerID="61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb"
Jul 06 20:39:56.484721 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:39:56.484704    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb\": container with ID starting with 61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb not found: ID does not exist" containerID="61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb"
Jul 06 20:39:56.484771 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.484728    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb"} err="failed to get container status \"61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb\": rpc error: code = NotFound desc = could not find container \"61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb\": container with ID starting with 61029a73da9be012a6888d71056361c228801254aff7b7ec77435e38791b40bb not found: ID does not exist"
Jul 06 20:39:56.484771 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.484746    2582 scope.go:117] "RemoveContainer" containerID="c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf"
Jul 06 20:39:56.484964 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:39:56.484950    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf\": container with ID starting with c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf not found: ID does not exist" containerID="c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf"
Jul 06 20:39:56.485013 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.484968    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf"} err="failed to get container status \"c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf\": rpc error: code = NotFound desc = could not find container \"c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf\": container with ID starting with c82f48bb1e5bcfc601f3aa7c69df4d09c22490b3905c6961a37719b56e23efbf not found: ID does not exist"
Jul 06 20:39:56.495321 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.495297    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"]
Jul 06 20:39:56.507283 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:56.507262    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-86cb5d-openshift-default-bc86b9c49-dj2kg"]
Jul 06 20:39:57.065575 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:57.065543    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" path="/var/lib/kubelet/pods/59cef630-05f8-4634-a78e-ec1fa5bb977d/volumes"
Jul 06 20:39:59.604306 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.604268    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"]
Jul 06 20:39:59.604768 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.604619    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy"
Jul 06 20:39:59.604768 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.604630    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy"
Jul 06 20:39:59.604768 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.604694    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy"
Jul 06 20:39:59.604768 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.604702    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy"
Jul 06 20:39:59.607770 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.607749    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.611140 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.611112    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-67755c-openshift-default-dockercfg-fkslw\""
Jul 06 20:39:59.622997 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.622969    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"]
Jul 06 20:39:59.768421 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.768385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-data\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.768591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.768445    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-credential-socket\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.768591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.768488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-socket\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.768591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.768533    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c039720e-4480-42d6-b0c4-535e74d4e58a-istiod-ca-cert\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.768591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.768560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-envoy\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.768591 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.768586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-certs\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.768783 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.768630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-token\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.768783 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.768658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-podinfo\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.768783 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.768682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szwrf\" (UniqueName: \"kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-kube-api-access-szwrf\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869330 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c039720e-4480-42d6-b0c4-535e74d4e58a-istiod-ca-cert\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869330 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-envoy\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869330 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-certs\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869596 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-token\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869596 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-podinfo\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869596 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szwrf\" (UniqueName: \"kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-kube-api-access-szwrf\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869755 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-data\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869755 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869652    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-credential-socket\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869755 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869663    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-certs\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869755 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-socket\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869979 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869909    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-data\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.869979 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.869965    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-socket\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.870108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.870081    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c039720e-4480-42d6-b0c4-535e74d4e58a-istiod-ca-cert\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.870172 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.870145    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-credential-socket\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.871589 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.871567    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-envoy\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.872049 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.872028    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-podinfo\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.880117 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.880092    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-token\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.884775 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.884747    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szwrf\" (UniqueName: \"kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-kube-api-access-szwrf\") pod \"e2e-shared-b-67755c-openshift-default-768f576795-qfbv8\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") " pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:39:59.918551 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:39:59.918515    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:40:00.080095 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:00.080071    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"]
Jul 06 20:40:00.081683 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:40:00.081657    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc039720e_4480_42d6_b0c4_535e74d4e58a.slice/crio-0989012b8913c86eb7925312d4ba62fc07212d65405db4bef65f80a6070260e1 WatchSource:0}: Error finding container 0989012b8913c86eb7925312d4ba62fc07212d65405db4bef65f80a6070260e1: Status 404 returned error can't find the container with id 0989012b8913c86eb7925312d4ba62fc07212d65405db4bef65f80a6070260e1
Jul 06 20:40:00.083954 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:00.083924    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:40:00.084016 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:00.083989    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:40:00.084174 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:00.084017    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:40:00.488152 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:00.488062    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" event={"ID":"c039720e-4480-42d6-b0c4-535e74d4e58a","Type":"ContainerStarted","Data":"37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3"}
Jul 06 20:40:00.488152 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:00.488114    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" event={"ID":"c039720e-4480-42d6-b0c4-535e74d4e58a","Type":"ContainerStarted","Data":"0989012b8913c86eb7925312d4ba62fc07212d65405db4bef65f80a6070260e1"}
Jul 06 20:40:00.517550 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:00.517496    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" podStartSLOduration=1.517475836 podStartE2EDuration="1.517475836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:40:00.516809394 +0000 UTC m=+2050.058220416" watchObservedRunningTime="2026-07-06 20:40:00.517475836 +0000 UTC m=+2050.058886830"
Jul 06 20:40:00.919309 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:00.919272    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:40:01.923708 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:01.923675    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:40:02.496874 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:02.496841    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:40:02.497869 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:02.497849    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:40:11.892977 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.892938    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"]
Jul 06 20:40:11.893459 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.893443    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy"
Jul 06 20:40:11.893507 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.893461    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="59cef630-05f8-4634-a78e-ec1fa5bb977d" containerName="istio-proxy"
Jul 06 20:40:11.895844 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.895825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:11.898477 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.898450    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-37e178\"/\"kube-root-ca.crt\""
Jul 06 20:40:11.898638 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.898450    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-37e178\"/\"openshift-service-ca.crt\""
Jul 06 20:40:11.899405 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.899378    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-37e178\"/\"default-dockercfg-r54jz\""
Jul 06 20:40:11.899649 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.899621    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-37e178\"/\"auth-test-model-37e178-kserve-self-signed-certs\""
Jul 06 20:40:11.908088 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.908064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"]
Jul 06 20:40:11.976326 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.976286    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-tmp-dir\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:11.976536 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.976396    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-dshm\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:11.976536 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.976422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w42x2\" (UniqueName: \"kubernetes.io/projected/804d8a64-33d8-43aa-9f98-06c5fff609ad-kube-api-access-w42x2\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:11.976536 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.976457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-home\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:11.976536 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.976483    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/804d8a64-33d8-43aa-9f98-06c5fff609ad-tls-certs\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:11.976688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:11.976577    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-model-cache\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.077496 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.077458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-model-cache\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.077691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.077522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-tmp-dir\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.077691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.077572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-dshm\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.077691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.077588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w42x2\" (UniqueName: \"kubernetes.io/projected/804d8a64-33d8-43aa-9f98-06c5fff609ad-kube-api-access-w42x2\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.077691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.077617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-home\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.077691 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.077643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/804d8a64-33d8-43aa-9f98-06c5fff609ad-tls-certs\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.078010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.077958    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-model-cache\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.078010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.077983    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-tmp-dir\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.078114 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.078046    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-home\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.079902 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.079883    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-dshm\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.080197 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.080179    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/804d8a64-33d8-43aa-9f98-06c5fff609ad-tls-certs\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.087308 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.087285    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w42x2\" (UniqueName: \"kubernetes.io/projected/804d8a64-33d8-43aa-9f98-06c5fff609ad-kube-api-access-w42x2\") pod \"auth-test-model-37e178-kserve-6d4854fcbc-kq62c\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") " pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.208404 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.208319    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:12.346927 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.346895    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"]
Jul 06 20:40:12.349894 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:40:12.349864    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod804d8a64_33d8_43aa_9f98_06c5fff609ad.slice/crio-d29021feeadbc514efdaf4b8cd09964aa18daf744891213dd3e14850fb64e6d6 WatchSource:0}: Error finding container d29021feeadbc514efdaf4b8cd09964aa18daf744891213dd3e14850fb64e6d6: Status 404 returned error can't find the container with id d29021feeadbc514efdaf4b8cd09964aa18daf744891213dd3e14850fb64e6d6
Jul 06 20:40:12.548013 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.547922    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c" event={"ID":"804d8a64-33d8-43aa-9f98-06c5fff609ad","Type":"ContainerStarted","Data":"85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb"}
Jul 06 20:40:12.548013 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.547969    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c" event={"ID":"804d8a64-33d8-43aa-9f98-06c5fff609ad","Type":"ContainerStarted","Data":"d29021feeadbc514efdaf4b8cd09964aa18daf744891213dd3e14850fb64e6d6"}
Jul 06 20:40:12.568090 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:12.568041    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c" podStartSLOduration=1.5680263220000001 podStartE2EDuration="1.568026322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:40:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:40:12.566727941 +0000 UTC m=+2062.108138935" watchObservedRunningTime="2026-07-06 20:40:12.568026322 +0000 UTC m=+2062.109437317"
Jul 06 20:40:13.553857 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:13.553822    2582 generic.go:356] "Generic (PLEG): container finished" podID="c039720e-4480-42d6-b0c4-535e74d4e58a" containerID="37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3" exitCode=0
Jul 06 20:40:13.554293 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:13.553893    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" event={"ID":"c039720e-4480-42d6-b0c4-535e74d4e58a","Type":"ContainerDied","Data":"37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3"}
Jul 06 20:40:13.554505 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:13.554487    2582 scope.go:117] "RemoveContainer" containerID="37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3"
Jul 06 20:40:13.555460 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:13.555436    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:40:13.555526 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:13.555501    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:40:13.555567 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:13.555533    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 20:40:14.560674 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:14.560637    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" event={"ID":"c039720e-4480-42d6-b0c4-535e74d4e58a","Type":"ContainerStarted","Data":"00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037"}
Jul 06 20:40:14.920678 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:14.920637    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:40:14.920898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:14.920777    2582 patch_prober.go:28] interesting pod/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:40:14.920898 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:14.920821    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" podUID="c039720e-4480-42d6-b0c4-535e74d4e58a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 06 20:40:15.919493 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:15.919451    2582 patch_prober.go:28] interesting pod/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:40:15.920101 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:15.920068    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" podUID="c039720e-4480-42d6-b0c4-535e74d4e58a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 06 20:40:16.919786 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:16.919747    2582 patch_prober.go:28] interesting pod/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:40:16.920306 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:16.919818    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" podUID="c039720e-4480-42d6-b0c4-535e74d4e58a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 06 20:40:17.497405 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:17.497364    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:40:17.919122 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:17.919082    2582 patch_prober.go:28] interesting pod/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 06 20:40:17.919458 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:17.919427    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" podUID="c039720e-4480-42d6-b0c4-535e74d4e58a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 06 20:40:18.922977 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:18.922947    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:40:18.923931 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:18.923912    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:40:22.208764 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:22.208728    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:22.209277 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:22.208778    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:22.221526 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:22.221501    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:22.609572 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:22.609547    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:40:30.708214 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.708164    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"]
Jul 06 20:40:30.710578 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.710559    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.713451 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.713429    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"kube-root-ca.crt\""
Jul 06 20:40:30.714400 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.714379    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"auth-test-model-67755c-kserve-self-signed-certs\""
Jul 06 20:40:30.714499 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.714458    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"default-dockercfg-f57b5\""
Jul 06 20:40:30.714568 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.714525    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"openshift-service-ca.crt\""
Jul 06 20:40:30.724621 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.724597    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"]
Jul 06 20:40:30.861582 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.861545    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-home\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.861754 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.861658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0701915-5d6f-4263-b579-d22be60f38d2-tls-certs\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.861754 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.861688    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-model-cache\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.861754 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.861704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptg85\" (UniqueName: \"kubernetes.io/projected/f0701915-5d6f-4263-b579-d22be60f38d2-kube-api-access-ptg85\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.861754 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.861742    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-tmp-dir\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.861901 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.861766    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-dshm\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.963058 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.962964    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-dshm\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.963266 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.963076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-home\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.963266 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.963148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0701915-5d6f-4263-b579-d22be60f38d2-tls-certs\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.963266 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.963173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-model-cache\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.963266 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.963197    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptg85\" (UniqueName: \"kubernetes.io/projected/f0701915-5d6f-4263-b579-d22be60f38d2-kube-api-access-ptg85\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.963514 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.963268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-tmp-dir\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.963514 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.963495    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-home\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.963654 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.963544    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-model-cache\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.963654 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.963611    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-tmp-dir\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.965289 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.965257    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-dshm\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.965625 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.965600    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0701915-5d6f-4263-b579-d22be60f38d2-tls-certs\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:30.972274 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:30.972251    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptg85\" (UniqueName: \"kubernetes.io/projected/f0701915-5d6f-4263-b579-d22be60f38d2-kube-api-access-ptg85\") pod \"auth-test-model-67755c-kserve-5bccb66cf-d744q\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") " pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:31.020124 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:31.020084    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:31.169126 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:31.169104    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"]
Jul 06 20:40:31.171038 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:40:31.171010    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0701915_5d6f_4263_b579_d22be60f38d2.slice/crio-a10648914dee4cb0bf2454877c3f7dce545319bdcf573ea51e284ceb06ad971d WatchSource:0}: Error finding container a10648914dee4cb0bf2454877c3f7dce545319bdcf573ea51e284ceb06ad971d: Status 404 returned error can't find the container with id a10648914dee4cb0bf2454877c3f7dce545319bdcf573ea51e284ceb06ad971d
Jul 06 20:40:31.648667 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:31.648628    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q" event={"ID":"f0701915-5d6f-4263-b579-d22be60f38d2","Type":"ContainerStarted","Data":"d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33"}
Jul 06 20:40:31.648667 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:31.648673    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q" event={"ID":"f0701915-5d6f-4263-b579-d22be60f38d2","Type":"ContainerStarted","Data":"a10648914dee4cb0bf2454877c3f7dce545319bdcf573ea51e284ceb06ad971d"}
Jul 06 20:40:31.682079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:31.682027    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q" podStartSLOduration=1.682013408 podStartE2EDuration="1.682013408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:40:31.680584574 +0000 UTC m=+2081.221995568" watchObservedRunningTime="2026-07-06 20:40:31.682013408 +0000 UTC m=+2081.223424400"
Jul 06 20:40:41.020278 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:41.020234    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:41.020278 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:41.020286    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:41.032727 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:41.032696    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:41.707741 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:41.707706    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:40:51.093879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:51.093846    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:40:51.099928 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:40:51.099906    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:42:38.706492 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:38.706455    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"]
Jul 06 20:42:39.598530 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:39.598492    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"]
Jul 06 20:42:53.726844 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:53.726783    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c" podUID="804d8a64-33d8-43aa-9f98-06c5fff609ad" containerName="main" containerID="cri-o://85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb" gracePeriod=45
Jul 06 20:42:53.971331 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:53.971303    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:42:54.014329 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014240    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-model-cache\") pod \"804d8a64-33d8-43aa-9f98-06c5fff609ad\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") "
Jul 06 20:42:54.014329 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014295    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/804d8a64-33d8-43aa-9f98-06c5fff609ad-tls-certs\") pod \"804d8a64-33d8-43aa-9f98-06c5fff609ad\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") "
Jul 06 20:42:54.014549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014346    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-tmp-dir\") pod \"804d8a64-33d8-43aa-9f98-06c5fff609ad\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") "
Jul 06 20:42:54.014549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014379    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-dshm\") pod \"804d8a64-33d8-43aa-9f98-06c5fff609ad\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") "
Jul 06 20:42:54.014549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014402    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w42x2\" (UniqueName: \"kubernetes.io/projected/804d8a64-33d8-43aa-9f98-06c5fff609ad-kube-api-access-w42x2\") pod \"804d8a64-33d8-43aa-9f98-06c5fff609ad\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") "
Jul 06 20:42:54.014549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014502    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-home\") pod \"804d8a64-33d8-43aa-9f98-06c5fff609ad\" (UID: \"804d8a64-33d8-43aa-9f98-06c5fff609ad\") "
Jul 06 20:42:54.014751 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014553    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "804d8a64-33d8-43aa-9f98-06c5fff609ad" (UID: "804d8a64-33d8-43aa-9f98-06c5fff609ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:42:54.014751 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014590    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "804d8a64-33d8-43aa-9f98-06c5fff609ad" (UID: "804d8a64-33d8-43aa-9f98-06c5fff609ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:42:54.014846 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014795    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-home" (OuterVolumeSpecName: "home") pod "804d8a64-33d8-43aa-9f98-06c5fff609ad" (UID: "804d8a64-33d8-43aa-9f98-06c5fff609ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:42:54.014914 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014895    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:54.014955 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014919    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:54.014955 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.014933    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:54.016640 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.016606    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/804d8a64-33d8-43aa-9f98-06c5fff609ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "804d8a64-33d8-43aa-9f98-06c5fff609ad" (UID: "804d8a64-33d8-43aa-9f98-06c5fff609ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:42:54.016751 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.016643    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-dshm" (OuterVolumeSpecName: "dshm") pod "804d8a64-33d8-43aa-9f98-06c5fff609ad" (UID: "804d8a64-33d8-43aa-9f98-06c5fff609ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:42:54.016982 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.016963    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804d8a64-33d8-43aa-9f98-06c5fff609ad-kube-api-access-w42x2" (OuterVolumeSpecName: "kube-api-access-w42x2") pod "804d8a64-33d8-43aa-9f98-06c5fff609ad" (UID: "804d8a64-33d8-43aa-9f98-06c5fff609ad"). InnerVolumeSpecName "kube-api-access-w42x2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:42:54.116261 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.116233    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/804d8a64-33d8-43aa-9f98-06c5fff609ad-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:54.116261 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.116259    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w42x2\" (UniqueName: \"kubernetes.io/projected/804d8a64-33d8-43aa-9f98-06c5fff609ad-kube-api-access-w42x2\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:54.116454 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.116270    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/804d8a64-33d8-43aa-9f98-06c5fff609ad-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:54.124922 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.124893    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"]
Jul 06 20:42:54.125302 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.125289    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="804d8a64-33d8-43aa-9f98-06c5fff609ad" containerName="main"
Jul 06 20:42:54.125370 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.125303    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="804d8a64-33d8-43aa-9f98-06c5fff609ad" containerName="main"
Jul 06 20:42:54.125408 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.125369    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="804d8a64-33d8-43aa-9f98-06c5fff609ad" containerName="main"
Jul 06 20:42:54.128286 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.128271    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.131342 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.131323    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-37e178\"/\"sub-test-model-37e178-kserve-self-signed-certs\""
Jul 06 20:42:54.144442 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.144419    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"]
Jul 06 20:42:54.217512 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.217478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-dshm\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.217686 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.217524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdkll\" (UniqueName: \"kubernetes.io/projected/03a79849-ff99-41cc-addb-e6e663193e11-kube-api-access-zdkll\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.217686 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.217584    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a79849-ff99-41cc-addb-e6e663193e11-tls-certs\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.217686 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.217658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-tmp-dir\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.217844 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.217741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-home\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.217844 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.217763    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-model-cache\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.318603 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.318574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-dshm\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.318758 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.318616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdkll\" (UniqueName: \"kubernetes.io/projected/03a79849-ff99-41cc-addb-e6e663193e11-kube-api-access-zdkll\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.318758 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.318650    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a79849-ff99-41cc-addb-e6e663193e11-tls-certs\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.318758 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.318686    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-tmp-dir\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.318758 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.318752    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-home\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.318915 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.318786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-model-cache\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.319120 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.319096    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-tmp-dir\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.319191 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.319128    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-model-cache\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.319191 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.319163    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-home\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.320930 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.320907    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-dshm\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.321104 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.321087    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a79849-ff99-41cc-addb-e6e663193e11-tls-certs\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.330684 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.330658    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdkll\" (UniqueName: \"kubernetes.io/projected/03a79849-ff99-41cc-addb-e6e663193e11-kube-api-access-zdkll\") pod \"sub-test-model-37e178-kserve-7b4589c74f-k67tz\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") " pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.331715 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.331694    2582 generic.go:356] "Generic (PLEG): container finished" podID="804d8a64-33d8-43aa-9f98-06c5fff609ad" containerID="85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb" exitCode=0
Jul 06 20:42:54.331818 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.331744    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"
Jul 06 20:42:54.331818 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.331759    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c" event={"ID":"804d8a64-33d8-43aa-9f98-06c5fff609ad","Type":"ContainerDied","Data":"85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb"}
Jul 06 20:42:54.331818 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.331791    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c" event={"ID":"804d8a64-33d8-43aa-9f98-06c5fff609ad","Type":"ContainerDied","Data":"d29021feeadbc514efdaf4b8cd09964aa18daf744891213dd3e14850fb64e6d6"}
Jul 06 20:42:54.331818 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.331806    2582 scope.go:117] "RemoveContainer" containerID="85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb"
Jul 06 20:42:54.340949 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.340929    2582 scope.go:117] "RemoveContainer" containerID="85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb"
Jul 06 20:42:54.341193 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:42:54.341174    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb\": container with ID starting with 85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb not found: ID does not exist" containerID="85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb"
Jul 06 20:42:54.341273 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.341223    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb"} err="failed to get container status \"85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb\": rpc error: code = NotFound desc = could not find container \"85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb\": container with ID starting with 85c0614985f73282b3e374bc0e4ab0a0044ed85506764ec2deb92f9c4bb605cb not found: ID does not exist"
Jul 06 20:42:54.361002 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.360979    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"]
Jul 06 20:42:54.363256 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.363227    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/auth-test-model-37e178-kserve-6d4854fcbc-kq62c"]
Jul 06 20:42:54.437461 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.437427    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:42:54.573106 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.573025    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"]
Jul 06 20:42:54.575986 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:42:54.575961    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03a79849_ff99_41cc_addb_e6e663193e11.slice/crio-6544d1254df5edc40a87b16e4d7ea6d06b1d79dbb10906d378cf8e1a6a8308fa WatchSource:0}: Error finding container 6544d1254df5edc40a87b16e4d7ea6d06b1d79dbb10906d378cf8e1a6a8308fa: Status 404 returned error can't find the container with id 6544d1254df5edc40a87b16e4d7ea6d06b1d79dbb10906d378cf8e1a6a8308fa
Jul 06 20:42:54.619522 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.619491    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q" podUID="f0701915-5d6f-4263-b579-d22be60f38d2" containerName="main" containerID="cri-o://d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33" gracePeriod=45
Jul 06 20:42:54.875473 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.875447    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:42:54.924759 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.924730    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptg85\" (UniqueName: \"kubernetes.io/projected/f0701915-5d6f-4263-b579-d22be60f38d2-kube-api-access-ptg85\") pod \"f0701915-5d6f-4263-b579-d22be60f38d2\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") "
Jul 06 20:42:54.924950 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.924839    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-model-cache\") pod \"f0701915-5d6f-4263-b579-d22be60f38d2\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") "
Jul 06 20:42:54.924950 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.924865    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-tmp-dir\") pod \"f0701915-5d6f-4263-b579-d22be60f38d2\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") "
Jul 06 20:42:54.924950 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.924925    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-home\") pod \"f0701915-5d6f-4263-b579-d22be60f38d2\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") "
Jul 06 20:42:54.924950 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.924948    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0701915-5d6f-4263-b579-d22be60f38d2-tls-certs\") pod \"f0701915-5d6f-4263-b579-d22be60f38d2\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") "
Jul 06 20:42:54.925178 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.924983    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-dshm\") pod \"f0701915-5d6f-4263-b579-d22be60f38d2\" (UID: \"f0701915-5d6f-4263-b579-d22be60f38d2\") "
Jul 06 20:42:54.925178 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.925138    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0701915-5d6f-4263-b579-d22be60f38d2" (UID: "f0701915-5d6f-4263-b579-d22be60f38d2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:42:54.925178 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.925158    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0701915-5d6f-4263-b579-d22be60f38d2" (UID: "f0701915-5d6f-4263-b579-d22be60f38d2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:42:54.925352 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.925322    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-home" (OuterVolumeSpecName: "home") pod "f0701915-5d6f-4263-b579-d22be60f38d2" (UID: "f0701915-5d6f-4263-b579-d22be60f38d2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:42:54.925400 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.925374    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:54.925444 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.925415    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:54.927108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.927060    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0701915-5d6f-4263-b579-d22be60f38d2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0701915-5d6f-4263-b579-d22be60f38d2" (UID: "f0701915-5d6f-4263-b579-d22be60f38d2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:42:54.927277 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.927121    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0701915-5d6f-4263-b579-d22be60f38d2-kube-api-access-ptg85" (OuterVolumeSpecName: "kube-api-access-ptg85") pod "f0701915-5d6f-4263-b579-d22be60f38d2" (UID: "f0701915-5d6f-4263-b579-d22be60f38d2"). InnerVolumeSpecName "kube-api-access-ptg85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:42:54.927277 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:54.927168    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-dshm" (OuterVolumeSpecName: "dshm") pod "f0701915-5d6f-4263-b579-d22be60f38d2" (UID: "f0701915-5d6f-4263-b579-d22be60f38d2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:42:55.026359 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.026322    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:55.026359 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.026351    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0701915-5d6f-4263-b579-d22be60f38d2-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:55.026359 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.026361    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0701915-5d6f-4263-b579-d22be60f38d2-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:55.026359 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.026369    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptg85\" (UniqueName: \"kubernetes.io/projected/f0701915-5d6f-4263-b579-d22be60f38d2-kube-api-access-ptg85\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:42:55.067303 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.067272    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="804d8a64-33d8-43aa-9f98-06c5fff609ad" path="/var/lib/kubelet/pods/804d8a64-33d8-43aa-9f98-06c5fff609ad/volumes"
Jul 06 20:42:55.338380 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.338347    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz" event={"ID":"03a79849-ff99-41cc-addb-e6e663193e11","Type":"ContainerStarted","Data":"ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141"}
Jul 06 20:42:55.338554 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.338392    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz" event={"ID":"03a79849-ff99-41cc-addb-e6e663193e11","Type":"ContainerStarted","Data":"6544d1254df5edc40a87b16e4d7ea6d06b1d79dbb10906d378cf8e1a6a8308fa"}
Jul 06 20:42:55.339616 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.339592    2582 generic.go:356] "Generic (PLEG): container finished" podID="f0701915-5d6f-4263-b579-d22be60f38d2" containerID="d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33" exitCode=0
Jul 06 20:42:55.339718 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.339625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q" event={"ID":"f0701915-5d6f-4263-b579-d22be60f38d2","Type":"ContainerDied","Data":"d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33"}
Jul 06 20:42:55.339718 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.339628    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"
Jul 06 20:42:55.339718 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.339649    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q" event={"ID":"f0701915-5d6f-4263-b579-d22be60f38d2","Type":"ContainerDied","Data":"a10648914dee4cb0bf2454877c3f7dce545319bdcf573ea51e284ceb06ad971d"}
Jul 06 20:42:55.339718 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.339671    2582 scope.go:117] "RemoveContainer" containerID="d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33"
Jul 06 20:42:55.348221 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.348191    2582 scope.go:117] "RemoveContainer" containerID="d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33"
Jul 06 20:42:55.348461 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:42:55.348440    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33\": container with ID starting with d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33 not found: ID does not exist" containerID="d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33"
Jul 06 20:42:55.348525 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.348473    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33"} err="failed to get container status \"d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33\": rpc error: code = NotFound desc = could not find container \"d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33\": container with ID starting with d22945579d606d363eba2809147d7e4f7b7cbadb92f116f9302ca2b7d2986b33 not found: ID does not exist"
Jul 06 20:42:55.402648 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.402596    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz" podStartSLOduration=1.402580402 podStartE2EDuration="1.402580402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:42:55.386644653 +0000 UTC m=+2224.928055647" watchObservedRunningTime="2026-07-06 20:42:55.402580402 +0000 UTC m=+2224.943991396"
Jul 06 20:42:55.404079 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.404059    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"]
Jul 06 20:42:55.407946 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:55.407922    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/auth-test-model-67755c-kserve-5bccb66cf-d744q"]
Jul 06 20:42:57.066798 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:42:57.066763    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0701915-5d6f-4263-b579-d22be60f38d2" path="/var/lib/kubelet/pods/f0701915-5d6f-4263-b579-d22be60f38d2/volumes"
Jul 06 20:43:04.438058 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:04.438018    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:43:04.438473 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:04.438074    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:43:04.450177 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:04.450154    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:43:05.400866 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:05.400824    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:43:26.505549 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.505467    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"]
Jul 06 20:43:26.506008 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.505863    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0701915-5d6f-4263-b579-d22be60f38d2" containerName="main"
Jul 06 20:43:26.506008 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.505874    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0701915-5d6f-4263-b579-d22be60f38d2" containerName="main"
Jul 06 20:43:26.506008 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.505933    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0701915-5d6f-4263-b579-d22be60f38d2" containerName="main"
Jul 06 20:43:26.508962 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.508940    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.514835 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.514811    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"default-dockercfg-f57b5\""
Jul 06 20:43:26.515001 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.514841    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"sub-test-model-67755c-kserve-self-signed-certs\""
Jul 06 20:43:26.515001 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.514910    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"openshift-service-ca.crt\""
Jul 06 20:43:26.515001 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.514911    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"kube-root-ca.crt\""
Jul 06 20:43:26.523651 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.523625    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"]
Jul 06 20:43:26.525570 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.525543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tmp-dir\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.525738 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.525646    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-dshm\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.525738 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.525701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dknd8\" (UniqueName: \"kubernetes.io/projected/e68e361a-eb3e-47cd-aaa8-7778fef01eab-kube-api-access-dknd8\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.525848 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.525775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-model-cache\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.525848 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.525809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tls-certs\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.525848 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.525835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-home\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.626286 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.626251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tls-certs\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.626286 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.626291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-home\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.626559 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.626314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tmp-dir\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.626559 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.626370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-dshm\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.626559 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.626410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dknd8\" (UniqueName: \"kubernetes.io/projected/e68e361a-eb3e-47cd-aaa8-7778fef01eab-kube-api-access-dknd8\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.626559 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.626479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-model-cache\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.626794 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.626767    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-home\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.626844 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.626790    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tmp-dir\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.626897 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.626881    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-model-cache\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.628704 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.628685    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-dshm\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.628987 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.628972    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tls-certs\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.643338 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.643310    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dknd8\" (UniqueName: \"kubernetes.io/projected/e68e361a-eb3e-47cd-aaa8-7778fef01eab-kube-api-access-dknd8\") pod \"sub-test-model-67755c-kserve-76b487b85c-xkldn\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") " pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.818638 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.818605    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:26.964895 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:26.964869    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"]
Jul 06 20:43:26.966587 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:43:26.966562    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode68e361a_eb3e_47cd_aaa8_7778fef01eab.slice/crio-71ccab0b003fc7a927e97bb34ab775d38581b01fd9789f0a4d1f2d5f31c396e1 WatchSource:0}: Error finding container 71ccab0b003fc7a927e97bb34ab775d38581b01fd9789f0a4d1f2d5f31c396e1: Status 404 returned error can't find the container with id 71ccab0b003fc7a927e97bb34ab775d38581b01fd9789f0a4d1f2d5f31c396e1
Jul 06 20:43:27.498144 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:27.498105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn" event={"ID":"e68e361a-eb3e-47cd-aaa8-7778fef01eab","Type":"ContainerStarted","Data":"62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234"}
Jul 06 20:43:27.498144 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:27.498151    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn" event={"ID":"e68e361a-eb3e-47cd-aaa8-7778fef01eab","Type":"ContainerStarted","Data":"71ccab0b003fc7a927e97bb34ab775d38581b01fd9789f0a4d1f2d5f31c396e1"}
Jul 06 20:43:27.525499 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:27.525449    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn" podStartSLOduration=1.5254348100000001 podStartE2EDuration="1.52543481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:27.522832175 +0000 UTC m=+2257.064243167" watchObservedRunningTime="2026-07-06 20:43:27.52543481 +0000 UTC m=+2257.066845814"
Jul 06 20:43:36.818792 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:36.818755    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:36.819299 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:36.819024    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:36.836000 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:36.835977    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:43:37.558635 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:43:37.558609    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:44:18.456091 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:18.456046    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"]
Jul 06 20:44:19.326347 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:19.326310    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"]
Jul 06 20:44:33.476270 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.476227    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz" podUID="03a79849-ff99-41cc-addb-e6e663193e11" containerName="main" containerID="cri-o://ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141" gracePeriod=45
Jul 06 20:44:33.719173 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.719143    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:44:33.815822 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.815733    2582 generic.go:356] "Generic (PLEG): container finished" podID="03a79849-ff99-41cc-addb-e6e663193e11" containerID="ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141" exitCode=0
Jul 06 20:44:33.815822 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.815781    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"
Jul 06 20:44:33.816009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.815818    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz" event={"ID":"03a79849-ff99-41cc-addb-e6e663193e11","Type":"ContainerDied","Data":"ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141"}
Jul 06 20:44:33.816009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.815862    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz" event={"ID":"03a79849-ff99-41cc-addb-e6e663193e11","Type":"ContainerDied","Data":"6544d1254df5edc40a87b16e4d7ea6d06b1d79dbb10906d378cf8e1a6a8308fa"}
Jul 06 20:44:33.816009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.815881    2582 scope.go:117] "RemoveContainer" containerID="ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141"
Jul 06 20:44:33.823951 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.823935    2582 scope.go:117] "RemoveContainer" containerID="ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141"
Jul 06 20:44:33.824176 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:44:33.824160    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141\": container with ID starting with ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141 not found: ID does not exist" containerID="ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141"
Jul 06 20:44:33.824252 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.824185    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141"} err="failed to get container status \"ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141\": rpc error: code = NotFound desc = could not find container \"ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141\": container with ID starting with ace810dd175d63a3107680c17063392ff29be63d9df4069e687c5649c6c67141 not found: ID does not exist"
Jul 06 20:44:33.868800 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.868772    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-tmp-dir\") pod \"03a79849-ff99-41cc-addb-e6e663193e11\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") "
Jul 06 20:44:33.868931 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.868809    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-model-cache\") pod \"03a79849-ff99-41cc-addb-e6e663193e11\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") "
Jul 06 20:44:33.868931 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.868840    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a79849-ff99-41cc-addb-e6e663193e11-tls-certs\") pod \"03a79849-ff99-41cc-addb-e6e663193e11\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") "
Jul 06 20:44:33.868931 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.868880    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-dshm\") pod \"03a79849-ff99-41cc-addb-e6e663193e11\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") "
Jul 06 20:44:33.869075 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.869050    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdkll\" (UniqueName: \"kubernetes.io/projected/03a79849-ff99-41cc-addb-e6e663193e11-kube-api-access-zdkll\") pod \"03a79849-ff99-41cc-addb-e6e663193e11\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") "
Jul 06 20:44:33.869118 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.869065    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-model-cache" (OuterVolumeSpecName: "model-cache") pod "03a79849-ff99-41cc-addb-e6e663193e11" (UID: "03a79849-ff99-41cc-addb-e6e663193e11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:44:33.869118 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.869078    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "03a79849-ff99-41cc-addb-e6e663193e11" (UID: "03a79849-ff99-41cc-addb-e6e663193e11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:44:33.869118 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.869099    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-home\") pod \"03a79849-ff99-41cc-addb-e6e663193e11\" (UID: \"03a79849-ff99-41cc-addb-e6e663193e11\") "
Jul 06 20:44:33.869323 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.869305    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-home" (OuterVolumeSpecName: "home") pod "03a79849-ff99-41cc-addb-e6e663193e11" (UID: "03a79849-ff99-41cc-addb-e6e663193e11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:44:33.869434 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.869422    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:33.869495 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.869435    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:33.869495 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.869444    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:33.870989 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.870968    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-dshm" (OuterVolumeSpecName: "dshm") pod "03a79849-ff99-41cc-addb-e6e663193e11" (UID: "03a79849-ff99-41cc-addb-e6e663193e11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:44:33.870989 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.870974    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03a79849-ff99-41cc-addb-e6e663193e11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "03a79849-ff99-41cc-addb-e6e663193e11" (UID: "03a79849-ff99-41cc-addb-e6e663193e11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:44:33.871108 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.871014    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a79849-ff99-41cc-addb-e6e663193e11-kube-api-access-zdkll" (OuterVolumeSpecName: "kube-api-access-zdkll") pod "03a79849-ff99-41cc-addb-e6e663193e11" (UID: "03a79849-ff99-41cc-addb-e6e663193e11"). InnerVolumeSpecName "kube-api-access-zdkll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:44:33.970628 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.970588    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdkll\" (UniqueName: \"kubernetes.io/projected/03a79849-ff99-41cc-addb-e6e663193e11-kube-api-access-zdkll\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:33.970628 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.970624    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a79849-ff99-41cc-addb-e6e663193e11-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:33.970628 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:33.970634    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a79849-ff99-41cc-addb-e6e663193e11-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:34.143492 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.143457    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"]
Jul 06 20:44:34.148892 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.148865    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/sub-test-model-37e178-kserve-7b4589c74f-k67tz"]
Jul 06 20:44:34.345892 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.345846    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn" podUID="e68e361a-eb3e-47cd-aaa8-7778fef01eab" containerName="main" containerID="cri-o://62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234" gracePeriod=45
Jul 06 20:44:34.509765 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.509736    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"]
Jul 06 20:44:34.510107 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.510092    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a79849-ff99-41cc-addb-e6e663193e11" containerName="main"
Jul 06 20:44:34.510107 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.510103    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a79849-ff99-41cc-addb-e6e663193e11" containerName="main"
Jul 06 20:44:34.510176 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.510167    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a79849-ff99-41cc-addb-e6e663193e11" containerName="main"
Jul 06 20:44:34.512880 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.512864    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.516228 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.516191    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-37e178\"/\"openshift-service-ca.crt\""
Jul 06 20:44:34.517119 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.517101    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-37e178\"/\"kube-root-ca.crt\""
Jul 06 20:44:34.517230 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.517128    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-37e178\"/\"default-dockercfg-r54jz\""
Jul 06 20:44:34.517295 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.517229    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-37e178\"/\"rate-test-model-37e178-kserve-self-signed-certs\""
Jul 06 20:44:34.528699 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.528675    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"]
Jul 06 20:44:34.600481 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.600456    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:44:34.675850 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.675820    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-dshm\") pod \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") "
Jul 06 20:44:34.676045 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.675914    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-home\") pod \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") "
Jul 06 20:44:34.676045 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.675944    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dknd8\" (UniqueName: \"kubernetes.io/projected/e68e361a-eb3e-47cd-aaa8-7778fef01eab-kube-api-access-dknd8\") pod \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") "
Jul 06 20:44:34.676045 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676013    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-model-cache\") pod \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") "
Jul 06 20:44:34.676239 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676047    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tls-certs\") pod \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") "
Jul 06 20:44:34.676239 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676075    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tmp-dir\") pod \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\" (UID: \"e68e361a-eb3e-47cd-aaa8-7778fef01eab\") "
Jul 06 20:44:34.676239 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676193    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-home" (OuterVolumeSpecName: "home") pod "e68e361a-eb3e-47cd-aaa8-7778fef01eab" (UID: "e68e361a-eb3e-47cd-aaa8-7778fef01eab"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:44:34.676409 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676271    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-home\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.676409 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-model-cache\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.676409 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-tmp-dir\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.676409 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676334    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-model-cache" (OuterVolumeSpecName: "model-cache") pod "e68e361a-eb3e-47cd-aaa8-7778fef01eab" (UID: "e68e361a-eb3e-47cd-aaa8-7778fef01eab"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:44:34.676409 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676380    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e68e361a-eb3e-47cd-aaa8-7778fef01eab" (UID: "e68e361a-eb3e-47cd-aaa8-7778fef01eab"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:44:34.676619 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676445    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x87l\" (UniqueName: \"kubernetes.io/projected/7dc09597-c203-40ab-8f65-f29a5bc53240-kube-api-access-8x87l\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.676619 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-dshm\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.676619 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc09597-c203-40ab-8f65-f29a5bc53240-tls-certs\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.676779 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676627    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:34.676779 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676643    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:34.676779 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.676659    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:34.678181 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.678157    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e68e361a-eb3e-47cd-aaa8-7778fef01eab-kube-api-access-dknd8" (OuterVolumeSpecName: "kube-api-access-dknd8") pod "e68e361a-eb3e-47cd-aaa8-7778fef01eab" (UID: "e68e361a-eb3e-47cd-aaa8-7778fef01eab"). InnerVolumeSpecName "kube-api-access-dknd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:44:34.678396 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.678376    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-dshm" (OuterVolumeSpecName: "dshm") pod "e68e361a-eb3e-47cd-aaa8-7778fef01eab" (UID: "e68e361a-eb3e-47cd-aaa8-7778fef01eab"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:44:34.678461 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.678412    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e68e361a-eb3e-47cd-aaa8-7778fef01eab" (UID: "e68e361a-eb3e-47cd-aaa8-7778fef01eab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:44:34.777540 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.777454    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-dshm\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.777540 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.777498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc09597-c203-40ab-8f65-f29a5bc53240-tls-certs\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.777755 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.777574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-home\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.777755 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.777616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-model-cache\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.777755 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.777643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-tmp-dir\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.777755 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.777675    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x87l\" (UniqueName: \"kubernetes.io/projected/7dc09597-c203-40ab-8f65-f29a5bc53240-kube-api-access-8x87l\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.777755 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.777744    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e68e361a-eb3e-47cd-aaa8-7778fef01eab-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:34.778009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.777760    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dknd8\" (UniqueName: \"kubernetes.io/projected/e68e361a-eb3e-47cd-aaa8-7778fef01eab-kube-api-access-dknd8\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:34.778009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.777774    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e68e361a-eb3e-47cd-aaa8-7778fef01eab-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:44:34.778097 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.778008    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-home\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.778097 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.778046    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-tmp-dir\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.778177 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.778121    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-model-cache\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.779776 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.779752    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-dshm\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.780027 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.780010    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc09597-c203-40ab-8f65-f29a5bc53240-tls-certs\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.793960 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.793936    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x87l\" (UniqueName: \"kubernetes.io/projected/7dc09597-c203-40ab-8f65-f29a5bc53240-kube-api-access-8x87l\") pod \"rate-test-model-37e178-kserve-7b95d54d7-frzq6\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") " pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.822074 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.822047    2582 generic.go:356] "Generic (PLEG): container finished" podID="e68e361a-eb3e-47cd-aaa8-7778fef01eab" containerID="62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234" exitCode=0
Jul 06 20:44:34.822195 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.822085    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"
Jul 06 20:44:34.822195 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.822083    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn" event={"ID":"e68e361a-eb3e-47cd-aaa8-7778fef01eab","Type":"ContainerDied","Data":"62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234"}
Jul 06 20:44:34.822331 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.822196    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn" event={"ID":"e68e361a-eb3e-47cd-aaa8-7778fef01eab","Type":"ContainerDied","Data":"71ccab0b003fc7a927e97bb34ab775d38581b01fd9789f0a4d1f2d5f31c396e1"}
Jul 06 20:44:34.822331 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.822256    2582 scope.go:117] "RemoveContainer" containerID="62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234"
Jul 06 20:44:34.823412 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.823391    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:34.831065 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.831050    2582 scope.go:117] "RemoveContainer" containerID="62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234"
Jul 06 20:44:34.831353 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:44:34.831334    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234\": container with ID starting with 62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234 not found: ID does not exist" containerID="62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234"
Jul 06 20:44:34.831426 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.831363    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234"} err="failed to get container status \"62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234\": rpc error: code = NotFound desc = could not find container \"62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234\": container with ID starting with 62508aa824b98fda8ebd6168001c33ad36f75eed14a2baf4bd92f07b8e0fd234 not found: ID does not exist"
Jul 06 20:44:34.859603 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.859574    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"]
Jul 06 20:44:34.870582 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.870556    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/sub-test-model-67755c-kserve-76b487b85c-xkldn"]
Jul 06 20:44:34.967028 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:34.966990    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"]
Jul 06 20:44:34.967823 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:44:34.967797    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7dc09597_c203_40ab_8f65_f29a5bc53240.slice/crio-15ac66759ca9eacd3009aeee4e37bd1a842fd0d14d514dcec64f44471b1d84f9 WatchSource:0}: Error finding container 15ac66759ca9eacd3009aeee4e37bd1a842fd0d14d514dcec64f44471b1d84f9: Status 404 returned error can't find the container with id 15ac66759ca9eacd3009aeee4e37bd1a842fd0d14d514dcec64f44471b1d84f9
Jul 06 20:44:35.065973 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:35.065898    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a79849-ff99-41cc-addb-e6e663193e11" path="/var/lib/kubelet/pods/03a79849-ff99-41cc-addb-e6e663193e11/volumes"
Jul 06 20:44:35.066350 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:35.066305    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e68e361a-eb3e-47cd-aaa8-7778fef01eab" path="/var/lib/kubelet/pods/e68e361a-eb3e-47cd-aaa8-7778fef01eab/volumes"
Jul 06 20:44:35.830362 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:35.830324    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6" event={"ID":"7dc09597-c203-40ab-8f65-f29a5bc53240","Type":"ContainerStarted","Data":"dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105"}
Jul 06 20:44:35.830766 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:35.830371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6" event={"ID":"7dc09597-c203-40ab-8f65-f29a5bc53240","Type":"ContainerStarted","Data":"15ac66759ca9eacd3009aeee4e37bd1a842fd0d14d514dcec64f44471b1d84f9"}
Jul 06 20:44:35.864999 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:35.864946    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6" podStartSLOduration=1.8649306 podStartE2EDuration="1.8649306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:35.861308072 +0000 UTC m=+2325.402719065" watchObservedRunningTime="2026-07-06 20:44:35.8649306 +0000 UTC m=+2325.406341591"
Jul 06 20:44:44.824019 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:44.823963    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:44.824519 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:44.824046    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:44.836191 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:44.836165    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:44:44.883997 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:44:44.883972    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:45:16.119891 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.119852    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"]
Jul 06 20:45:16.122215 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.120239    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68e361a-eb3e-47cd-aaa8-7778fef01eab" containerName="main"
Jul 06 20:45:16.122215 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.120251    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68e361a-eb3e-47cd-aaa8-7778fef01eab" containerName="main"
Jul 06 20:45:16.122215 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.120320    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68e361a-eb3e-47cd-aaa8-7778fef01eab" containerName="main"
Jul 06 20:45:16.123110 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.123094    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.126302 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.126278    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"openshift-service-ca.crt\""
Jul 06 20:45:16.127420 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.127400    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"default-dockercfg-f57b5\""
Jul 06 20:45:16.127517 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.127404    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"rate-test-model-67755c-kserve-self-signed-certs\""
Jul 06 20:45:16.127517 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.127467    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-67755c\"/\"kube-root-ca.crt\""
Jul 06 20:45:16.133702 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.133661    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"]
Jul 06 20:45:16.279920 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.279883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-model-cache\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.280153 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.279952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-dshm\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.280153 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.280064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-home\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.280395 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.280237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8acc5228-7f9e-4b54-8f85-3472d6e95814-tls-certs\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.280395 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.280293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2vmt\" (UniqueName: \"kubernetes.io/projected/8acc5228-7f9e-4b54-8f85-3472d6e95814-kube-api-access-z2vmt\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.280395 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.280328    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-tmp-dir\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.381270 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.381148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8acc5228-7f9e-4b54-8f85-3472d6e95814-tls-certs\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.381270 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.381190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2vmt\" (UniqueName: \"kubernetes.io/projected/8acc5228-7f9e-4b54-8f85-3472d6e95814-kube-api-access-z2vmt\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.381493 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.381232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-tmp-dir\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.381493 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.381405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-model-cache\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.381493 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.381472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-dshm\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.381654 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.381517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-home\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.381839 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.381813    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-tmp-dir\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.381912 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.381819    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-model-cache\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.381912 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.381864    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-home\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.383581 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.383558    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-dshm\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.383754 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.383733    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8acc5228-7f9e-4b54-8f85-3472d6e95814-tls-certs\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.389756 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.389736    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2vmt\" (UniqueName: \"kubernetes.io/projected/8acc5228-7f9e-4b54-8f85-3472d6e95814-kube-api-access-z2vmt\") pod \"rate-test-model-67755c-kserve-7f956bcc99-rhhl2\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") " pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.433057 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.433016    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:16.567425 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:16.567398    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"]
Jul 06 20:45:16.569412 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:45:16.569388    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8acc5228_7f9e_4b54_8f85_3472d6e95814.slice/crio-0f55e12d038325f57f8076c78ca8e1bd839afb38b6cd3e263502f008437c3a65 WatchSource:0}: Error finding container 0f55e12d038325f57f8076c78ca8e1bd839afb38b6cd3e263502f008437c3a65: Status 404 returned error can't find the container with id 0f55e12d038325f57f8076c78ca8e1bd839afb38b6cd3e263502f008437c3a65
Jul 06 20:45:17.031949 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:17.031911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2" event={"ID":"8acc5228-7f9e-4b54-8f85-3472d6e95814","Type":"ContainerStarted","Data":"111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a"}
Jul 06 20:45:17.031949 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:17.031953    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2" event={"ID":"8acc5228-7f9e-4b54-8f85-3472d6e95814","Type":"ContainerStarted","Data":"0f55e12d038325f57f8076c78ca8e1bd839afb38b6cd3e263502f008437c3a65"}
Jul 06 20:45:17.057145 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:17.057097    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2" podStartSLOduration=1.057082591 podStartE2EDuration="1.057082591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:45:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:45:17.055036619 +0000 UTC m=+2366.596447613" watchObservedRunningTime="2026-07-06 20:45:17.057082591 +0000 UTC m=+2366.598493626"
Jul 06 20:45:26.433327 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:26.433275    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:26.433845 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:26.433362    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:26.445757 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:26.445731    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:27.089831 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:27.089802    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:45:51.122021 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:51.121991    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:45:51.129797 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:51.129774    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5gqht_6b790fa8-3aa5-42d0-822d-1985b5526b53/ovn-acl-logging/0.log"
Jul 06 20:45:58.704453 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:58.704413    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"]
Jul 06 20:45:59.584251 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:45:59.584198    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"]
Jul 06 20:46:13.724023 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:13.723935    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6" podUID="7dc09597-c203-40ab-8f65-f29a5bc53240" containerName="main" containerID="cri-o://dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105" gracePeriod=45
Jul 06 20:46:13.969674 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:13.969649    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:46:14.038692 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.038611    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-dshm\") pod \"7dc09597-c203-40ab-8f65-f29a5bc53240\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") "
Jul 06 20:46:14.038692 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.038649    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-tmp-dir\") pod \"7dc09597-c203-40ab-8f65-f29a5bc53240\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") "
Jul 06 20:46:14.038916 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.038694    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x87l\" (UniqueName: \"kubernetes.io/projected/7dc09597-c203-40ab-8f65-f29a5bc53240-kube-api-access-8x87l\") pod \"7dc09597-c203-40ab-8f65-f29a5bc53240\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") "
Jul 06 20:46:14.038916 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.038782    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc09597-c203-40ab-8f65-f29a5bc53240-tls-certs\") pod \"7dc09597-c203-40ab-8f65-f29a5bc53240\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") "
Jul 06 20:46:14.038916 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.038813    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-home\") pod \"7dc09597-c203-40ab-8f65-f29a5bc53240\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") "
Jul 06 20:46:14.038916 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.038843    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-model-cache\") pod \"7dc09597-c203-40ab-8f65-f29a5bc53240\" (UID: \"7dc09597-c203-40ab-8f65-f29a5bc53240\") "
Jul 06 20:46:14.039121 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.038956    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7dc09597-c203-40ab-8f65-f29a5bc53240" (UID: "7dc09597-c203-40ab-8f65-f29a5bc53240"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:14.039195 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.039117    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-home" (OuterVolumeSpecName: "home") pod "7dc09597-c203-40ab-8f65-f29a5bc53240" (UID: "7dc09597-c203-40ab-8f65-f29a5bc53240"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:14.039195 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.039163    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-model-cache" (OuterVolumeSpecName: "model-cache") pod "7dc09597-c203-40ab-8f65-f29a5bc53240" (UID: "7dc09597-c203-40ab-8f65-f29a5bc53240"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:14.039344 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.039265    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:14.039344 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.039286    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:14.039344 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.039300    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:14.040977 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.040951    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-dshm" (OuterVolumeSpecName: "dshm") pod "7dc09597-c203-40ab-8f65-f29a5bc53240" (UID: "7dc09597-c203-40ab-8f65-f29a5bc53240"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:14.041138 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.041115    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dc09597-c203-40ab-8f65-f29a5bc53240-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7dc09597-c203-40ab-8f65-f29a5bc53240" (UID: "7dc09597-c203-40ab-8f65-f29a5bc53240"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:46:14.041365 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.041340    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dc09597-c203-40ab-8f65-f29a5bc53240-kube-api-access-8x87l" (OuterVolumeSpecName: "kube-api-access-8x87l") pod "7dc09597-c203-40ab-8f65-f29a5bc53240" (UID: "7dc09597-c203-40ab-8f65-f29a5bc53240"). InnerVolumeSpecName "kube-api-access-8x87l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:46:14.140690 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.140650    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc09597-c203-40ab-8f65-f29a5bc53240-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:14.140690 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.140683    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dc09597-c203-40ab-8f65-f29a5bc53240-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:14.140690 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.140697    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x87l\" (UniqueName: \"kubernetes.io/projected/7dc09597-c203-40ab-8f65-f29a5bc53240-kube-api-access-8x87l\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:14.315987 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.315898    2582 generic.go:356] "Generic (PLEG): container finished" podID="7dc09597-c203-40ab-8f65-f29a5bc53240" containerID="dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105" exitCode=0
Jul 06 20:46:14.315987 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.315946    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"
Jul 06 20:46:14.315987 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.315970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6" event={"ID":"7dc09597-c203-40ab-8f65-f29a5bc53240","Type":"ContainerDied","Data":"dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105"}
Jul 06 20:46:14.316276 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.316000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6" event={"ID":"7dc09597-c203-40ab-8f65-f29a5bc53240","Type":"ContainerDied","Data":"15ac66759ca9eacd3009aeee4e37bd1a842fd0d14d514dcec64f44471b1d84f9"}
Jul 06 20:46:14.316276 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.316018    2582 scope.go:117] "RemoveContainer" containerID="dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105"
Jul 06 20:46:14.325352 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.325332    2582 scope.go:117] "RemoveContainer" containerID="dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105"
Jul 06 20:46:14.325602 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:46:14.325583    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105\": container with ID starting with dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105 not found: ID does not exist" containerID="dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105"
Jul 06 20:46:14.325656 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.325614    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105"} err="failed to get container status \"dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105\": rpc error: code = NotFound desc = could not find container \"dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105\": container with ID starting with dd7b71375ebe9a56441e99b53afff9373e1f752d57e061b68d4984f9a6c46105 not found: ID does not exist"
Jul 06 20:46:14.340626 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.340596    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"]
Jul 06 20:46:14.342289 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.342268    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-37e178/rate-test-model-37e178-kserve-7b95d54d7-frzq6"]
Jul 06 20:46:14.604577 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.604519    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2" podUID="8acc5228-7f9e-4b54-8f85-3472d6e95814" containerName="main" containerID="cri-o://111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a" gracePeriod=45
Jul 06 20:46:14.862390 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.862329    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:46:14.948095 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.948059    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-model-cache\") pod \"8acc5228-7f9e-4b54-8f85-3472d6e95814\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") "
Jul 06 20:46:14.948095 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.948101    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-dshm\") pod \"8acc5228-7f9e-4b54-8f85-3472d6e95814\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") "
Jul 06 20:46:14.948373 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.948124    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-home\") pod \"8acc5228-7f9e-4b54-8f85-3472d6e95814\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") "
Jul 06 20:46:14.948373 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.948150    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-tmp-dir\") pod \"8acc5228-7f9e-4b54-8f85-3472d6e95814\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") "
Jul 06 20:46:14.948373 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.948180    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8acc5228-7f9e-4b54-8f85-3472d6e95814-tls-certs\") pod \"8acc5228-7f9e-4b54-8f85-3472d6e95814\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") "
Jul 06 20:46:14.948373 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.948221    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2vmt\" (UniqueName: \"kubernetes.io/projected/8acc5228-7f9e-4b54-8f85-3472d6e95814-kube-api-access-z2vmt\") pod \"8acc5228-7f9e-4b54-8f85-3472d6e95814\" (UID: \"8acc5228-7f9e-4b54-8f85-3472d6e95814\") "
Jul 06 20:46:14.948577 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.948457    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-home" (OuterVolumeSpecName: "home") pod "8acc5228-7f9e-4b54-8f85-3472d6e95814" (UID: "8acc5228-7f9e-4b54-8f85-3472d6e95814"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:14.948577 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.948468    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-model-cache" (OuterVolumeSpecName: "model-cache") pod "8acc5228-7f9e-4b54-8f85-3472d6e95814" (UID: "8acc5228-7f9e-4b54-8f85-3472d6e95814"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:14.948577 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.948481    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8acc5228-7f9e-4b54-8f85-3472d6e95814" (UID: "8acc5228-7f9e-4b54-8f85-3472d6e95814"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:14.950425 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.950400    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-dshm" (OuterVolumeSpecName: "dshm") pod "8acc5228-7f9e-4b54-8f85-3472d6e95814" (UID: "8acc5228-7f9e-4b54-8f85-3472d6e95814"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:14.950543 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.950506    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8acc5228-7f9e-4b54-8f85-3472d6e95814-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8acc5228-7f9e-4b54-8f85-3472d6e95814" (UID: "8acc5228-7f9e-4b54-8f85-3472d6e95814"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:46:14.950584 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:14.950550    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8acc5228-7f9e-4b54-8f85-3472d6e95814-kube-api-access-z2vmt" (OuterVolumeSpecName: "kube-api-access-z2vmt") pod "8acc5228-7f9e-4b54-8f85-3472d6e95814" (UID: "8acc5228-7f9e-4b54-8f85-3472d6e95814"). InnerVolumeSpecName "kube-api-access-z2vmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:46:15.049312 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.049279    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:15.049312 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.049306    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:15.049312 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.049314    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:15.049312 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.049322    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8acc5228-7f9e-4b54-8f85-3472d6e95814-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:15.049575 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.049331    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8acc5228-7f9e-4b54-8f85-3472d6e95814-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:15.049575 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.049339    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2vmt\" (UniqueName: \"kubernetes.io/projected/8acc5228-7f9e-4b54-8f85-3472d6e95814-kube-api-access-z2vmt\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:15.066645 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.066604    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dc09597-c203-40ab-8f65-f29a5bc53240" path="/var/lib/kubelet/pods/7dc09597-c203-40ab-8f65-f29a5bc53240/volumes"
Jul 06 20:46:15.323161 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.323119    2582 generic.go:356] "Generic (PLEG): container finished" podID="8acc5228-7f9e-4b54-8f85-3472d6e95814" containerID="111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a" exitCode=0
Jul 06 20:46:15.323342 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.323163    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"
Jul 06 20:46:15.323342 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.323184    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2" event={"ID":"8acc5228-7f9e-4b54-8f85-3472d6e95814","Type":"ContainerDied","Data":"111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a"}
Jul 06 20:46:15.323342 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.323240    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2" event={"ID":"8acc5228-7f9e-4b54-8f85-3472d6e95814","Type":"ContainerDied","Data":"0f55e12d038325f57f8076c78ca8e1bd839afb38b6cd3e263502f008437c3a65"}
Jul 06 20:46:15.323342 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.323260    2582 scope.go:117] "RemoveContainer" containerID="111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a"
Jul 06 20:46:15.331734 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.331716    2582 scope.go:117] "RemoveContainer" containerID="111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a"
Jul 06 20:46:15.331988 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:46:15.331966    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a\": container with ID starting with 111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a not found: ID does not exist" containerID="111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a"
Jul 06 20:46:15.332059 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.331999    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a"} err="failed to get container status \"111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a\": rpc error: code = NotFound desc = could not find container \"111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a\": container with ID starting with 111752c470f5aa01f864637b719fc4978e10209b141fdb10e9c9f51a103d979a not found: ID does not exist"
Jul 06 20:46:15.341373 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.341349    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"]
Jul 06 20:46:15.346540 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:15.346518    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-67755c/rate-test-model-67755c-kserve-7f956bcc99-rhhl2"]
Jul 06 20:46:17.066606 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:17.066562    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8acc5228-7f9e-4b54-8f85-3472d6e95814" path="/var/lib/kubelet/pods/8acc5228-7f9e-4b54-8f85-3472d6e95814/volumes"
Jul 06 20:46:51.837711 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:51.837668    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"]
Jul 06 20:46:51.838262 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:51.837947    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" podUID="c039720e-4480-42d6-b0c4-535e74d4e58a" containerName="istio-proxy" containerID="cri-o://00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037" gracePeriod=30
Jul 06 20:46:57.085860 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.085834    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:46:57.135462 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135382    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-certs\") pod \"c039720e-4480-42d6-b0c4-535e74d4e58a\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") "
Jul 06 20:46:57.135462 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135446    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-data\") pod \"c039720e-4480-42d6-b0c4-535e74d4e58a\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") "
Jul 06 20:46:57.135654 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135480    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-podinfo\") pod \"c039720e-4480-42d6-b0c4-535e74d4e58a\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") "
Jul 06 20:46:57.135654 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135513    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szwrf\" (UniqueName: \"kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-kube-api-access-szwrf\") pod \"c039720e-4480-42d6-b0c4-535e74d4e58a\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") "
Jul 06 20:46:57.135654 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135546    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-socket\") pod \"c039720e-4480-42d6-b0c4-535e74d4e58a\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") "
Jul 06 20:46:57.135654 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135578    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-envoy\") pod \"c039720e-4480-42d6-b0c4-535e74d4e58a\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") "
Jul 06 20:46:57.135654 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135640    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c039720e-4480-42d6-b0c4-535e74d4e58a-istiod-ca-cert\") pod \"c039720e-4480-42d6-b0c4-535e74d4e58a\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") "
Jul 06 20:46:57.135879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135676    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-token\") pod \"c039720e-4480-42d6-b0c4-535e74d4e58a\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") "
Jul 06 20:46:57.135879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135704    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-credential-socket\") pod \"c039720e-4480-42d6-b0c4-535e74d4e58a\" (UID: \"c039720e-4480-42d6-b0c4-535e74d4e58a\") "
Jul 06 20:46:57.135879 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135734    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c039720e-4480-42d6-b0c4-535e74d4e58a" (UID: "c039720e-4480-42d6-b0c4-535e74d4e58a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:57.136040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135935    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c039720e-4480-42d6-b0c4-535e74d4e58a" (UID: "c039720e-4480-42d6-b0c4-535e74d4e58a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:57.136040 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.135984    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c039720e-4480-42d6-b0c4-535e74d4e58a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c039720e-4480-42d6-b0c4-535e74d4e58a" (UID: "c039720e-4480-42d6-b0c4-535e74d4e58a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:46:57.136151 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.136066    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:57.136236 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.136159    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-workload-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:57.136236 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.136170    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c039720e-4480-42d6-b0c4-535e74d4e58a-istiod-ca-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:57.136236 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.136137    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c039720e-4480-42d6-b0c4-535e74d4e58a" (UID: "c039720e-4480-42d6-b0c4-535e74d4e58a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:57.136505 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.136483    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-data" (OuterVolumeSpecName: "istio-data") pod "c039720e-4480-42d6-b0c4-535e74d4e58a" (UID: "c039720e-4480-42d6-b0c4-535e74d4e58a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:57.137837 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.137816    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-token" (OuterVolumeSpecName: "istio-token") pod "c039720e-4480-42d6-b0c4-535e74d4e58a" (UID: "c039720e-4480-42d6-b0c4-535e74d4e58a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:46:57.138161 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.138124    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c039720e-4480-42d6-b0c4-535e74d4e58a" (UID: "c039720e-4480-42d6-b0c4-535e74d4e58a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:46:57.138283 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.138179    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c039720e-4480-42d6-b0c4-535e74d4e58a" (UID: "c039720e-4480-42d6-b0c4-535e74d4e58a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:46:57.138283 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.138194    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-kube-api-access-szwrf" (OuterVolumeSpecName: "kube-api-access-szwrf") pod "c039720e-4480-42d6-b0c4-535e74d4e58a" (UID: "c039720e-4480-42d6-b0c4-535e74d4e58a"). InnerVolumeSpecName "kube-api-access-szwrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:46:57.236775 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.236740    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-envoy\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:57.236775 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.236768    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:57.236775 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.236777    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-credential-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:57.237010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.236785    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-data\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:57.237010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.236794    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c039720e-4480-42d6-b0c4-535e74d4e58a-istio-podinfo\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:57.237010 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.236802    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szwrf\" (UniqueName: \"kubernetes.io/projected/c039720e-4480-42d6-b0c4-535e74d4e58a-kube-api-access-szwrf\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 06 20:46:57.525009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.524924    2582 generic.go:356] "Generic (PLEG): container finished" podID="c039720e-4480-42d6-b0c4-535e74d4e58a" containerID="00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037" exitCode=0
Jul 06 20:46:57.525009 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.524969    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"
Jul 06 20:46:57.525184 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.525000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" event={"ID":"c039720e-4480-42d6-b0c4-535e74d4e58a","Type":"ContainerDied","Data":"00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037"}
Jul 06 20:46:57.525184 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.525052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8" event={"ID":"c039720e-4480-42d6-b0c4-535e74d4e58a","Type":"ContainerDied","Data":"0989012b8913c86eb7925312d4ba62fc07212d65405db4bef65f80a6070260e1"}
Jul 06 20:46:57.525184 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.525074    2582 scope.go:117] "RemoveContainer" containerID="00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037"
Jul 06 20:46:57.534448 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.534430    2582 scope.go:117] "RemoveContainer" containerID="37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3"
Jul 06 20:46:57.542296 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.542277    2582 scope.go:117] "RemoveContainer" containerID="00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037"
Jul 06 20:46:57.542571 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:46:57.542550    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037\": container with ID starting with 00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037 not found: ID does not exist" containerID="00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037"
Jul 06 20:46:57.542616 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.542581    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037"} err="failed to get container status \"00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037\": rpc error: code = NotFound desc = could not find container \"00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037\": container with ID starting with 00c5725cab0396b3819e6402183f994687eda31ffbf5cad7a1b3b92453d7d037 not found: ID does not exist"
Jul 06 20:46:57.542616 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.542599    2582 scope.go:117] "RemoveContainer" containerID="37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3"
Jul 06 20:46:57.542818 ip-10-0-136-9 kubenswrapper[2582]: E0706 20:46:57.542801    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3\": container with ID starting with 37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3 not found: ID does not exist" containerID="37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3"
Jul 06 20:46:57.542860 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.542826    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3"} err="failed to get container status \"37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3\": rpc error: code = NotFound desc = could not find container \"37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3\": container with ID starting with 37f69641ce2b701f627015db40373811d698dcfb5ce59cc49662904d03acefb3 not found: ID does not exist"
Jul 06 20:46:57.549569 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.549543    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"]
Jul 06 20:46:57.556359 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.556338    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-67755c-openshift-default-768f576795-qfbv8"]
Jul 06 20:46:57.585557 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.585537    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-d5rlp_aa8fd394-85bd-4da5-9ecd-3f5eca652e23/server/0.log"
Jul 06 20:46:57.946141 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.946110    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68cbf59454-jkmmc_e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac/copy-manifests/0.log"
Jul 06 20:46:57.953623 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:57.953600    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68cbf59454-jkmmc_e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac/manager/0.log"
Jul 06 20:46:59.066098 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:46:59.066064    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c039720e-4480-42d6-b0c4-535e74d4e58a" path="/var/lib/kubelet/pods/c039720e-4480-42d6-b0c4-535e74d4e58a/volumes"
Jul 06 20:47:00.555975 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:00.555946    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d2tzj_407169ca-ddb6-433a-a0d5-96c26841cd15/istio-proxy/0.log"
Jul 06 20:47:00.795000 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:00.794970    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64f5c756bf-gpflb_bc6c43c8-9a10-4fdd-a499-1aa7c972ee90/kube-auth-proxy/0.log"
Jul 06 20:47:01.867885 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:01.867855    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-wmvhc_eafb4a8b-18cf-47e2-beb0-691cc370e3a3/main/0.log"
Jul 06 20:47:01.986864 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:01.986834    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-pj97q_8c569158-7e01-48ce-8437-66ef33a1634f/main/0.log"
Jul 06 20:47:02.226339 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:02.226262    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hp57m_6110c2a2-3f3b-4bc4-b7ed-222395b81a8f/main/0.log"
Jul 06 20:47:02.340783 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:02.340753    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-9tlt6_eaabc46c-9d10-4c33-a2ed-8fd857a958af/main/0.log"
Jul 06 20:47:10.007887 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:10.007854    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wsxpw_d7078019-dd34-434c-81b1-bf5685ff76ed/global-pull-secret-syncer/0.log"
Jul 06 20:47:10.099822 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:10.099789    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mhlr9_75740867-2cfc-477f-864f-ef0357a87bfc/konnectivity-agent/0.log"
Jul 06 20:47:10.208848 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:10.208820    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-9.ec2.internal_a1ef2ca68729a3e6662bb61abe38ed8a/haproxy/0.log"
Jul 06 20:47:17.837739 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:17.837693    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f9fb8d564-9g2cr_c0836167-2735-442c-962f-990d42f262c5/metrics-server/0.log"
Jul 06 20:47:18.080733 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.080701    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vs29m_0dbe89b2-1ec2-486e-bfe6-488bd818dfe4/node-exporter/0.log"
Jul 06 20:47:18.111650 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.111578    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vs29m_0dbe89b2-1ec2-486e-bfe6-488bd818dfe4/kube-rbac-proxy/0.log"
Jul 06 20:47:18.139787 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.139759    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vs29m_0dbe89b2-1ec2-486e-bfe6-488bd818dfe4/init-textfile/0.log"
Jul 06 20:47:18.444449 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.444368    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-kffwh_4defa085-b69e-40cb-9d1c-b4316ee823af/prometheus-operator/0.log"
Jul 06 20:47:18.466854 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.466830    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-kffwh_4defa085-b69e-40cb-9d1c-b4316ee823af/kube-rbac-proxy/0.log"
Jul 06 20:47:18.495954 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.495925    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-5w7f8_c06c3b05-aa9c-48dd-b92b-aa82aae306dd/prometheus-operator-admission-webhook/0.log"
Jul 06 20:47:18.525085 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.525061    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dffdd7bcc-b4jrh_3f3c299b-6bd5-4851-b298-32571600be12/telemeter-client/0.log"
Jul 06 20:47:18.550635 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.550612    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dffdd7bcc-b4jrh_3f3c299b-6bd5-4851-b298-32571600be12/reload/0.log"
Jul 06 20:47:18.574798 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.574770    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dffdd7bcc-b4jrh_3f3c299b-6bd5-4851-b298-32571600be12/kube-rbac-proxy/0.log"
Jul 06 20:47:18.608984 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.608958    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d74fc4fb-5zsld_d932eb97-316a-4fe3-8aad-c5ec74eef369/thanos-query/0.log"
Jul 06 20:47:18.632134 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.632113    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d74fc4fb-5zsld_d932eb97-316a-4fe3-8aad-c5ec74eef369/kube-rbac-proxy-web/0.log"
Jul 06 20:47:18.657773 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.657752    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d74fc4fb-5zsld_d932eb97-316a-4fe3-8aad-c5ec74eef369/kube-rbac-proxy/0.log"
Jul 06 20:47:18.680291 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.680264    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d74fc4fb-5zsld_d932eb97-316a-4fe3-8aad-c5ec74eef369/prom-label-proxy/0.log"
Jul 06 20:47:18.703688 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.703630    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d74fc4fb-5zsld_d932eb97-316a-4fe3-8aad-c5ec74eef369/kube-rbac-proxy-rules/0.log"
Jul 06 20:47:18.727770 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:18.727749    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54d74fc4fb-5zsld_d932eb97-316a-4fe3-8aad-c5ec74eef369/kube-rbac-proxy-metrics/0.log"
Jul 06 20:47:19.702172 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.702133    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"]
Jul 06 20:47:19.702570 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.702510    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dc09597-c203-40ab-8f65-f29a5bc53240" containerName="main"
Jul 06 20:47:19.702570 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.702525    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dc09597-c203-40ab-8f65-f29a5bc53240" containerName="main"
Jul 06 20:47:19.702570 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.702543    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c039720e-4480-42d6-b0c4-535e74d4e58a" containerName="istio-proxy"
Jul 06 20:47:19.702570 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.702550    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c039720e-4480-42d6-b0c4-535e74d4e58a" containerName="istio-proxy"
Jul 06 20:47:19.702570 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.702571    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8acc5228-7f9e-4b54-8f85-3472d6e95814" containerName="main"
Jul 06 20:47:19.702826 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.702577    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8acc5228-7f9e-4b54-8f85-3472d6e95814" containerName="main"
Jul 06 20:47:19.702826 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.702647    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c039720e-4480-42d6-b0c4-535e74d4e58a" containerName="istio-proxy"
Jul 06 20:47:19.702826 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.702659    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c039720e-4480-42d6-b0c4-535e74d4e58a" containerName="istio-proxy"
Jul 06 20:47:19.702826 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.702669    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dc09597-c203-40ab-8f65-f29a5bc53240" containerName="main"
Jul 06 20:47:19.702826 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.702680    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8acc5228-7f9e-4b54-8f85-3472d6e95814" containerName="main"
Jul 06 20:47:19.707156 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.707129    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.709569 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.709545    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rsttk\"/\"kube-root-ca.crt\""
Jul 06 20:47:19.709664 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.709611    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rsttk\"/\"default-dockercfg-tvshg\""
Jul 06 20:47:19.709664 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.709649    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rsttk\"/\"openshift-service-ca.crt\""
Jul 06 20:47:19.712856 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.712832    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"]
Jul 06 20:47:19.840558 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.840523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-sys\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.840824 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.840588    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9tmr\" (UniqueName: \"kubernetes.io/projected/ef00cd21-67c1-40d3-b14a-de2a387545e4-kube-api-access-n9tmr\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.840824 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.840640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-lib-modules\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.840824 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.840662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-podres\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.840824 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.840716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-proc\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.941575 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.941535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-lib-modules\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.941575 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.941577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-podres\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.941806 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.941604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-proc\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.941806 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.941627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-sys\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.941806 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.941678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9tmr\" (UniqueName: \"kubernetes.io/projected/ef00cd21-67c1-40d3-b14a-de2a387545e4-kube-api-access-n9tmr\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.941806 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.941734    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-podres\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.941806 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.941757    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-sys\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.941806 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.941738    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-lib-modules\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.941806 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.941736    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef00cd21-67c1-40d3-b14a-de2a387545e4-proc\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:19.951699 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:19.951677    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9tmr\" (UniqueName: \"kubernetes.io/projected/ef00cd21-67c1-40d3-b14a-de2a387545e4-kube-api-access-n9tmr\") pod \"perf-node-gather-daemonset-hpr68\" (UID: \"ef00cd21-67c1-40d3-b14a-de2a387545e4\") " pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:20.018499 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:20.018420    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:20.156458 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:20.156289    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"]
Jul 06 20:47:20.159161 ip-10-0-136-9 kubenswrapper[2582]: W0706 20:47:20.159118    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podef00cd21_67c1_40d3_b14a_de2a387545e4.slice/crio-775666ce49b1f4769be6ab277be93b8c927de097731c03872811baf03533e668 WatchSource:0}: Error finding container 775666ce49b1f4769be6ab277be93b8c927de097731c03872811baf03533e668: Status 404 returned error can't find the container with id 775666ce49b1f4769be6ab277be93b8c927de097731c03872811baf03533e668
Jul 06 20:47:20.638441 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:20.638403    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68" event={"ID":"ef00cd21-67c1-40d3-b14a-de2a387545e4","Type":"ContainerStarted","Data":"04758ab7edf5963df66bbbc83831f62d97d3b7e99c1ee401c5a4d9facecfeb57"}
Jul 06 20:47:20.638626 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:20.638460    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68" event={"ID":"ef00cd21-67c1-40d3-b14a-de2a387545e4","Type":"ContainerStarted","Data":"775666ce49b1f4769be6ab277be93b8c927de097731c03872811baf03533e668"}
Jul 06 20:47:20.638626 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:20.638499    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:20.658023 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:20.657973    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68" podStartSLOduration=1.657957286 podStartE2EDuration="1.657957286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:47:20.655356576 +0000 UTC m=+2490.196767570" watchObservedRunningTime="2026-07-06 20:47:20.657957286 +0000 UTC m=+2490.199368277"
Jul 06 20:47:21.108135 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:21.108104    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-5zv49_b5063a29-75aa-4ba2-8891-3dcc53464f94/download-server/0.log"
Jul 06 20:47:22.908334 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:22.908302    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tlx2b_88451c27-2e6a-42ab-9adc-94bb930464bc/dns/0.log"
Jul 06 20:47:22.931796 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:22.931755    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tlx2b_88451c27-2e6a-42ab-9adc-94bb930464bc/kube-rbac-proxy/0.log"
Jul 06 20:47:22.955632 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:22.955610    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6l7s4_17d4f092-7b09-45ef-8131-fb1024022a7c/dns-node-resolver/0.log"
Jul 06 20:47:23.576020 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:23.575986    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-988f549c8-frzk4_f81738e4-4dc5-4744-8133-e6bcee225405/registry/0.log"
Jul 06 20:47:23.599067 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:23.599040    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxbv8_27f9059b-2e69-457b-9fbf-17b8bb36e010/node-ca/0.log"
Jul 06 20:47:24.628956 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:24.628925    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d2tzj_407169ca-ddb6-433a-a0d5-96c26841cd15/istio-proxy/0.log"
Jul 06 20:47:24.761524 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:24.761495    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64f5c756bf-gpflb_bc6c43c8-9a10-4fdd-a499-1aa7c972ee90/kube-auth-proxy/0.log"
Jul 06 20:47:25.703745 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:25.703711    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6wgkd_2aff33fa-c131-4aae-8bf8-3529eaf09bb5/serve-healthcheck-canary/0.log"
Jul 06 20:47:26.259434 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:26.259377    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9m7jk_9a1305d4-4c41-4579-8428-9ef08176ba4b/kube-rbac-proxy/0.log"
Jul 06 20:47:26.283305 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:26.283275    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9m7jk_9a1305d4-4c41-4579-8428-9ef08176ba4b/exporter/0.log"
Jul 06 20:47:26.306290 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:26.306264    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9m7jk_9a1305d4-4c41-4579-8428-9ef08176ba4b/extractor/0.log"
Jul 06 20:47:26.653518 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:26.653491    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rsttk/perf-node-gather-daemonset-hpr68"
Jul 06 20:47:29.128101 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:29.128069    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-d5rlp_aa8fd394-85bd-4da5-9ecd-3f5eca652e23/server/0.log"
Jul 06 20:47:29.321623 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:29.321579    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68cbf59454-jkmmc_e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac/manager/0.log"
Jul 06 20:47:29.348475 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:29.348452    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68cbf59454-jkmmc_e302b8bd-2c7c-4fc1-9dbd-cd35879d2eac/copy-manifests/0.log"
Jul 06 20:47:29.992544 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:29.992461    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d2tzj_407169ca-ddb6-433a-a0d5-96c26841cd15/istio-proxy/0.log"
Jul 06 20:47:30.114573 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:30.114544    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64f5c756bf-gpflb_bc6c43c8-9a10-4fdd-a499-1aa7c972ee90/kube-auth-proxy/0.log"
Jul 06 20:47:30.773454 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:30.773420    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79c95fdbc9-zblsd_137cc1f2-eab1-4a42-bc4f-1343254d408b/manager/0.log"
Jul 06 20:47:31.607973 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:31.607947    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d2tzj_407169ca-ddb6-433a-a0d5-96c26841cd15/istio-proxy/0.log"
Jul 06 20:47:31.736588 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:31.736556    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64f5c756bf-gpflb_bc6c43c8-9a10-4fdd-a499-1aa7c972ee90/kube-auth-proxy/0.log"
Jul 06 20:47:35.812185 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:35.812105    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-zxcjl_99eb4935-0f34-4567-821c-fbf0d442957c/migrator/0.log"
Jul 06 20:47:35.834872 ip-10-0-136-9 kubenswrapper[2582]: I0706 20:47:35.834849    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-zxcjl_99eb4935-0f34-4567-821c-fbf0d442957c/graceful-termination/0.log"