Jul 15 04:06:11.445348 ip-10-0-136-55 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 04:06:11.864642 ip-10-0-136-55 kubenswrapper[2539]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 04:06:11.864642 ip-10-0-136-55 kubenswrapper[2539]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 04:06:11.864642 ip-10-0-136-55 kubenswrapper[2539]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 04:06:11.864642 ip-10-0-136-55 kubenswrapper[2539]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 04:06:11.864642 ip-10-0-136-55 kubenswrapper[2539]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 04:06:11.867067 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.866987    2539 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 04:06:11.871459 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871445    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871461    2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871466    2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871469    2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871473    2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871476    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871479    2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871481    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871484    2539 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871492    2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871495    2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871498    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871501    2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 04:06:11.871498 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871503    2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871506    2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871509    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871511    2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871514    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871517    2539 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871519    2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871521    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871524    2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871526    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871529    2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871531    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871534    2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871536    2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871538    2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871541    2539 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871543    2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871546    2539 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871548    2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871551    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 04:06:11.871798 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871553    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871556    2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871558    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871561    2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871563    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871566    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871568    2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871571    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871574    2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871578    2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871582    2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871585    2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871587    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871590    2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871592    2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871595    2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871598    2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871600    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871603    2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871605    2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 04:06:11.872325 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871608    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871610    2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871613    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871615    2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871618    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871620    2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871623    2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871626    2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871628    2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871630    2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871633    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871635    2539 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871637    2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871640    2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871642    2539 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871645    2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871647    2539 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871649    2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871655    2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871658    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 04:06:11.872808 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871661    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871664    2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871666    2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871669    2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871671    2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871674    2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871677    2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871680    2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871683    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871685    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871688    2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871690    2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871693    2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871695    2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871698    2539 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871700    2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871703    2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871705    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871708    2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871711    2539 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 04:06:11.873295 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871713    2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871716    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871718    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871721    2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871723    2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.871725    2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872415    2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872421    2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872424    2539 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872427    2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872430    2539 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872433    2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872436    2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872440    2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872442    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872445    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872447    2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872450    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872453    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872455    2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 04:06:11.873787 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872458    2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872461    2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872463    2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872466    2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872468    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872471    2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872473    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872476    2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872478    2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872481    2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872483    2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872485    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872488    2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872490    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872495    2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872498    2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872501    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872504    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872507    2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 04:06:11.874322 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872510    2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872513    2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872516    2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872518    2539 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872521    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872524    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872526    2539 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872529    2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872532    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872534    2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872536    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872539    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872542    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872546    2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872549    2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872552    2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872555    2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872558    2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872561    2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872563    2539 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 04:06:11.874779 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872566    2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872569    2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872571    2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872574    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872576    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872578    2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872581    2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872583    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872586    2539 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872589    2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872591    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872594    2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872597    2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872599    2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872601    2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872604    2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872606    2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872609    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872612    2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872614    2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 04:06:11.875287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872617    2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872619    2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872623    2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872625    2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872628    2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872630    2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872633    2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872635    2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872638    2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872640    2539 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872643    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872645    2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872647    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872650    2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872652    2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872655    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872657    2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872659    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872662    2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872664    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 04:06:11.875759 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872667    2539 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872670    2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872673    2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872676    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872679    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.872681    2539 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873107    2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873113    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873116    2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873119    2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873123    2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873126    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873130    2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873134    2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873137    2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873140    2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873143    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873146    2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873149    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 04:06:11.876258 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873152    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873154    2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873157    2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873160    2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873162    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873165    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873167    2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873170    2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873173    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873175    2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873178    2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873180    2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873183    2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873186    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873189    2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873192    2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873194    2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873197    2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873199    2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873202    2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 04:06:11.876711 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873204    2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873206    2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873209    2539 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873211    2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873214    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873217    2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873220    2539 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873222    2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873225    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873227    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873230    2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873233    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873237    2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873240    2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873243    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873245    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873248    2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873250    2539 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873252    2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873255    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 04:06:11.877193 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873258    2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873260    2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873263    2539 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873265    2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873270    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873273    2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873275    2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873278    2539 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873281    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873283    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873287    2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873290    2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873293    2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873295    2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873298    2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873301    2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873303    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873306    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873309    2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 04:06:11.877678 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873311    2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873314    2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873316    2539 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873319    2539 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873321    2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873324    2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873326    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873329    2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873331    2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873334    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873336    2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873338    2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873341    2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873344    2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873347    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873349    2539 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873352    2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873356    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873359    2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873361    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 04:06:11.878145 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873364    2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873366    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873369    2539 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873371    2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873373    2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873376    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.873378    2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873440    2539 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873452    2539 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873458    2539 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873463    2539 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873467    2539 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873470    2539 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873474    2539 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873478    2539 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873481    2539 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873484    2539 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873487    2539 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873490    2539 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873496    2539 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873498    2539 flags.go:64] FLAG: --cgroup-root=""
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873501    2539 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873504    2539 flags.go:64] FLAG: --client-ca-file=""
Jul 15 04:06:11.878622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873507    2539 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873511    2539 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873515    2539 flags.go:64] FLAG: --cluster-domain=""
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873518    2539 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873521    2539 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873524    2539 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873530    2539 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873533    2539 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873536    2539 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873539    2539 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873543    2539 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873545    2539 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873548    2539 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873551    2539 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873554    2539 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873557    2539 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873561    2539 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873563    2539 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873566    2539 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873569    2539 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873582    2539 flags.go:64] FLAG: --enable-server="true"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873586    2539 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873590    2539 flags.go:64] FLAG: --event-burst="100"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873593    2539 flags.go:64] FLAG: --event-qps="50"
Jul 15 04:06:11.879275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873595    2539 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873598    2539 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873601    2539 flags.go:64] FLAG: --eviction-hard=""
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873605    2539 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873608    2539 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873611    2539 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873613    2539 flags.go:64] FLAG: --eviction-soft=""
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873616    2539 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873619    2539 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873623    2539 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873626    2539 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873629    2539 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873632    2539 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873634    2539 flags.go:64] FLAG: --feature-gates=""
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873639    2539 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873642    2539 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873645    2539 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873648    2539 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873651    2539 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873654    2539 flags.go:64] FLAG: --help="false"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873657    2539 flags.go:64] FLAG: --hostname-override="ip-10-0-136-55.ec2.internal"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873660    2539 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873663    2539 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 04:06:11.879917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873666    2539 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873669    2539 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873672    2539 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873675    2539 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873678    2539 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873680    2539 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873683    2539 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873686    2539 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873689    2539 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873692    2539 flags.go:64] FLAG: --kube-reserved=""
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873695    2539 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873698    2539 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873701    2539 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873703    2539 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873706    2539 flags.go:64] FLAG: --lock-file=""
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873708    2539 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873711    2539 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873714    2539 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873720    2539 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873723    2539 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873725    2539 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873728    2539 flags.go:64] FLAG: --logging-format="text"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873731    2539 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873735    2539 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 04:06:11.880519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873738    2539 flags.go:64] FLAG: --manifest-url=""
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873741    2539 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873745    2539 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873748    2539 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873751    2539 flags.go:64] FLAG: --max-pods="110"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873754    2539 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873757    2539 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873760    2539 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873763    2539 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873766    2539 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873768    2539 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873771    2539 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873777    2539 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873780    2539 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873783    2539 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873786    2539 flags.go:64] FLAG: --pod-cidr=""
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873789    2539 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873794    2539 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873796    2539 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873800    2539 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873803    2539 flags.go:64] FLAG: --port="10250"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873808    2539 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873812    2539 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0312c3bf63916514f"
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873817    2539 flags.go:64] FLAG: --qos-reserved=""
Jul 15 04:06:11.881103 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873820    2539 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873823    2539 flags.go:64] FLAG: --register-node="true"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873826    2539 flags.go:64] FLAG: --register-with-taints=""
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873830    2539 flags.go:64] FLAG: --registry-burst="10"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873833    2539 flags.go:64] FLAG: --registry-qps="5"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873835    2539 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873838    2539 flags.go:64] FLAG: --reserved-memory=""
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873841    2539 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873846    2539 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873849    2539 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873852    2539 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873855    2539 flags.go:64] FLAG: --runonce="false"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873857    2539 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873860    2539 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873863    2539 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873866    2539 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873868    2539 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873871    2539 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873874    2539 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873877    2539 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873880    2539 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873883    2539 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873886    2539 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873888    2539 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873891    2539 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 04:06:11.881673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873894    2539 flags.go:64] FLAG: --system-cgroups=""
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873897    2539 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873902    2539 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873904    2539 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873907    2539 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873911    2539 flags.go:64] FLAG: --tls-min-version=""
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873913    2539 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873916    2539 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873919    2539 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873922    2539 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873925    2539 flags.go:64] FLAG: --v="2"
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873928    2539 flags.go:64] FLAG: --version="false"
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873932    2539 flags.go:64] FLAG: --vmodule=""
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873935    2539 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.873938    2539 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874069    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874074    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874077    2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874080    2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874083    2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874100    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874103    2539 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874106    2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 04:06:11.882338 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874109    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874112    2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874114    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874117    2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874121    2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874124    2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874128    2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874131    2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874134    2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874137    2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874140    2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874143    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874145    2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874148    2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874150    2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874153    2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874155    2539 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874158    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874162    2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 04:06:11.882886 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874164    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874166    2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874169    2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874171    2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874174    2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874177    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874180    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874182    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874185    2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874187    2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874190    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874192    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874195    2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874197    2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874200    2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874202    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874204    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874208    2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874212    2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 04:06:11.883396 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874215    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874217    2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874219    2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874222    2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874224    2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874228    2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874230    2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874232    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874235    2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874237    2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874240    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874243    2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874248    2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874250    2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874252    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874255    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874257    2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874259    2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874263    2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874266    2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 04:06:11.883842 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874268    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874271    2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874273    2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874275    2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874278    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874280    2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874283    2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874285    2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874288    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874290    2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874292    2539 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874295    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874297    2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874300    2539 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874304    2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874307    2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874311    2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874313    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874317    2539 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874319    2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 04:06:11.884582 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874322    2539 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874325    2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874327    2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874330    2539 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874335    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874337    2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874340    2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874342    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874345    2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874348    2539 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874351    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874354    2539 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.874356    2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.874364    2539 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.881011    2539 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 04:06:11.885316 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.881026    2539 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.881042    2539 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.881048    2539 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881121    2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881126    2539 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881130    2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881133    2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881137    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881139    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881142    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881145    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881148    2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881151    2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881153    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881156    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881158    2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881161    2539 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881163    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881166    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881168    2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 04:06:11.885697 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881171    2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881173    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881176    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881178    2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881181    2539 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881184    2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881187    2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881191    2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881194    2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881197    2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881200    2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881202    2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881205    2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881209    2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881213    2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881216    2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881218    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881221    2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881224    2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 04:06:11.886248 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881226    2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881229    2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881232    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881234    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881238    2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881241    2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881244    2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881247    2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881251    2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881254    2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881257    2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881260    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881262    2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881265    2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881267    2539 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881270    2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881272    2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881275    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881278    2539 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881280    2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 04:06:11.886829 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881283    2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881286    2539 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881288    2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881290    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881293    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881296    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881299    2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881302    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881305    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881307    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881310    2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881312    2539 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881315    2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881318    2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881321    2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881323    2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881325    2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881328    2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881331    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881333    2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 04:06:11.887349 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881335    2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881338    2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881340    2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881343    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881345    2539 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881347    2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881350    2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881352    2539 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881355    2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881358    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881360    2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881363    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881365    2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881368    2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881370    2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881373    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881375    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881378    2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881381    2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881384    2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 04:06:11.887905 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881386    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881389    2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881391    2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.881396    2539 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881501    2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881506    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881509    2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881512    2539 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881514    2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881517    2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881519    2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881522    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881524    2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881527    2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881529    2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 04:06:11.888432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881531    2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881534    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881537    2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881539    2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881542    2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881544    2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881547    2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881550    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881552    2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881554    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881557    2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881559    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881562    2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881564    2539 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881567    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881569    2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881571    2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881574    2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881577    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881579    2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 04:06:11.889029 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881581    2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881584    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881586    2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881588    2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881591    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881593    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881595    2539 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881598    2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881600    2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881603    2539 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881605    2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881607    2539 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881610    2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881612    2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881615    2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881617    2539 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881620    2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881622    2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881625    2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881627    2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 04:06:11.889699 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881630    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881632    2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881635    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881637    2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881639    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881642    2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881645    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881647    2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881650    2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881652    2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881655    2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881657    2539 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881660    2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881662    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881664    2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881667    2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881669    2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881672    2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881674    2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 04:06:11.890261 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881677    2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881679    2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881682    2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881684    2539 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881687    2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881691    2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881694    2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881697    2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881699    2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881701    2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881704    2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881706    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881709    2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881711    2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881714    2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881716    2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881718    2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881721    2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881724    2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 04:06:11.890922 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881726    2539 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881728    2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881731    2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881733    2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881735    2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881738    2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881742    2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881746    2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881749    2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:11.881752    2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.881757    2539 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.881848    2539 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.883803    2539 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 04:06:11.891486 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.886291    2539 server.go:1019] "Starting client certificate rotation"
Jul 15 04:06:11.891804 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.886413    2539 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 04:06:11.891804 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.886472    2539 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 04:06:11.891804 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.889069    2539 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 04:06:11.891804 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.890127    2539 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 04:06:11.897314 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.897297    2539 log.go:25] "Validated CRI v1 runtime API"
Jul 15 04:06:11.899348 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.899335    2539 log.go:25] "Validated CRI v1 image API"
Jul 15 04:06:11.900050 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.900034    2539 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 04:06:11.902571 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.902545    2539 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d2a50af6-e226-4bb8-afdc-9fdaa9e4af1e:/dev/nvme0n1p4 e6aa5c01-64dd-4c46-92d8-21f9aa0c084d:/dev/nvme0n1p3]
Jul 15 04:06:11.902571 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.902563    2539 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 04:06:11.908799 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.908688    2539 manager.go:216] Machine: {Timestamp:2026-07-15 04:06:11.907464676 +0000 UTC m=+0.344391563 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101929 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e556bfd570d7fa404f2327dd69ff2 SystemUUID:ec2e556b-fd57-0d7f-a404-f2327dd69ff2 BootID:b113d15f-d05f-463e-ad4a-26be07b9d217 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2b:81:69:ed:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2b:81:69:ed:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:27:64:53:de:5f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 04:06:11.908799 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.908796    2539 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 04:06:11.908908 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.908870    2539 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 04:06:11.910017 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.909991    2539 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 04:06:11.910179 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.910022    2539 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-55.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 04:06:11.911279 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.911269    2539 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 04:06:11.911316 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.911282    2539 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 04:06:11.911316 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.911289    2539 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 04:06:11.911963 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.911954    2539 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 04:06:11.912223 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.912208    2539 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 04:06:11.913152 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.913141    2539 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 04:06:11.917737 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.917725    2539 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 04:06:11.917874 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.917865    2539 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 04:06:11.917907 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.917896    2539 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 04:06:11.917934 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.917918    2539 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 04:06:11.917960 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.917944    2539 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 04:06:11.918011 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.918002    2539 kubelet.go:398] "Adding apiserver pod source"
Jul 15 04:06:11.918039 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.918017    2539 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 04:06:11.918411 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.918400    2539 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 04:06:11.918447 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.918423    2539 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 04:06:11.921929 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.920802    2539 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 04:06:11.923827 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.923811    2539 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 04:06:11.923888 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.923842    2539 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 04:06:11.924022 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924010    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 04:06:11.924061 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924033    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 04:06:11.924114 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924066    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 04:06:11.924114 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924073    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 04:06:11.924114 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924081    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 04:06:11.924114 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924103    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 04:06:11.924648 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924639    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 04:06:11.924683 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924649    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 04:06:11.924683 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924656    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 04:06:11.924683 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924661    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 04:06:11.924683 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924669    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 04:06:11.924683 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.924676    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 04:06:11.925318 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.925308    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 04:06:11.925355 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.925319    2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 04:06:11.927299 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:11.927272    2539 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 04:06:11.927383 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.927317    2539 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-55.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 04:06:11.927450 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:11.927406    2539 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 04:06:11.928513 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.928499    2539 server.go:1268] "Started kubelet"
Jul 15 04:06:11.928563 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.928540    2539 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 04:06:11.928630 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.928577    2539 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 04:06:11.928688 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.928651    2539 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 04:06:11.929422 ip-10-0-136-55 systemd[1]: Started Kubernetes Kubelet.
Jul 15 04:06:11.930002 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.929986    2539 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 04:06:11.930937 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.930924    2539 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 04:06:11.932658 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.932641    2539 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86glz"
Jul 15 04:06:11.934203 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:11.933257    2539 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-55.ec2.internal.18c25aebf8b39b83  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-55.ec2.internal,UID:ip-10-0-136-55.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-55.ec2.internal,},FirstTimestamp:2026-07-15 04:06:11.928472451 +0000 UTC m=+0.365399339,LastTimestamp:2026-07-15 04:06:11.928472451 +0000 UTC m=+0.365399339,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-55.ec2.internal,}"
Jul 15 04:06:11.934521 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:11.934504    2539 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 04:06:11.935170 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.935156    2539 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 04:06:11.935170 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.935163    2539 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 04:06:11.935309 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:11.935228    2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-55.ec2.internal\" not found"
Jul 15 04:06:11.935834 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.935690    2539 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 04:06:11.935834 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.935710    2539 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 04:06:11.935834 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.935691    2539 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 04:06:11.935834 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.935823    2539 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 04:06:11.935834 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.935831    2539 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 04:06:11.936398 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.936384    2539 factory.go:55] Registering systemd factory
Jul 15 04:06:11.936398 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.936399    2539 factory.go:223] Registration of the systemd container factory successfully
Jul 15 04:06:11.937475 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.937405    2539 factory.go:153] Registering CRI-O factory
Jul 15 04:06:11.937475 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.937423    2539 factory.go:223] Registration of the crio container factory successfully
Jul 15 04:06:11.937475 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.937469    2539 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 04:06:11.937665 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.937497    2539 factory.go:103] Registering Raw factory
Jul 15 04:06:11.937665 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.937512    2539 manager.go:1196] Started watching for new ooms in manager
Jul 15 04:06:11.937878 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.937865    2539 manager.go:349] Starting recovery of all containers
Jul 15 04:06:11.938405 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.938383    2539 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86glz"
Jul 15 04:06:11.945150 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:11.945113    2539 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 04:06:11.945241 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:11.945225    2539 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-55.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 04:06:11.948269 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.948252    2539 manager.go:354] Recovery completed
Jul 15 04:06:11.950246 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:11.950226    2539 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 15 04:06:11.953034 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.953021    2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 04:06:11.954895 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.954877    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 04:06:11.954959 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.954914    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 04:06:11.954959 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.954930    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientPID"
Jul 15 04:06:11.955493 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.955467    2539 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 04:06:11.955493 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.955494    2539 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 04:06:11.955637 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.955510    2539 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 04:06:11.955637 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.955468    2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 04:06:11.956206 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.956192    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 04:06:11.956287 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.956223    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 04:06:11.956287 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.956237    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientPID"
Jul 15 04:06:11.957445 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.957433    2539 policy_none.go:49] "None policy: Start"
Jul 15 04:06:11.957499 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.957448    2539 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 04:06:11.957499 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.957458    2539 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 04:06:11.959321 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.959310    2539 policy_none.go:47] "Start"
Jul 15 04:06:11.995328 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.995317    2539 manager.go:337] "Starting Device Plugin manager"
Jul 15 04:06:11.995385 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:11.995372    2539 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 04:06:11.995423 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.995388    2539 server.go:87] "Starting device plugin registration server"
Jul 15 04:06:11.995608 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.995595    2539 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 04:06:11.995667 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.995608    2539 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 04:06:11.995762 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.995694    2539 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 04:06:11.995804 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.995768    2539 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 04:06:11.995804 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:11.995777    2539 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 04:06:11.996228 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:11.996209    2539 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 04:06:11.996312 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:11.996251    2539 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-55.ec2.internal\" not found"
Jul 15 04:06:12.071892 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.071863    2539 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 04:06:12.073969 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.073197    2539 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 04:06:12.073969 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.073239    2539 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 04:06:12.073969 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.073263    2539 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 04:06:12.073969 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.073300    2539 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 04:06:12.075416 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.075398    2539 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 04:06:12.096137 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.096117    2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 04:06:12.097890 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.097874    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 04:06:12.097959 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.097901    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 04:06:12.097959 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.097912    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientPID"
Jul 15 04:06:12.097959 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.097932    2539 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.103845 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.103831    2539 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.103900 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.103850    2539 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-55.ec2.internal\": node \"ip-10-0-136-55.ec2.internal\" not found"
Jul 15 04:06:12.119662 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.119621    2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-55.ec2.internal\" not found"
Jul 15 04:06:12.174287 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.174268    2539 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-55.ec2.internal"]
Jul 15 04:06:12.174345 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.174332    2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 04:06:12.175047 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.175034    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 04:06:12.175122 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.175064    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 04:06:12.175122 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.175074    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientPID"
Jul 15 04:06:12.177343 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.177331    2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 04:06:12.177435 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.177420    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.177470 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.177446    2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 04:06:12.177989 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.177972    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 04:06:12.178062 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.178000    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 04:06:12.178062 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.178009    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientPID"
Jul 15 04:06:12.178062 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.178009    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 04:06:12.178062 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.178030    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 04:06:12.178223 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.178067    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientPID"
Jul 15 04:06:12.180223 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.180210    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.180272 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.180234    2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 04:06:12.180888 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.180873    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 04:06:12.180963 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.180900    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 04:06:12.180963 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.180910    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeHasSufficientPID"
Jul 15 04:06:12.205562 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.205543    2539 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-55.ec2.internal\" not found" node="ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.209614 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.209600    2539 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-55.ec2.internal\" not found" node="ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.219866 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.219852    2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-55.ec2.internal\" not found"
Jul 15 04:06:12.237211 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.237192    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fd6ceeaba410c80fffc34fb05c8ae3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal\" (UID: \"6fd6ceeaba410c80fffc34fb05c8ae3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.237273 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.237217    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fd6ceeaba410c80fffc34fb05c8ae3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal\" (UID: \"6fd6ceeaba410c80fffc34fb05c8ae3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.237273 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.237252    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb4fc7b7b597fd5dd2a5941924dbc289-config\") pod \"kube-apiserver-proxy-ip-10-0-136-55.ec2.internal\" (UID: \"eb4fc7b7b597fd5dd2a5941924dbc289\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.320786 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.320765    2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-55.ec2.internal\" not found"
Jul 15 04:06:12.338078 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.338059    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fd6ceeaba410c80fffc34fb05c8ae3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal\" (UID: \"6fd6ceeaba410c80fffc34fb05c8ae3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.338225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.338109    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fd6ceeaba410c80fffc34fb05c8ae3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal\" (UID: \"6fd6ceeaba410c80fffc34fb05c8ae3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.338225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.338139    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb4fc7b7b597fd5dd2a5941924dbc289-config\") pod \"kube-apiserver-proxy-ip-10-0-136-55.ec2.internal\" (UID: \"eb4fc7b7b597fd5dd2a5941924dbc289\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.338225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.338146    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6fd6ceeaba410c80fffc34fb05c8ae3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal\" (UID: \"6fd6ceeaba410c80fffc34fb05c8ae3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.338225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.338172    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb4fc7b7b597fd5dd2a5941924dbc289-config\") pod \"kube-apiserver-proxy-ip-10-0-136-55.ec2.internal\" (UID: \"eb4fc7b7b597fd5dd2a5941924dbc289\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.338225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.338200    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fd6ceeaba410c80fffc34fb05c8ae3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal\" (UID: \"6fd6ceeaba410c80fffc34fb05c8ae3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.421439 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.421394    2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-55.ec2.internal\" not found"
Jul 15 04:06:12.506899 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.506872    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.512682 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.512667    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.522500 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.522483    2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-55.ec2.internal\" not found"
Jul 15 04:06:12.623040 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.623013    2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-55.ec2.internal\" not found"
Jul 15 04:06:12.723506 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.723461    2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-55.ec2.internal\" not found"
Jul 15 04:06:12.823998 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.823976    2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-55.ec2.internal\" not found"
Jul 15 04:06:12.885437 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.885417    2539 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 04:06:12.885963 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.885530    2539 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 04:06:12.916452 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.916434    2539 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 04:06:12.918332 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.918316    2539 apiserver.go:52] "Watching apiserver"
Jul 15 04:06:12.927599 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.927571    2539 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 04:06:12.930382 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.930362    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-lnvjn","openshift-cluster-node-tuning-operator/tuned-cr6ws","openshift-dns/node-resolver-q7n7b","openshift-image-registry/node-ca-dx75w","openshift-multus/network-metrics-daemon-vkw9q","openshift-network-operator/iptables-alerter-r9chx","kube-system/global-pull-secret-syncer-bkw6z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf","openshift-multus/multus-additional-cni-plugins-cbdhv","openshift-multus/multus-vwkqm","openshift-network-diagnostics/network-check-target-dt2kv","openshift-ovn-kubernetes/ovnkube-node-dqkl6"]
Jul 15 04:06:12.933774 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.933757    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:12.935970 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.935952    2539 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.936065 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.935985    2539 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 04:06:12.936319 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.936298    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bj2d7\""
Jul 15 04:06:12.936376 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.936303    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 04:06:12.936415 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.936393    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 04:06:12.936488 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.936471    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.941553 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941273    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-sysctl-conf\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.941553 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941429    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56e14cd3-f903-4978-83c9-1622c1544499-agent-certs\") pod \"konnectivity-agent-lnvjn\" (UID: \"56e14cd3-f903-4978-83c9-1622c1544499\") " pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:12.941553 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941500    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56e14cd3-f903-4978-83c9-1622c1544499-konnectivity-ca\") pod \"konnectivity-agent-lnvjn\" (UID: \"56e14cd3-f903-4978-83c9-1622c1544499\") " pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:12.941553 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941547    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-modprobe-d\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.941863 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941570    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-kubernetes\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.941863 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941636    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-var-lib-kubelet\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.941863 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941698    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-sys\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.941863 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941707    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 04:06:12.941863 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941753    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-lib-modules\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.941863 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941715    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 04:06:12.941863 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941769    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pmzrf\""
Jul 15 04:06:12.941863 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941804    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-tmp\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.941863 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941854    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-run\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.942262 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941882    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-sysconfig\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.942262 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941932    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-sysctl-d\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.942262 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941964    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-host\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.942262 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.941994    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-systemd\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.942430 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.942411    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-tuned\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.942487 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.942449    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9rdc\" (UniqueName: \"kubernetes.io/projected/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-kube-api-access-j9rdc\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:12.942633 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.942615    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q7n7b"
Jul 15 04:06:12.944867 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.944846    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 04:06:12.944867 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.944862    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vh6qr\""
Jul 15 04:06:12.944997 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.944958    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 04:06:12.945393 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.945379    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dx75w"
Jul 15 04:06:12.945963 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.945944    2539 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 04:06:12.946667 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.946645    2539 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 04:01:12 +0000 UTC" deadline="2028-04-05 19:03:18.296006914 +0000 UTC"
Jul 15 04:06:12.946735 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.946667    2539 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15134h57m5.34934346s"
Jul 15 04:06:12.947516 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.947499    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 04:06:12.947872 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.947858    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 04:06:12.947910 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.947882    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xj2s8\""
Jul 15 04:06:12.948184 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.948168    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 04:06:12.948396 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.948383    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:12.948472 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.948454    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:12.949492 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.949474    2539 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 04:06:12.949577 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.949563    2539 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-55.ec2.internal"
Jul 15 04:06:12.951259 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.951240    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r9chx"
Jul 15 04:06:12.953788 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.953771    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 04:06:12.953788 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.953777    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 04:06:12.953945 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.953845    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7klc2\""
Jul 15 04:06:12.953945 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.953889    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 04:06:12.954084 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.954067    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:12.954178 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.954156    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:12.957401 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.957387    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:12.958185 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.958151    2539 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 04:06:12.959807 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.959790    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 04:06:12.959885 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.959831    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cz6wv\""
Jul 15 04:06:12.959885 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.959862    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 04:06:12.960034 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.960011    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 04:06:12.960263 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.960247    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:12.962639 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.962616    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 04:06:12.962753 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.962732    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 04:06:12.962818 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.962748    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 04:06:12.962818 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.962742    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rlgld\""
Jul 15 04:06:12.962897 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.962883    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:12.963144 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.963047    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 04:06:12.963144 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.963083    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 04:06:12.965153 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.965136    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:12.965249 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:12.965210    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:12.965249 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.965231    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mw75n\""
Jul 15 04:06:12.965364 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.965263    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 04:06:12.967919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.967902    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal"]
Jul 15 04:06:12.967992 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.967934    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-55.ec2.internal"]
Jul 15 04:06:12.968040 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.968008    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:12.970565 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.970546    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 04:06:12.970740 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.970600    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 04:06:12.970740 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.970659    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 04:06:12.970740 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.970673    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 04:06:12.970740 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.970663    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 04:06:12.970740 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.970663    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c5xv5\""
Jul 15 04:06:12.971180 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.971166    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 04:06:12.972070 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.972055    2539 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bk9km"
Jul 15 04:06:12.980141 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.980094    2539 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bk9km"
Jul 15 04:06:12.988282 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:12.988266    2539 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 04:06:13.036912 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.036892    2539 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 04:06:13.042839 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.042817    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-os-release\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.042945 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.042855    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-var-lib-kubelet\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.042945 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.042883    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-node-log\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.043052 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.042907    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-cni-netd\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.043052 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.042975    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa7930d2-6d25-4302-8798-2f0e3bcac369-env-overrides\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.043052 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043020    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjvlb\" (UniqueName: \"kubernetes.io/projected/fa7930d2-6d25-4302-8798-2f0e3bcac369-kube-api-access-sjvlb\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.043174 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043066    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-lib-modules\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.043174 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043121    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-run-k8s-cni-cncf-io\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.043174 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043151    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-run-multus-certs\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.043266 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043178    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-run\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.043266 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043195    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-lib-modules\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.043266 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043205    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:13.043266 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043231    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.043266 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043252    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-run\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.043266 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043258    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.043440 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043282    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-system-cni-dir\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.043440 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043314    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-multus-cni-dir\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.043440 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043338    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-etc-openvswitch\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.043440 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043378    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-log-socket\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.043440 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043419    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13ac8a6b-5743-4bec-b544-2da140a035d0-tmp-dir\") pod \"node-resolver-q7n7b\" (UID: \"13ac8a6b-5743-4bec-b544-2da140a035d0\") " pod="openshift-dns/node-resolver-q7n7b"
Jul 15 04:06:13.043668 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043448    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56e14cd3-f903-4978-83c9-1622c1544499-agent-certs\") pod \"konnectivity-agent-lnvjn\" (UID: \"56e14cd3-f903-4978-83c9-1622c1544499\") " pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:13.043668 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043473    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56e14cd3-f903-4978-83c9-1622c1544499-konnectivity-ca\") pod \"konnectivity-agent-lnvjn\" (UID: \"56e14cd3-f903-4978-83c9-1622c1544499\") " pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:13.043668 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043564    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-modprobe-d\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.043668 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043598    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-var-lib-cni-multus\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.043668 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043654    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-run-ovn\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.043919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043679    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa7930d2-6d25-4302-8798-2f0e3bcac369-ovn-node-metrics-cert\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.043919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043696    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-modprobe-d\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.043919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043702    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/624ff61e-8c93-4956-b0a4-4b3782abaded-host\") pod \"node-ca-dx75w\" (UID: \"624ff61e-8c93-4956-b0a4-4b3782abaded\") " pod="openshift-image-registry/node-ca-dx75w"
Jul 15 04:06:13.043919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043744    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.043919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043767    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-var-lib-cni-bin\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.043919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043788    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2x76\" (UniqueName: \"kubernetes.io/projected/1c614905-a2d0-4b04-8122-9eaec77e72a7-kube-api-access-n2x76\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.043919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043831    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-hostroot\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.043919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043853    2539 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 04:06:13.043919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043864    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-kubelet\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.043919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043892    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa7930d2-6d25-4302-8798-2f0e3bcac369-ovnkube-config\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.043919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043915    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-sys-fs\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043941    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-os-release\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043970    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.043994    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-cnibin\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044020    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044051    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-sysctl-conf\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044074    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13ac8a6b-5743-4bec-b544-2da140a035d0-hosts-file\") pod \"node-resolver-q7n7b\" (UID: \"13ac8a6b-5743-4bec-b544-2da140a035d0\") " pod="openshift-dns/node-resolver-q7n7b"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044098    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8ggc\" (UniqueName: \"kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc\") pod \"network-check-target-dt2kv\" (UID: \"cbd6d3c3-1c04-4243-a133-06747bb45e10\") " pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044145    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-socket-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044172    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-etc-kubernetes\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044195    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-run-systemd\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044220    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-run-openvswitch\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044244    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-run-ovn-kubernetes\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044251    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-sysctl-conf\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044269    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044295    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-cnibin\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.045064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044327    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtskv\" (UniqueName: \"kubernetes.io/projected/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-kube-api-access-jtskv\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044355    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d72b21c7-d44c-485f-bf22-636027b30850-cni-binary-copy\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044380    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-multus-conf-dir\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044407    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfnpz\" (UniqueName: \"kubernetes.io/projected/d72b21c7-d44c-485f-bf22-636027b30850-kube-api-access-hfnpz\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044438    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-sysconfig\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044471    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/624ff61e-8c93-4956-b0a4-4b3782abaded-serviceca\") pod \"node-ca-dx75w\" (UID: \"624ff61e-8c93-4956-b0a4-4b3782abaded\") " pod="openshift-image-registry/node-ca-dx75w"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044509    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qj6s\" (UniqueName: \"kubernetes.io/projected/d67a7872-e452-44f7-92e3-8afd1c0d18bb-kube-api-access-7qj6s\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044520    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-sysconfig\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044539    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-multus-socket-dir-parent\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044577    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-systemd\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044613    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-registration-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044645    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044618    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-systemd\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044672    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044699    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-slash\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044699    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/56e14cd3-f903-4978-83c9-1622c1544499-konnectivity-ca\") pod \"konnectivity-agent-lnvjn\" (UID: \"56e14cd3-f903-4978-83c9-1622c1544499\") " pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044748    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa7930d2-6d25-4302-8798-2f0e3bcac369-ovnkube-script-lib\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.046281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044773    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-kubernetes\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044795    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-device-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044819    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d72b21c7-d44c-485f-bf22-636027b30850-multus-daemon-config\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044839    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-sys\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044845    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-kubernetes\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044855    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-tmp\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044886    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrzcq\" (UniqueName: \"kubernetes.io/projected/13ac8a6b-5743-4bec-b544-2da140a035d0-kube-api-access-nrzcq\") pod \"node-resolver-q7n7b\" (UID: \"13ac8a6b-5743-4bec-b544-2da140a035d0\") " pod="openshift-dns/node-resolver-q7n7b"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044895    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-sys\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044910    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-run-netns\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044939    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-systemd-units\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044965    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-run-netns\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.044990    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-var-lib-openvswitch\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045013    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-cni-bin\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045044    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-sysctl-d\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045274    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-host\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045303    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-tuned\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045327    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9rdc\" (UniqueName: \"kubernetes.io/projected/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-kube-api-access-j9rdc\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045361    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9ggw\" (UniqueName: \"kubernetes.io/projected/624ff61e-8c93-4956-b0a4-4b3782abaded-kube-api-access-m9ggw\") pod \"node-ca-dx75w\" (UID: \"624ff61e-8c93-4956-b0a4-4b3782abaded\") " pod="openshift-image-registry/node-ca-dx75w"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045389    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2b5010c-bd28-4890-ab15-c91fc67b1a9f-iptables-alerter-script\") pod \"iptables-alerter-r9chx\" (UID: \"d2b5010c-bd28-4890-ab15-c91fc67b1a9f\") " pod="openshift-network-operator/iptables-alerter-r9chx"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045396    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-host\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045413    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2b5010c-bd28-4890-ab15-c91fc67b1a9f-host-slash\") pod \"iptables-alerter-r9chx\" (UID: \"d2b5010c-bd28-4890-ab15-c91fc67b1a9f\") " pod="openshift-network-operator/iptables-alerter-r9chx"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045230    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-sysctl-d\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045439    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xslh\" (UniqueName: \"kubernetes.io/projected/d2b5010c-bd28-4890-ab15-c91fc67b1a9f-kube-api-access-9xslh\") pod \"iptables-alerter-r9chx\" (UID: \"d2b5010c-bd28-4890-ab15-c91fc67b1a9f\") " pod="openshift-network-operator/iptables-alerter-r9chx"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045465    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8455199-dc31-493a-9fbd-fe6382eb83ee-kubelet-config\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045501    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8455199-dc31-493a-9fbd-fe6382eb83ee-dbus\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045551    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-var-lib-kubelet\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045591    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-system-cni-dir\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.045671    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-var-lib-kubelet\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.047351    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/56e14cd3-f903-4978-83c9-1622c1544499-agent-certs\") pod \"konnectivity-agent-lnvjn\" (UID: \"56e14cd3-f903-4978-83c9-1622c1544499\") " pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.047465    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-tmp\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.047802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.047548    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-etc-tuned\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.053104 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.053084    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9rdc\" (UniqueName: \"kubernetes.io/projected/441f87b0-ecf1-445c-8ac2-4e263cdff8bc-kube-api-access-j9rdc\") pod \"tuned-cr6ws\" (UID: \"441f87b0-ecf1-445c-8ac2-4e263cdff8bc\") " pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.099156 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:13.098992    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb4fc7b7b597fd5dd2a5941924dbc289.slice/crio-cd5ed8caf8d19c6ef6a916f6e81e927ce5996d8402a673df40948dc5a486680c WatchSource:0}: Error finding container cd5ed8caf8d19c6ef6a916f6e81e927ce5996d8402a673df40948dc5a486680c: Status 404 returned error can't find the container with id cd5ed8caf8d19c6ef6a916f6e81e927ce5996d8402a673df40948dc5a486680c
Jul 15 04:06:13.103133 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.103117    2539 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 04:06:13.146577 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146550    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/624ff61e-8c93-4956-b0a4-4b3782abaded-host\") pod \"node-ca-dx75w\" (UID: \"624ff61e-8c93-4956-b0a4-4b3782abaded\") " pod="openshift-image-registry/node-ca-dx75w"
Jul 15 04:06:13.146675 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146582    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.146675 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146600    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-var-lib-cni-bin\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.146675 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146615    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2x76\" (UniqueName: \"kubernetes.io/projected/1c614905-a2d0-4b04-8122-9eaec77e72a7-kube-api-access-n2x76\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.146675 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146665    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-hostroot\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.146826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146662    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.146826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146696    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/624ff61e-8c93-4956-b0a4-4b3782abaded-host\") pod \"node-ca-dx75w\" (UID: \"624ff61e-8c93-4956-b0a4-4b3782abaded\") " pod="openshift-image-registry/node-ca-dx75w"
Jul 15 04:06:13.146826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146684    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-kubelet\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.146826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146705    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-hostroot\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.146826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146725    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-kubelet\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.146826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146685    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-var-lib-cni-bin\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.146826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146749    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa7930d2-6d25-4302-8798-2f0e3bcac369-ovnkube-config\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.146826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146777    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-sys-fs\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.146826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146801    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-os-release\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.146826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146811    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-sys-fs\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.146826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146827    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146850    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-cnibin\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146880    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-os-release\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146893    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146913    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13ac8a6b-5743-4bec-b544-2da140a035d0-hosts-file\") pod \"node-resolver-q7n7b\" (UID: \"13ac8a6b-5743-4bec-b544-2da140a035d0\") " pod="openshift-dns/node-resolver-q7n7b"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146937    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ggc\" (UniqueName: \"kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc\") pod \"network-check-target-dt2kv\" (UID: \"cbd6d3c3-1c04-4243-a133-06747bb45e10\") " pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146964    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-socket-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146973    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146986    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13ac8a6b-5743-4bec-b544-2da140a035d0-hosts-file\") pod \"node-resolver-q7n7b\" (UID: \"13ac8a6b-5743-4bec-b544-2da140a035d0\") " pod="openshift-dns/node-resolver-q7n7b"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146939    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-cnibin\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.146987    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-etc-kubernetes\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147031    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-run-systemd\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147086    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-run-openvswitch\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147111    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-socket-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147143    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-etc-kubernetes\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147164    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-run-systemd\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147188    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-run-ovn-kubernetes\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.147346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147207    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-run-openvswitch\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147222    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147246    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-run-ovn-kubernetes\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147247    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-cnibin\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147284    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-cnibin\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147285    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtskv\" (UniqueName: \"kubernetes.io/projected/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-kube-api-access-jtskv\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147317    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d72b21c7-d44c-485f-bf22-636027b30850-cni-binary-copy\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147346    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-multus-conf-dir\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.147351    2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147370    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfnpz\" (UniqueName: \"kubernetes.io/projected/d72b21c7-d44c-485f-bf22-636027b30850-kube-api-access-hfnpz\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147403    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/624ff61e-8c93-4956-b0a4-4b3782abaded-serviceca\") pod \"node-ca-dx75w\" (UID: \"624ff61e-8c93-4956-b0a4-4b3782abaded\") " pod="openshift-image-registry/node-ca-dx75w"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.147450    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs podName:d67a7872-e452-44f7-92e3-8afd1c0d18bb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:13.647428261 +0000 UTC m=+2.084355153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs") pod "network-metrics-daemon-vkw9q" (UID: "d67a7872-e452-44f7-92e3-8afd1c0d18bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147484    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qj6s\" (UniqueName: \"kubernetes.io/projected/d67a7872-e452-44f7-92e3-8afd1c0d18bb-kube-api-access-7qj6s\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147513    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-multus-socket-dir-parent\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147486    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa7930d2-6d25-4302-8798-2f0e3bcac369-ovnkube-config\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147543    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-registration-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147545    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-multus-conf-dir\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.148195 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147571    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147574    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147600    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147709    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-slash\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147736    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa7930d2-6d25-4302-8798-2f0e3bcac369-ovnkube-script-lib\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147763    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-device-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147813    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d72b21c7-d44c-485f-bf22-636027b30850-multus-daemon-config\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147842    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrzcq\" (UniqueName: \"kubernetes.io/projected/13ac8a6b-5743-4bec-b544-2da140a035d0-kube-api-access-nrzcq\") pod \"node-resolver-q7n7b\" (UID: \"13ac8a6b-5743-4bec-b544-2da140a035d0\") " pod="openshift-dns/node-resolver-q7n7b"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147876    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147875    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-run-netns\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147906    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/624ff61e-8c93-4956-b0a4-4b3782abaded-serviceca\") pod \"node-ca-dx75w\" (UID: \"624ff61e-8c93-4956-b0a4-4b3782abaded\") " pod="openshift-image-registry/node-ca-dx75w"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147929    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-systemd-units\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147985    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-slash\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.147999    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-registration-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148033    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-systemd-units\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148045    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-device-dir\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148081    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-multus-socket-dir-parent\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.148962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148190    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-run-netns\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148222    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-var-lib-openvswitch\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148259    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-run-netns\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148261    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-var-lib-openvswitch\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148295    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-run-netns\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148301    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-cni-bin\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148344    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-cni-bin\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148405    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9ggw\" (UniqueName: \"kubernetes.io/projected/624ff61e-8c93-4956-b0a4-4b3782abaded-kube-api-access-m9ggw\") pod \"node-ca-dx75w\" (UID: \"624ff61e-8c93-4956-b0a4-4b3782abaded\") " pod="openshift-image-registry/node-ca-dx75w"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148432    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2b5010c-bd28-4890-ab15-c91fc67b1a9f-iptables-alerter-script\") pod \"iptables-alerter-r9chx\" (UID: \"d2b5010c-bd28-4890-ab15-c91fc67b1a9f\") " pod="openshift-network-operator/iptables-alerter-r9chx"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148457    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2b5010c-bd28-4890-ab15-c91fc67b1a9f-host-slash\") pod \"iptables-alerter-r9chx\" (UID: \"d2b5010c-bd28-4890-ab15-c91fc67b1a9f\") " pod="openshift-network-operator/iptables-alerter-r9chx"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148482    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xslh\" (UniqueName: \"kubernetes.io/projected/d2b5010c-bd28-4890-ab15-c91fc67b1a9f-kube-api-access-9xslh\") pod \"iptables-alerter-r9chx\" (UID: \"d2b5010c-bd28-4890-ab15-c91fc67b1a9f\") " pod="openshift-network-operator/iptables-alerter-r9chx"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148535    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2b5010c-bd28-4890-ab15-c91fc67b1a9f-host-slash\") pod \"iptables-alerter-r9chx\" (UID: \"d2b5010c-bd28-4890-ab15-c91fc67b1a9f\") " pod="openshift-network-operator/iptables-alerter-r9chx"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148566    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa7930d2-6d25-4302-8798-2f0e3bcac369-ovnkube-script-lib\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148620    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d72b21c7-d44c-485f-bf22-636027b30850-cni-binary-copy\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148686    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8455199-dc31-493a-9fbd-fe6382eb83ee-kubelet-config\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148707    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8455199-dc31-493a-9fbd-fe6382eb83ee-dbus\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148758    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8455199-dc31-493a-9fbd-fe6382eb83ee-kubelet-config\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:13.149700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148204    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148794    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-system-cni-dir\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148807    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8455199-dc31-493a-9fbd-fe6382eb83ee-dbus\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148823    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-system-cni-dir\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148848    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-os-release\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148877    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-var-lib-kubelet\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148900    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-os-release\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148910    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-node-log\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148922    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-var-lib-kubelet\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148943    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-node-log\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148951    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-cni-netd\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148982    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-host-cni-netd\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.148983    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa7930d2-6d25-4302-8798-2f0e3bcac369-env-overrides\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149018    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d72b21c7-d44c-485f-bf22-636027b30850-multus-daemon-config\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149022    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjvlb\" (UniqueName: \"kubernetes.io/projected/fa7930d2-6d25-4302-8798-2f0e3bcac369-kube-api-access-sjvlb\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149074    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-run-k8s-cni-cncf-io\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149122    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-run-multus-certs\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149133    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-run-k8s-cni-cncf-io\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.150548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149134    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2b5010c-bd28-4890-ab15-c91fc67b1a9f-iptables-alerter-script\") pod \"iptables-alerter-r9chx\" (UID: \"d2b5010c-bd28-4890-ab15-c91fc67b1a9f\") " pod="openshift-network-operator/iptables-alerter-r9chx"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149150    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149163    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-run-multus-certs\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149178    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149209    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.149234    2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149235    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-system-cni-dir\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149238    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c614905-a2d0-4b04-8122-9eaec77e72a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.149280    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret podName:a8455199-dc31-493a-9fbd-fe6382eb83ee nodeName:}" failed. No retries permitted until 2026-07-15 04:06:13.64926243 +0000 UTC m=+2.086189308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret") pod "global-pull-secret-syncer-bkw6z" (UID: "a8455199-dc31-493a-9fbd-fe6382eb83ee") : object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149298    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-system-cni-dir\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149311    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-multus-cni-dir\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149334    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-etc-openvswitch\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149403    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-etc-openvswitch\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149355    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-log-socket\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149760    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-multus-cni-dir\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149775    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa7930d2-6d25-4302-8798-2f0e3bcac369-env-overrides\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149443    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-log-socket\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.151404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149874    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13ac8a6b-5743-4bec-b544-2da140a035d0-tmp-dir\") pod \"node-resolver-q7n7b\" (UID: \"13ac8a6b-5743-4bec-b544-2da140a035d0\") " pod="openshift-dns/node-resolver-q7n7b"
Jul 15 04:06:13.152462 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149929    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-var-lib-cni-multus\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.152462 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.149955    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-run-ovn\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.152462 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.150010    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa7930d2-6d25-4302-8798-2f0e3bcac369-ovn-node-metrics-cert\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.152462 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.150053    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d72b21c7-d44c-485f-bf22-636027b30850-host-var-lib-cni-multus\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.152462 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.150116    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa7930d2-6d25-4302-8798-2f0e3bcac369-run-ovn\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.152462 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.150133    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.152462 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.150182    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13ac8a6b-5743-4bec-b544-2da140a035d0-tmp-dir\") pod \"node-resolver-q7n7b\" (UID: \"13ac8a6b-5743-4bec-b544-2da140a035d0\") " pod="openshift-dns/node-resolver-q7n7b"
Jul 15 04:06:13.153187 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.152864    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 04:06:13.153187 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.153185    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 04:06:13.153310 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.153200    2539 projected.go:196] Error preparing data for projected volume kube-api-access-c8ggc for pod openshift-network-diagnostics/network-check-target-dt2kv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:13.153310 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.153260    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc podName:cbd6d3c3-1c04-4243-a133-06747bb45e10 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:13.653244211 +0000 UTC m=+2.090171108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c8ggc" (UniqueName: "kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc") pod "network-check-target-dt2kv" (UID: "cbd6d3c3-1c04-4243-a133-06747bb45e10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:13.153870 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.153846    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa7930d2-6d25-4302-8798-2f0e3bcac369-ovn-node-metrics-cert\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.155666 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.155561    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2x76\" (UniqueName: \"kubernetes.io/projected/1c614905-a2d0-4b04-8122-9eaec77e72a7-kube-api-access-n2x76\") pod \"aws-ebs-csi-driver-node-qzqhf\" (UID: \"1c614905-a2d0-4b04-8122-9eaec77e72a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.156647 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.156626    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfnpz\" (UniqueName: \"kubernetes.io/projected/d72b21c7-d44c-485f-bf22-636027b30850-kube-api-access-hfnpz\") pod \"multus-vwkqm\" (UID: \"d72b21c7-d44c-485f-bf22-636027b30850\") " pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.156856 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.156831    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtskv\" (UniqueName: \"kubernetes.io/projected/6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1-kube-api-access-jtskv\") pod \"multus-additional-cni-plugins-cbdhv\" (UID: \"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1\") " pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.157736 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.157716    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjvlb\" (UniqueName: \"kubernetes.io/projected/fa7930d2-6d25-4302-8798-2f0e3bcac369-kube-api-access-sjvlb\") pod \"ovnkube-node-dqkl6\" (UID: \"fa7930d2-6d25-4302-8798-2f0e3bcac369\") " pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.157885 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.157868    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9ggw\" (UniqueName: \"kubernetes.io/projected/624ff61e-8c93-4956-b0a4-4b3782abaded-kube-api-access-m9ggw\") pod \"node-ca-dx75w\" (UID: \"624ff61e-8c93-4956-b0a4-4b3782abaded\") " pod="openshift-image-registry/node-ca-dx75w"
Jul 15 04:06:13.158264 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.158238    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrzcq\" (UniqueName: \"kubernetes.io/projected/13ac8a6b-5743-4bec-b544-2da140a035d0-kube-api-access-nrzcq\") pod \"node-resolver-q7n7b\" (UID: \"13ac8a6b-5743-4bec-b544-2da140a035d0\") " pod="openshift-dns/node-resolver-q7n7b"
Jul 15 04:06:13.158490 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.158471    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xslh\" (UniqueName: \"kubernetes.io/projected/d2b5010c-bd28-4890-ab15-c91fc67b1a9f-kube-api-access-9xslh\") pod \"iptables-alerter-r9chx\" (UID: \"d2b5010c-bd28-4890-ab15-c91fc67b1a9f\") " pod="openshift-network-operator/iptables-alerter-r9chx"
Jul 15 04:06:13.158751 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.158734    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qj6s\" (UniqueName: \"kubernetes.io/projected/d67a7872-e452-44f7-92e3-8afd1c0d18bb-kube-api-access-7qj6s\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:13.218117 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.218098    2539 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 04:06:13.254520 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.254450    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:13.265088 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:13.265067    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e14cd3_f903_4978_83c9_1622c1544499.slice/crio-c393b80fd71ad69db23c0de4ee29b71a265ea73818d003c5f5f05818f0989366 WatchSource:0}: Error finding container c393b80fd71ad69db23c0de4ee29b71a265ea73818d003c5f5f05818f0989366: Status 404 returned error can't find the container with id c393b80fd71ad69db23c0de4ee29b71a265ea73818d003c5f5f05818f0989366
Jul 15 04:06:13.283702 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.283684    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cr6ws"
Jul 15 04:06:13.291785 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:13.291765    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod441f87b0_ecf1_445c_8ac2_4e263cdff8bc.slice/crio-1a5191f7793deeff521689f1e34d84c40abb6e4a69012b6430e7c85a4753ea3a WatchSource:0}: Error finding container 1a5191f7793deeff521689f1e34d84c40abb6e4a69012b6430e7c85a4753ea3a: Status 404 returned error can't find the container with id 1a5191f7793deeff521689f1e34d84c40abb6e4a69012b6430e7c85a4753ea3a
Jul 15 04:06:13.302073 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.302054    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q7n7b"
Jul 15 04:06:13.310432 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:13.310409    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ac8a6b_5743_4bec_b544_2da140a035d0.slice/crio-6f46c90e768ebc32fd5c65badf1d342ae3296d75299b289c40832e1a7ee483c4 WatchSource:0}: Error finding container 6f46c90e768ebc32fd5c65badf1d342ae3296d75299b289c40832e1a7ee483c4: Status 404 returned error can't find the container with id 6f46c90e768ebc32fd5c65badf1d342ae3296d75299b289c40832e1a7ee483c4
Jul 15 04:06:13.316411 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.316395    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dx75w"
Jul 15 04:06:13.325158 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:13.325139    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624ff61e_8c93_4956_b0a4_4b3782abaded.slice/crio-3753dd292ddb0ebf0b21138cdba8e1bd4e3e29369e001d3b0a9a1375a87f7121 WatchSource:0}: Error finding container 3753dd292ddb0ebf0b21138cdba8e1bd4e3e29369e001d3b0a9a1375a87f7121: Status 404 returned error can't find the container with id 3753dd292ddb0ebf0b21138cdba8e1bd4e3e29369e001d3b0a9a1375a87f7121
Jul 15 04:06:13.327217 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.327204    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r9chx"
Jul 15 04:06:13.337730 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:13.337696    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b5010c_bd28_4890_ab15_c91fc67b1a9f.slice/crio-20a33bd110146b68e035264619a07f51d2d30955390fd4425f83284d805519cf WatchSource:0}: Error finding container 20a33bd110146b68e035264619a07f51d2d30955390fd4425f83284d805519cf: Status 404 returned error can't find the container with id 20a33bd110146b68e035264619a07f51d2d30955390fd4425f83284d805519cf
Jul 15 04:06:13.342007 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.341991    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf"
Jul 15 04:06:13.350025 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:13.350005    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c614905_a2d0_4b04_8122_9eaec77e72a7.slice/crio-fcc6ae74ee569cdb963fbcfd609988ebffac1dad092999038545ac5f01d63100 WatchSource:0}: Error finding container fcc6ae74ee569cdb963fbcfd609988ebffac1dad092999038545ac5f01d63100: Status 404 returned error can't find the container with id fcc6ae74ee569cdb963fbcfd609988ebffac1dad092999038545ac5f01d63100
Jul 15 04:06:13.361159 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.361144    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cbdhv"
Jul 15 04:06:13.367303 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.367242    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwkqm"
Jul 15 04:06:13.369148 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:13.369130    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c45e3bb_097c_4dcc_b3ca_dcc2c98324c1.slice/crio-75cd34e83d3c9a9bf6c6c703c87e143ca15cac08d05ffab98eab8fd51a22bca8 WatchSource:0}: Error finding container 75cd34e83d3c9a9bf6c6c703c87e143ca15cac08d05ffab98eab8fd51a22bca8: Status 404 returned error can't find the container with id 75cd34e83d3c9a9bf6c6c703c87e143ca15cac08d05ffab98eab8fd51a22bca8
Jul 15 04:06:13.370812 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.370793    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:13.375816 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:13.375797    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72b21c7_d44c_485f_bf22_636027b30850.slice/crio-01ac47cd9fc6f0edba31f2b37dba93907ebdb87b15977c7d5e5478b14a17785b WatchSource:0}: Error finding container 01ac47cd9fc6f0edba31f2b37dba93907ebdb87b15977c7d5e5478b14a17785b: Status 404 returned error can't find the container with id 01ac47cd9fc6f0edba31f2b37dba93907ebdb87b15977c7d5e5478b14a17785b
Jul 15 04:06:13.379989 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:13.379964    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7930d2_6d25_4302_8798_2f0e3bcac369.slice/crio-b3c7abcc5a84709eacf1d5755071f734ce009606e760a01b22780adbf9ce513a WatchSource:0}: Error finding container b3c7abcc5a84709eacf1d5755071f734ce009606e760a01b22780adbf9ce513a: Status 404 returned error can't find the container with id b3c7abcc5a84709eacf1d5755071f734ce009606e760a01b22780adbf9ce513a
Jul 15 04:06:13.594767 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:13.594738    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd6ceeaba410c80fffc34fb05c8ae3f.slice/crio-f1eccbad9b68ab4356038d265a2588f3b6d7d04bf2386cfd82bb89e41479924f WatchSource:0}: Error finding container f1eccbad9b68ab4356038d265a2588f3b6d7d04bf2386cfd82bb89e41479924f: Status 404 returned error can't find the container with id f1eccbad9b68ab4356038d265a2588f3b6d7d04bf2386cfd82bb89e41479924f
Jul 15 04:06:13.654771 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.654740    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:13.654884 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.654793    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ggc\" (UniqueName: \"kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc\") pod \"network-check-target-dt2kv\" (UID: \"cbd6d3c3-1c04-4243-a133-06747bb45e10\") " pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:13.654884 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.654821    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:13.655054 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.654902    2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:13.655054 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.654901    2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:13.655054 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.654913    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 04:06:13.655054 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.654934    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 04:06:13.655054 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.654947    2539 projected.go:196] Error preparing data for projected volume kube-api-access-c8ggc for pod openshift-network-diagnostics/network-check-target-dt2kv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:13.655054 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.654955    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs podName:d67a7872-e452-44f7-92e3-8afd1c0d18bb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:14.654935309 +0000 UTC m=+3.091862205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs") pod "network-metrics-daemon-vkw9q" (UID: "d67a7872-e452-44f7-92e3-8afd1c0d18bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:13.655054 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.654973    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret podName:a8455199-dc31-493a-9fbd-fe6382eb83ee nodeName:}" failed. No retries permitted until 2026-07-15 04:06:14.654963238 +0000 UTC m=+3.091890115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret") pod "global-pull-secret-syncer-bkw6z" (UID: "a8455199-dc31-493a-9fbd-fe6382eb83ee") : object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:13.655054 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:13.654991    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc podName:cbd6d3c3-1c04-4243-a133-06747bb45e10 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:14.654981252 +0000 UTC m=+3.091908129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8ggc" (UniqueName: "kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc") pod "network-check-target-dt2kv" (UID: "cbd6d3c3-1c04-4243-a133-06747bb45e10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:13.983943 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.983838    2539 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 04:01:13 +0000 UTC" deadline="2028-04-12 08:02:51.133772354 +0000 UTC"
Jul 15 04:06:13.983943 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:13.983902    2539 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15291h56m37.149875863s"
Jul 15 04:06:14.100315 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.100250    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-55.ec2.internal" event={"ID":"eb4fc7b7b597fd5dd2a5941924dbc289","Type":"ContainerStarted","Data":"cd5ed8caf8d19c6ef6a916f6e81e927ce5996d8402a673df40948dc5a486680c"}
Jul 15 04:06:14.110118 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.110085    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r9chx" event={"ID":"d2b5010c-bd28-4890-ab15-c91fc67b1a9f","Type":"ContainerStarted","Data":"20a33bd110146b68e035264619a07f51d2d30955390fd4425f83284d805519cf"}
Jul 15 04:06:14.129645 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.129605    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dx75w" event={"ID":"624ff61e-8c93-4956-b0a4-4b3782abaded","Type":"ContainerStarted","Data":"3753dd292ddb0ebf0b21138cdba8e1bd4e3e29369e001d3b0a9a1375a87f7121"}
Jul 15 04:06:14.137604 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.137575    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q7n7b" event={"ID":"13ac8a6b-5743-4bec-b544-2da140a035d0","Type":"ContainerStarted","Data":"6f46c90e768ebc32fd5c65badf1d342ae3296d75299b289c40832e1a7ee483c4"}
Jul 15 04:06:14.158959 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.158931    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnvjn" event={"ID":"56e14cd3-f903-4978-83c9-1622c1544499","Type":"ContainerStarted","Data":"c393b80fd71ad69db23c0de4ee29b71a265ea73818d003c5f5f05818f0989366"}
Jul 15 04:06:14.167454 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.167418    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal" event={"ID":"6fd6ceeaba410c80fffc34fb05c8ae3f","Type":"ContainerStarted","Data":"f1eccbad9b68ab4356038d265a2588f3b6d7d04bf2386cfd82bb89e41479924f"}
Jul 15 04:06:14.189830 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.189797    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" event={"ID":"fa7930d2-6d25-4302-8798-2f0e3bcac369","Type":"ContainerStarted","Data":"b3c7abcc5a84709eacf1d5755071f734ce009606e760a01b22780adbf9ce513a"}
Jul 15 04:06:14.203360 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.203312    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwkqm" event={"ID":"d72b21c7-d44c-485f-bf22-636027b30850","Type":"ContainerStarted","Data":"01ac47cd9fc6f0edba31f2b37dba93907ebdb87b15977c7d5e5478b14a17785b"}
Jul 15 04:06:14.211358 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.211332    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbdhv" event={"ID":"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1","Type":"ContainerStarted","Data":"75cd34e83d3c9a9bf6c6c703c87e143ca15cac08d05ffab98eab8fd51a22bca8"}
Jul 15 04:06:14.227380 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.227352    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf" event={"ID":"1c614905-a2d0-4b04-8122-9eaec77e72a7","Type":"ContainerStarted","Data":"fcc6ae74ee569cdb963fbcfd609988ebffac1dad092999038545ac5f01d63100"}
Jul 15 04:06:14.245614 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.245561    2539 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 04:06:14.245857 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.245836    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cr6ws" event={"ID":"441f87b0-ecf1-445c-8ac2-4e263cdff8bc","Type":"ContainerStarted","Data":"1a5191f7793deeff521689f1e34d84c40abb6e4a69012b6430e7c85a4753ea3a"}
Jul 15 04:06:14.664345 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.663344    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ggc\" (UniqueName: \"kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc\") pod \"network-check-target-dt2kv\" (UID: \"cbd6d3c3-1c04-4243-a133-06747bb45e10\") " pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:14.664345 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.663397    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:14.664345 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.663457    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:14.664345 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:14.663585    2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:14.664345 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:14.663649    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret podName:a8455199-dc31-493a-9fbd-fe6382eb83ee nodeName:}" failed. No retries permitted until 2026-07-15 04:06:16.663630675 +0000 UTC m=+5.100557568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret") pod "global-pull-secret-syncer-bkw6z" (UID: "a8455199-dc31-493a-9fbd-fe6382eb83ee") : object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:14.664345 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:14.664057    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 04:06:14.664345 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:14.664079    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 04:06:14.664345 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:14.664092    2539 projected.go:196] Error preparing data for projected volume kube-api-access-c8ggc for pod openshift-network-diagnostics/network-check-target-dt2kv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:14.664345 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:14.664139    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc podName:cbd6d3c3-1c04-4243-a133-06747bb45e10 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:16.664124083 +0000 UTC m=+5.101050962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8ggc" (UniqueName: "kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc") pod "network-check-target-dt2kv" (UID: "cbd6d3c3-1c04-4243-a133-06747bb45e10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:14.664345 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:14.664220    2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:14.664345 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:14.664257    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs podName:d67a7872-e452-44f7-92e3-8afd1c0d18bb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:16.664243859 +0000 UTC m=+5.101170738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs") pod "network-metrics-daemon-vkw9q" (UID: "d67a7872-e452-44f7-92e3-8afd1c0d18bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:14.984886 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.984785    2539 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 04:01:13 +0000 UTC" deadline="2028-02-18 13:57:26.896716211 +0000 UTC"
Jul 15 04:06:14.984886 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:14.984835    2539 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14001h51m11.911885851s"
Jul 15 04:06:15.073544 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:15.073466    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:15.073691 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:15.073665    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:15.074116 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:15.074087    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:15.074254 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:15.074228    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:15.074342 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:15.074305    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:15.074398 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:15.074383    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:16.684872 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:16.684819    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ggc\" (UniqueName: \"kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc\") pod \"network-check-target-dt2kv\" (UID: \"cbd6d3c3-1c04-4243-a133-06747bb45e10\") " pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:16.684872 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:16.684879    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:16.685452 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:16.684931    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:16.685452 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:16.685108    2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:16.685452 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:16.685139    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 04:06:16.685452 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:16.685155    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 04:06:16.685452 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:16.685168    2539 projected.go:196] Error preparing data for projected volume kube-api-access-c8ggc for pod openshift-network-diagnostics/network-check-target-dt2kv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:16.685452 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:16.685196    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs podName:d67a7872-e452-44f7-92e3-8afd1c0d18bb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:20.685158428 +0000 UTC m=+9.122085320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs") pod "network-metrics-daemon-vkw9q" (UID: "d67a7872-e452-44f7-92e3-8afd1c0d18bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:16.685452 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:16.685217    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc podName:cbd6d3c3-1c04-4243-a133-06747bb45e10 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:20.685205681 +0000 UTC m=+9.122132566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8ggc" (UniqueName: "kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc") pod "network-check-target-dt2kv" (UID: "cbd6d3c3-1c04-4243-a133-06747bb45e10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:16.685452 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:16.685231    2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:16.685452 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:16.685262    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret podName:a8455199-dc31-493a-9fbd-fe6382eb83ee nodeName:}" failed. No retries permitted until 2026-07-15 04:06:20.685251392 +0000 UTC m=+9.122178277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret") pod "global-pull-secret-syncer-bkw6z" (UID: "a8455199-dc31-493a-9fbd-fe6382eb83ee") : object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:17.074708 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:17.073793    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:17.074708 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:17.073939    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:17.074708 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:17.074383    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:17.074708 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:17.074483    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:17.074708 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:17.074548    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:17.074708 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:17.074618    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:19.074177 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:19.074148    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:19.074659 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:19.074275    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:19.074659 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:19.074606    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:19.074782 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:19.074717    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:19.074782 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:19.074766    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:19.074885 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:19.074832    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:20.721864 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:20.721826    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:20.722377 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:20.721898    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ggc\" (UniqueName: \"kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc\") pod \"network-check-target-dt2kv\" (UID: \"cbd6d3c3-1c04-4243-a133-06747bb45e10\") " pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:20.722377 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:20.721928    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:20.722377 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:20.722026    2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:20.722377 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:20.722031    2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:20.722377 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:20.722075    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs podName:d67a7872-e452-44f7-92e3-8afd1c0d18bb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:28.722060917 +0000 UTC m=+17.158987794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs") pod "network-metrics-daemon-vkw9q" (UID: "d67a7872-e452-44f7-92e3-8afd1c0d18bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:20.722377 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:20.722114    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 04:06:20.722377 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:20.722120    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret podName:a8455199-dc31-493a-9fbd-fe6382eb83ee nodeName:}" failed. No retries permitted until 2026-07-15 04:06:28.722084178 +0000 UTC m=+17.159011067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret") pod "global-pull-secret-syncer-bkw6z" (UID: "a8455199-dc31-493a-9fbd-fe6382eb83ee") : object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:20.722377 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:20.722140    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 04:06:20.722377 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:20.722154    2539 projected.go:196] Error preparing data for projected volume kube-api-access-c8ggc for pod openshift-network-diagnostics/network-check-target-dt2kv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:20.722377 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:20.722195    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc podName:cbd6d3c3-1c04-4243-a133-06747bb45e10 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:28.722185241 +0000 UTC m=+17.159112118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8ggc" (UniqueName: "kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc") pod "network-check-target-dt2kv" (UID: "cbd6d3c3-1c04-4243-a133-06747bb45e10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:21.074162 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:21.074081    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:21.074320 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:21.074233    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:21.074720 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:21.074699    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:21.074822 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:21.074801    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:21.074884 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:21.074870    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:21.074962 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:21.074946    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:23.074106 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:23.074028    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:23.074106 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:23.074049    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:23.074679 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:23.074080    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:23.074679 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:23.074207    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:23.074679 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:23.074289    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:23.074679 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:23.074389    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:25.074405 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:25.074369    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:25.074801 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:25.074378    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:25.074801 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:25.074492    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:25.074801 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:25.074582    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:25.074801 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:25.074378    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:25.074801 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:25.074676    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:27.073831 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:27.073808    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:27.074282 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:27.073844    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:27.074282 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:27.073804    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:27.074282 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:27.073941    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:27.074282 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:27.074080    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:27.074282 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:27.074176    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:28.784569 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:28.784515    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:28.785044 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:28.784887    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ggc\" (UniqueName: \"kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc\") pod \"network-check-target-dt2kv\" (UID: \"cbd6d3c3-1c04-4243-a133-06747bb45e10\") " pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:28.785044 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:28.784926    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:28.785044 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:28.784925    2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:28.785044 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:28.785004    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 04:06:28.785044 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:28.785014    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret podName:a8455199-dc31-493a-9fbd-fe6382eb83ee nodeName:}" failed. No retries permitted until 2026-07-15 04:06:44.784999287 +0000 UTC m=+33.221926161 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret") pod "global-pull-secret-syncer-bkw6z" (UID: "a8455199-dc31-493a-9fbd-fe6382eb83ee") : object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:28.785044 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:28.785024    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 04:06:28.785044 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:28.785036    2539 projected.go:196] Error preparing data for projected volume kube-api-access-c8ggc for pod openshift-network-diagnostics/network-check-target-dt2kv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:28.785366 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:28.785102    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc podName:cbd6d3c3-1c04-4243-a133-06747bb45e10 nodeName:}" failed. No retries permitted until 2026-07-15 04:06:44.785069361 +0000 UTC m=+33.221996236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8ggc" (UniqueName: "kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc") pod "network-check-target-dt2kv" (UID: "cbd6d3c3-1c04-4243-a133-06747bb45e10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:28.785366 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:28.785170    2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:28.785366 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:28.785208    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs podName:d67a7872-e452-44f7-92e3-8afd1c0d18bb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:44.785195672 +0000 UTC m=+33.222122551 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs") pod "network-metrics-daemon-vkw9q" (UID: "d67a7872-e452-44f7-92e3-8afd1c0d18bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:29.074196 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:29.074162    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:29.074196 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:29.074188    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:29.074391 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:29.074188    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:29.074391 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:29.074295    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:29.074391 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:29.074355    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:29.074542 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:29.074432    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:31.073836 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:31.073803    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:31.074268 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:31.073849    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:31.074268 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:31.073902    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:31.074268 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:31.073919    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:31.074268 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:31.074001    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:31.074268 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:31.074071    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:33.073866 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:33.073837    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:33.073866 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:33.073872    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:33.074361 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:33.073837    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:33.074361 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:33.073940    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:33.074361 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:33.074038    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:33.074361 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:33.074125    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:35.073996 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:35.073828    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:35.074512 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:35.073915    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:35.074512 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:35.074067    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:35.074512 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:35.073915    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:35.074512 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:35.074131    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:35.074512 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:35.074184    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:35.316055 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:35.316031    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" event={"ID":"fa7930d2-6d25-4302-8798-2f0e3bcac369","Type":"ContainerStarted","Data":"fd7fd3670f9078cd474b02769bb3e56053b1aac571f46f69519f85c7e9592da3"}
Jul 15 04:06:35.316174 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:35.316117    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" event={"ID":"fa7930d2-6d25-4302-8798-2f0e3bcac369","Type":"ContainerStarted","Data":"38b98f86cae8abece83c4f51b22f9bf95c89166a5a8e9b5fbbb9be20e66015eb"}
Jul 15 04:06:35.317388 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:35.317367    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwkqm" event={"ID":"d72b21c7-d44c-485f-bf22-636027b30850","Type":"ContainerStarted","Data":"6678ff3936881ee7ceb0e7649e60f9ddd113997943c911749e69a9fc6a79d39c"}
Jul 15 04:06:35.320054 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:35.320034    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cr6ws" event={"ID":"441f87b0-ecf1-445c-8ac2-4e263cdff8bc","Type":"ContainerStarted","Data":"c11543e1ab0602f62df7c75fa424bfbf1df38ed52349b2474c06e67e1cba4b41"}
Jul 15 04:06:35.321465 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:35.321442    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-55.ec2.internal" event={"ID":"eb4fc7b7b597fd5dd2a5941924dbc289","Type":"ContainerStarted","Data":"e302ae6f7dc96171f7d93d98ef1a5ef3800f03ba87fc58ce201ab504ec77420b"}
Jul 15 04:06:35.337345 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:35.335878    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vwkqm" podStartSLOduration=1.8719466599999999 podStartE2EDuration="23.335860332s" totalImagesPullingTime="21.463913672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:35.334317884 +0000 UTC m=+23.771244781" watchObservedRunningTime="2026-07-15 04:06:35.335860332 +0000 UTC m=+23.772787230"
Jul 15 04:06:35.348621 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:35.348586    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-55.ec2.internal" podStartSLOduration=22.348576352 podStartE2EDuration="22.348576352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:35.348204851 +0000 UTC m=+23.785131747" watchObservedRunningTime="2026-07-15 04:06:35.348576352 +0000 UTC m=+23.785503248"
Jul 15 04:06:35.372115 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:35.372067    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cr6ws" podStartSLOduration=1.832020792 podStartE2EDuration="23.372057045s" totalImagesPullingTime="21.540036253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:35.36316991 +0000 UTC m=+23.800096807" watchObservedRunningTime="2026-07-15 04:06:35.372057045 +0000 UTC m=+23.808983936"
Jul 15 04:06:36.325464 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.325247    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r9chx" event={"ID":"d2b5010c-bd28-4890-ab15-c91fc67b1a9f","Type":"ContainerStarted","Data":"f26b74672dd9670e9bc3f90fefadbc9a27eb057d79318d86c35c4dd05e2d8d06"}
Jul 15 04:06:36.326932 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.326908    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dx75w" event={"ID":"624ff61e-8c93-4956-b0a4-4b3782abaded","Type":"ContainerStarted","Data":"4b7a91339d66818da882858396dd1b0488a9bf1b35a5f4dd950051dbd8af720f"}
Jul 15 04:06:36.328579 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.328541    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q7n7b" event={"ID":"13ac8a6b-5743-4bec-b544-2da140a035d0","Type":"ContainerStarted","Data":"5e88d30956dcc50c94063d2a0103882f5399c7dadbea6985f4cdf6420c377976"}
Jul 15 04:06:36.330313 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.330289    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lnvjn" event={"ID":"56e14cd3-f903-4978-83c9-1622c1544499","Type":"ContainerStarted","Data":"7f0a8960206bb6a04d53f5b30aa48d9dc1078fbd48cc125e463fc48e59700f34"}
Jul 15 04:06:36.335866 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.335789    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:06:36.336274 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.336253    2539 generic.go:356] "Generic (PLEG): container finished" podID="fa7930d2-6d25-4302-8798-2f0e3bcac369" containerID="fd7fd3670f9078cd474b02769bb3e56053b1aac571f46f69519f85c7e9592da3" exitCode=1
Jul 15 04:06:36.336369 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.336278    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" event={"ID":"fa7930d2-6d25-4302-8798-2f0e3bcac369","Type":"ContainerDied","Data":"fd7fd3670f9078cd474b02769bb3e56053b1aac571f46f69519f85c7e9592da3"}
Jul 15 04:06:36.336428 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.336371    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" event={"ID":"fa7930d2-6d25-4302-8798-2f0e3bcac369","Type":"ContainerStarted","Data":"602f7dc37e54855dc430c47c7e4c07a5979992988776b611ba18052156b8a6db"}
Jul 15 04:06:36.336428 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.336422    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" event={"ID":"fa7930d2-6d25-4302-8798-2f0e3bcac369","Type":"ContainerStarted","Data":"39c69a281878a7e768560f02a67dec03efe102c1c66bda90d8ee74f0fdf3a956"}
Jul 15 04:06:36.336526 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.336469    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" event={"ID":"fa7930d2-6d25-4302-8798-2f0e3bcac369","Type":"ContainerStarted","Data":"5d783fd23aa731f12e397bf09a7455acedf1189b377c4723be67a7918f0149f7"}
Jul 15 04:06:36.336526 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.336516    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" event={"ID":"fa7930d2-6d25-4302-8798-2f0e3bcac369","Type":"ContainerStarted","Data":"2584c55bf71d3a678b0a13b38c4ec9dc67bad1cd40682606c72082a4cfcd3bc9"}
Jul 15 04:06:36.338317 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.337931    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbdhv" event={"ID":"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1","Type":"ContainerStarted","Data":"9d73de1265779555d507734af34b20d874650478f1d8b6ef76397af3a99e3ac3"}
Jul 15 04:06:36.339496 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.339439    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf" event={"ID":"1c614905-a2d0-4b04-8122-9eaec77e72a7","Type":"ContainerStarted","Data":"c95c337d073bf2244220c8799de0cd4458266d09fd46ffc18d3414f92dac419e"}
Jul 15 04:06:36.362167 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.362132    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q7n7b" podStartSLOduration=2.885782923 podStartE2EDuration="24.362119988s" totalImagesPullingTime="21.476337065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:36.361987401 +0000 UTC m=+24.798914298" watchObservedRunningTime="2026-07-15 04:06:36.362119988 +0000 UTC m=+24.799046885"
Jul 15 04:06:36.362377 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.362255    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r9chx" podStartSLOduration=2.913355695 podStartE2EDuration="24.362249205s" totalImagesPullingTime="21.44889351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:36.343952138 +0000 UTC m=+24.780879034" watchObservedRunningTime="2026-07-15 04:06:36.362249205 +0000 UTC m=+24.799176101"
Jul 15 04:06:36.398631 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:36.396414    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lnvjn" podStartSLOduration=2.874895417 podStartE2EDuration="24.396396683s" totalImagesPullingTime="21.521501266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:36.395759896 +0000 UTC m=+24.832686785" watchObservedRunningTime="2026-07-15 04:06:36.396396683 +0000 UTC m=+24.833323583"
Jul 15 04:06:37.074107 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:37.074061    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:37.074273 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:37.074059    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:37.074273 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:37.074191    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:37.074273 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:37.074065    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:37.074399 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:37.074278    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:37.074399 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:37.074319    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:37.342053 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:37.341979    2539 generic.go:356] "Generic (PLEG): container finished" podID="6fd6ceeaba410c80fffc34fb05c8ae3f" containerID="6af2b2152a519bc548f64b72439fd8b4e77ce151117fa66b89f03a392c2f0c66" exitCode=0
Jul 15 04:06:37.342476 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:37.342055    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal" event={"ID":"6fd6ceeaba410c80fffc34fb05c8ae3f","Type":"ContainerDied","Data":"6af2b2152a519bc548f64b72439fd8b4e77ce151117fa66b89f03a392c2f0c66"}
Jul 15 04:06:37.343548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:37.343528    2539 generic.go:356] "Generic (PLEG): container finished" podID="6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1" containerID="9d73de1265779555d507734af34b20d874650478f1d8b6ef76397af3a99e3ac3" exitCode=0
Jul 15 04:06:37.343645 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:37.343622    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbdhv" event={"ID":"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1","Type":"ContainerDied","Data":"9d73de1265779555d507734af34b20d874650478f1d8b6ef76397af3a99e3ac3"}
Jul 15 04:06:37.355073 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:37.355034    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dx75w" podStartSLOduration=3.872578573 podStartE2EDuration="25.355021292s" totalImagesPullingTime="21.482442719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:36.411516187 +0000 UTC m=+24.848443084" watchObservedRunningTime="2026-07-15 04:06:37.355021292 +0000 UTC m=+25.791948167"
Jul 15 04:06:37.586505 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:37.586457    2539 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 04:06:38.010663 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:38.010491    2539 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T04:06:37.586482884Z","UUID":"299f65e0-7fe9-4868-989a-131c8107c136","Handler":null,"Name":"","Endpoint":""}
Jul 15 04:06:38.011962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:38.011946    2539 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 04:06:38.012055 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:38.011985    2539 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 04:06:38.348197 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:38.348108    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf" event={"ID":"1c614905-a2d0-4b04-8122-9eaec77e72a7","Type":"ContainerStarted","Data":"296f3a2337b60c2398e7c8a34d0f03c4ec92f6e63cb712cf52da2c636be8afdc"}
Jul 15 04:06:38.350679 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:38.350652    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal" event={"ID":"6fd6ceeaba410c80fffc34fb05c8ae3f","Type":"ContainerStarted","Data":"07ca0ed924aa8748870575180bcc8e6ed17c8fdaed3503f3bc9a430bc4876ad4"}
Jul 15 04:06:38.364372 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:38.364348    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:06:38.364749 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:38.364724    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" event={"ID":"fa7930d2-6d25-4302-8798-2f0e3bcac369","Type":"ContainerStarted","Data":"491b196cdeef0648cfbb63943af040e45093e6a5ca3422604df93ceaaa20c6cd"}
Jul 15 04:06:39.073663 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:39.073639    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:39.073814 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:39.073639    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:39.073814 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:39.073759    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:39.073931 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:39.073647    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:39.073931 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:39.073863    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:39.074026 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:39.073938    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:39.369914 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:39.369877    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf" event={"ID":"1c614905-a2d0-4b04-8122-9eaec77e72a7","Type":"ContainerStarted","Data":"3a672d761ed22b32d68f7ead4edbb9e5c84739961b63b1d832db622602613629"}
Jul 15 04:06:39.395501 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:39.395447    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-55.ec2.internal" podStartSLOduration=26.39542436 podStartE2EDuration="26.39542436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:38.370162388 +0000 UTC m=+26.807089279" watchObservedRunningTime="2026-07-15 04:06:39.39542436 +0000 UTC m=+27.832351258"
Jul 15 04:06:40.234252 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:40.234203    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:40.235155 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:40.235135    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:40.252838 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:40.252794    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzqhf" podStartSLOduration=4.244432994 podStartE2EDuration="28.252778838s" totalImagesPullingTime="24.008345844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:39.39537719 +0000 UTC m=+27.832304087" watchObservedRunningTime="2026-07-15 04:06:40.252778838 +0000 UTC m=+28.689705769"
Jul 15 04:06:40.372311 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:40.372241    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:40.372705 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:40.372665    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lnvjn"
Jul 15 04:06:41.073469 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:41.073431    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:41.073638 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:41.073567    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:41.073638 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:41.073431    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:41.073727 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:41.073646    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:41.073727 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:41.073433    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:41.073727 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:41.073718    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:42.379376 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:42.379220    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:06:42.379978 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:42.379738    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" event={"ID":"fa7930d2-6d25-4302-8798-2f0e3bcac369","Type":"ContainerStarted","Data":"fd438230747156f95a4a744df72b0fa8c0efc1521fb39651bbdfc4754349ea82"}
Jul 15 04:06:42.380050 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:42.380013    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:42.380118 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:42.380071    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:42.380180 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:42.380136    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:42.380180 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:42.380145    2539 scope.go:117] "RemoveContainer" containerID="fd7fd3670f9078cd474b02769bb3e56053b1aac571f46f69519f85c7e9592da3"
Jul 15 04:06:42.381787 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:42.381764    2539 generic.go:356] "Generic (PLEG): container finished" podID="6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1" containerID="b2bd1e2f3b2dc720c85b1a735be2cb96dc55fac0ddcb802f89b4d42d5711c126" exitCode=0
Jul 15 04:06:42.381881 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:42.381830    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbdhv" event={"ID":"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1","Type":"ContainerDied","Data":"b2bd1e2f3b2dc720c85b1a735be2cb96dc55fac0ddcb802f89b4d42d5711c126"}
Jul 15 04:06:42.396156 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:42.396136    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:42.397141 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:42.397121    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:06:43.076823 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.076285    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:43.076823 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:43.076421    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:43.076823 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.076496    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:43.076823 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:43.076554    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:43.076823 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.076601    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:43.076823 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:43.076653    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:43.388225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.388165    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:06:43.388629 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.388576    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" event={"ID":"fa7930d2-6d25-4302-8798-2f0e3bcac369","Type":"ContainerStarted","Data":"42b23683019e2ddbd6379f1deaaa41b05dbbbba75bdef8d50f2599d9a109c4e1"}
Jul 15 04:06:43.415530 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.415493    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6" podStartSLOduration=9.847617364 podStartE2EDuration="31.415476624s" totalImagesPullingTime="21.56785926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:43.414024663 +0000 UTC m=+31.850951564" watchObservedRunningTime="2026-07-15 04:06:43.415476624 +0000 UTC m=+31.852403521"
Jul 15 04:06:43.738909 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.738709    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bkw6z"]
Jul 15 04:06:43.739107 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.738939    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:43.739107 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:43.739044    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:43.742158 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.742133    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dt2kv"]
Jul 15 04:06:43.742267 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.742221    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:43.742341 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:43.742307    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:43.742793 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.742773    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vkw9q"]
Jul 15 04:06:43.742883 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:43.742859    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:43.742960 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:43.742944    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:44.393105 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:44.393059    2539 generic.go:356] "Generic (PLEG): container finished" podID="6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1" containerID="719eb382da230220b8b715b6f2f04fc43fd30aa30726b04261cbc09cdd355a0f" exitCode=0
Jul 15 04:06:44.393561 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:44.393123    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbdhv" event={"ID":"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1","Type":"ContainerDied","Data":"719eb382da230220b8b715b6f2f04fc43fd30aa30726b04261cbc09cdd355a0f"}
Jul 15 04:06:44.809062 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:44.809031    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:44.809236 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:44.809107    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:44.809236 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:44.809154    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ggc\" (UniqueName: \"kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc\") pod \"network-check-target-dt2kv\" (UID: \"cbd6d3c3-1c04-4243-a133-06747bb45e10\") " pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:44.809236 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:44.809197    2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:44.809236 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:44.809205    2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:44.809395 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:44.809242    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 04:06:44.809395 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:44.809259    2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 04:06:44.809395 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:44.809263    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs podName:d67a7872-e452-44f7-92e3-8afd1c0d18bb nodeName:}" failed. No retries permitted until 2026-07-15 04:07:16.809243949 +0000 UTC m=+65.246170828 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs") pod "network-metrics-daemon-vkw9q" (UID: "d67a7872-e452-44f7-92e3-8afd1c0d18bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 04:06:44.809395 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:44.809271    2539 projected.go:196] Error preparing data for projected volume kube-api-access-c8ggc for pod openshift-network-diagnostics/network-check-target-dt2kv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:44.809395 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:44.809284    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret podName:a8455199-dc31-493a-9fbd-fe6382eb83ee nodeName:}" failed. No retries permitted until 2026-07-15 04:07:16.80927417 +0000 UTC m=+65.246201048 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret") pod "global-pull-secret-syncer-bkw6z" (UID: "a8455199-dc31-493a-9fbd-fe6382eb83ee") : object "kube-system"/"original-pull-secret" not registered
Jul 15 04:06:44.809395 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:44.809319    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc podName:cbd6d3c3-1c04-4243-a133-06747bb45e10 nodeName:}" failed. No retries permitted until 2026-07-15 04:07:16.809312409 +0000 UTC m=+65.246239284 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8ggc" (UniqueName: "kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc") pod "network-check-target-dt2kv" (UID: "cbd6d3c3-1c04-4243-a133-06747bb45e10") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 04:06:45.073966 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:45.073906    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:45.074105 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:45.074009    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:45.074105 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:45.074067    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:45.074179 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:45.074161    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:46.073839 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:46.073810    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:46.074333 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:46.073902    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:46.399815 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:46.399786    2539 generic.go:356] "Generic (PLEG): container finished" podID="6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1" containerID="3979bd68047257100a8c1c61de33f5b5e0944f3cf07fbe1fda7be3decb2c1cde" exitCode=0
Jul 15 04:06:46.399946 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:46.399834    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbdhv" event={"ID":"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1","Type":"ContainerDied","Data":"3979bd68047257100a8c1c61de33f5b5e0944f3cf07fbe1fda7be3decb2c1cde"}
Jul 15 04:06:47.073932 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:47.073904    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:47.073932 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:47.073922    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:47.074404 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:47.074011    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dt2kv" podUID="cbd6d3c3-1c04-4243-a133-06747bb45e10"
Jul 15 04:06:47.074404 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:47.074176    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vkw9q" podUID="d67a7872-e452-44f7-92e3-8afd1c0d18bb"
Jul 15 04:06:48.074361 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.074332    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:48.074779 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:48.074466    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bkw6z" podUID="a8455199-dc31-493a-9fbd-fe6382eb83ee"
Jul 15 04:06:48.401377 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.401349    2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-55.ec2.internal" event="NodeReady"
Jul 15 04:06:48.401531 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.401486    2539 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 04:06:48.442383 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.442348    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2f46c"]
Jul 15 04:06:48.446452 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.446424    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.449585 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.449561    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vj5mn"]
Jul 15 04:06:48.449704 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.449664    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2wv7r\""
Jul 15 04:06:48.449764 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.449708    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 04:06:48.449921 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.449901    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 04:06:48.455332 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.455302    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vj5mn"
Jul 15 04:06:48.456136 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.456113    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2f46c"]
Jul 15 04:06:48.457629 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.457608    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 04:06:48.457840 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.457817    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 04:06:48.458234 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.457940    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j29sx\""
Jul 15 04:06:48.458234 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.458044    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 04:06:48.462207 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.462104    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vj5mn"]
Jul 15 04:06:48.640709 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.640673    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602469bc-8388-42c3-9fbc-0dd67634d59d-tmp-dir\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.640880 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.640757    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.640880 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.640779    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvv8c\" (UniqueName: \"kubernetes.io/projected/602469bc-8388-42c3-9fbc-0dd67634d59d-kube-api-access-lvv8c\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.640880 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.640803    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/602469bc-8388-42c3-9fbc-0dd67634d59d-config-volume\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.640880 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.640822    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb89e80c-762c-462e-a309-ea754b8cbf88-cert\") pod \"ingress-canary-vj5mn\" (UID: \"bb89e80c-762c-462e-a309-ea754b8cbf88\") " pod="openshift-ingress-canary/ingress-canary-vj5mn"
Jul 15 04:06:48.640880 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.640842    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8b44\" (UniqueName: \"kubernetes.io/projected/bb89e80c-762c-462e-a309-ea754b8cbf88-kube-api-access-w8b44\") pod \"ingress-canary-vj5mn\" (UID: \"bb89e80c-762c-462e-a309-ea754b8cbf88\") " pod="openshift-ingress-canary/ingress-canary-vj5mn"
Jul 15 04:06:48.741665 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.741591    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602469bc-8388-42c3-9fbc-0dd67634d59d-tmp-dir\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.741820 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.741668    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.741820 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.741694    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvv8c\" (UniqueName: \"kubernetes.io/projected/602469bc-8388-42c3-9fbc-0dd67634d59d-kube-api-access-lvv8c\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.741820 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.741731    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/602469bc-8388-42c3-9fbc-0dd67634d59d-config-volume\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.741820 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.741754    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb89e80c-762c-462e-a309-ea754b8cbf88-cert\") pod \"ingress-canary-vj5mn\" (UID: \"bb89e80c-762c-462e-a309-ea754b8cbf88\") " pod="openshift-ingress-canary/ingress-canary-vj5mn"
Jul 15 04:06:48.741820 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.741794    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8b44\" (UniqueName: \"kubernetes.io/projected/bb89e80c-762c-462e-a309-ea754b8cbf88-kube-api-access-w8b44\") pod \"ingress-canary-vj5mn\" (UID: \"bb89e80c-762c-462e-a309-ea754b8cbf88\") " pod="openshift-ingress-canary/ingress-canary-vj5mn"
Jul 15 04:06:48.742066 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:48.741832    2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 04:06:48.742066 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:48.741896    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls podName:602469bc-8388-42c3-9fbc-0dd67634d59d nodeName:}" failed. No retries permitted until 2026-07-15 04:06:49.241879646 +0000 UTC m=+37.678806524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls") pod "dns-default-2f46c" (UID: "602469bc-8388-42c3-9fbc-0dd67634d59d") : secret "dns-default-metrics-tls" not found
Jul 15 04:06:48.742066 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.741953    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/602469bc-8388-42c3-9fbc-0dd67634d59d-tmp-dir\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.742503 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.742482    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/602469bc-8388-42c3-9fbc-0dd67634d59d-config-volume\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.746846 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.746683    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb89e80c-762c-462e-a309-ea754b8cbf88-cert\") pod \"ingress-canary-vj5mn\" (UID: \"bb89e80c-762c-462e-a309-ea754b8cbf88\") " pod="openshift-ingress-canary/ingress-canary-vj5mn"
Jul 15 04:06:48.750817 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.750791    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvv8c\" (UniqueName: \"kubernetes.io/projected/602469bc-8388-42c3-9fbc-0dd67634d59d-kube-api-access-lvv8c\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:48.750948 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.750929    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8b44\" (UniqueName: \"kubernetes.io/projected/bb89e80c-762c-462e-a309-ea754b8cbf88-kube-api-access-w8b44\") pod \"ingress-canary-vj5mn\" (UID: \"bb89e80c-762c-462e-a309-ea754b8cbf88\") " pod="openshift-ingress-canary/ingress-canary-vj5mn"
Jul 15 04:06:48.767790 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.767772    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vj5mn"
Jul 15 04:06:48.910590 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:48.910556    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vj5mn"]
Jul 15 04:06:48.918400 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:48.918370    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb89e80c_762c_462e_a309_ea754b8cbf88.slice/crio-5f9131ecf9883ff3911bf2e541b6769c8612a5eaa611f1998561bd320c587a77 WatchSource:0}: Error finding container 5f9131ecf9883ff3911bf2e541b6769c8612a5eaa611f1998561bd320c587a77: Status 404 returned error can't find the container with id 5f9131ecf9883ff3911bf2e541b6769c8612a5eaa611f1998561bd320c587a77
Jul 15 04:06:49.074039 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:49.074008    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:06:49.074216 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:49.074009    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:06:49.077173 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:49.077147    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 04:06:49.077173 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:49.077150    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 04:06:49.078281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:49.078263    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nc2gd\""
Jul 15 04:06:49.078383 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:49.078279    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rjwx\""
Jul 15 04:06:49.078383 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:49.078262    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 04:06:49.245352 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:49.245317    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:49.245533 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:49.245490    2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 04:06:49.245589 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:49.245580    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls podName:602469bc-8388-42c3-9fbc-0dd67634d59d nodeName:}" failed. No retries permitted until 2026-07-15 04:06:50.245556903 +0000 UTC m=+38.682483802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls") pod "dns-default-2f46c" (UID: "602469bc-8388-42c3-9fbc-0dd67634d59d") : secret "dns-default-metrics-tls" not found
Jul 15 04:06:49.407799 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:49.407711    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vj5mn" event={"ID":"bb89e80c-762c-462e-a309-ea754b8cbf88","Type":"ContainerStarted","Data":"5f9131ecf9883ff3911bf2e541b6769c8612a5eaa611f1998561bd320c587a77"}
Jul 15 04:06:50.074441 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:50.074404    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:06:50.077803 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:50.077781    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 04:06:50.252620 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:50.252587    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:50.252794 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:50.252718    2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 04:06:50.252855 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:50.252793    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls podName:602469bc-8388-42c3-9fbc-0dd67634d59d nodeName:}" failed. No retries permitted until 2026-07-15 04:06:52.252771284 +0000 UTC m=+40.689698160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls") pod "dns-default-2f46c" (UID: "602469bc-8388-42c3-9fbc-0dd67634d59d") : secret "dns-default-metrics-tls" not found
Jul 15 04:06:51.416162 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:51.415880    2539 generic.go:356] "Generic (PLEG): container finished" podID="6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1" containerID="4114a255b6eeb8b3ce5ffbb758e75c87480f3badfd8ee050ac346671c069f284" exitCode=0
Jul 15 04:06:51.416162 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:51.415965    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbdhv" event={"ID":"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1","Type":"ContainerDied","Data":"4114a255b6eeb8b3ce5ffbb758e75c87480f3badfd8ee050ac346671c069f284"}
Jul 15 04:06:52.265222 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:52.265191    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:52.265356 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:52.265335    2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 04:06:52.265412 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:52.265402    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls podName:602469bc-8388-42c3-9fbc-0dd67634d59d nodeName:}" failed. No retries permitted until 2026-07-15 04:06:56.265386803 +0000 UTC m=+44.702313677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls") pod "dns-default-2f46c" (UID: "602469bc-8388-42c3-9fbc-0dd67634d59d") : secret "dns-default-metrics-tls" not found
Jul 15 04:06:52.421009 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:52.420979    2539 generic.go:356] "Generic (PLEG): container finished" podID="6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1" containerID="8854ab456012a9d7558184cf18d4ab13d1946cc6a67364e110d2b223f1106902" exitCode=0
Jul 15 04:06:52.421429 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:52.421031    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbdhv" event={"ID":"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1","Type":"ContainerDied","Data":"8854ab456012a9d7558184cf18d4ab13d1946cc6a67364e110d2b223f1106902"}
Jul 15 04:06:53.426285 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:53.426248    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cbdhv" event={"ID":"6c45e3bb-097c-4dcc-b3ca-dcc2c98324c1","Type":"ContainerStarted","Data":"bb7e7235561e9102c926ccdf17a43de7ee1888d900f812067b9b8daae886e371"}
Jul 15 04:06:53.427605 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:53.427585    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vj5mn" event={"ID":"bb89e80c-762c-462e-a309-ea754b8cbf88","Type":"ContainerStarted","Data":"5e2713469d35181a4c385787ae90e1048d4fbfa31bbe8de06469832c05237734"}
Jul 15 04:06:53.450600 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:53.450560    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cbdhv" podStartSLOduration=9.292410333 podStartE2EDuration="41.450546971s" totalImagesPullingTime="32.158136638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:53.450191486 +0000 UTC m=+41.887118402" watchObservedRunningTime="2026-07-15 04:06:53.450546971 +0000 UTC m=+41.887473845"
Jul 15 04:06:53.464472 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:53.464436    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vj5mn" podStartSLOduration=1.7738830289999998 podStartE2EDuration="5.46442241s" totalImagesPullingTime="3.690539381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:53.464415542 +0000 UTC m=+41.901342440" watchObservedRunningTime="2026-07-15 04:06:53.46442241 +0000 UTC m=+41.901349311"
Jul 15 04:06:54.950584 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:54.950552    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-glc9h"]
Jul 15 04:06:54.981030 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:54.981007    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:54.981769 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:54.981753    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-glc9h"]
Jul 15 04:06:54.985029 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:54.985008    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 04:06:54.985029 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:54.985023    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 04:06:54.985201 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:54.985008    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 04:06:54.985936 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:54.985922    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 04:06:54.985999 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:54.985926    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tzsqp\""
Jul 15 04:06:55.085126 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.085099    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a165c47-5593-4a83-a357-c1443b1116cb-data-volume\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.085212 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.085135    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a165c47-5593-4a83-a357-c1443b1116cb-crio-socket\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.085212 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.085153    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.085212 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.085201    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.085304 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.085250    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5f7g\" (UniqueName: \"kubernetes.io/projected/9a165c47-5593-4a83-a357-c1443b1116cb-kube-api-access-d5f7g\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.185684 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.185663    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.185749 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.185690    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5f7g\" (UniqueName: \"kubernetes.io/projected/9a165c47-5593-4a83-a357-c1443b1116cb-kube-api-access-d5f7g\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.185749 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.185723    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a165c47-5593-4a83-a357-c1443b1116cb-data-volume\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.185749 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.185740    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a165c47-5593-4a83-a357-c1443b1116cb-crio-socket\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.185844 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.185773    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.185844 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:55.185824    2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 04:06:55.185916 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:55.185887    2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 04:06:55.185916 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.185895    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a165c47-5593-4a83-a357-c1443b1116cb-crio-socket\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.186005 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:55.185889    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls podName:9a165c47-5593-4a83-a357-c1443b1116cb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:55.685871322 +0000 UTC m=+44.122798223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-glc9h" (UID: "9a165c47-5593-4a83-a357-c1443b1116cb") : secret "insights-runtime-extractor-tls" not found
Jul 15 04:06:55.186005 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:55.185975    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm podName:9a165c47-5593-4a83-a357-c1443b1116cb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:55.685952779 +0000 UTC m=+44.122879670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-glc9h" (UID: "9a165c47-5593-4a83-a357-c1443b1116cb") : configmap "kube-rbac-proxy" not found
Jul 15 04:06:55.186077 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.186028    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a165c47-5593-4a83-a357-c1443b1116cb-data-volume\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.195641 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.195620    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5f7g\" (UniqueName: \"kubernetes.io/projected/9a165c47-5593-4a83-a357-c1443b1116cb-kube-api-access-d5f7g\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.689886 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.689854    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.690032 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.689908    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:55.690032 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:55.689980    2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 04:06:55.690032 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:55.689984    2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 04:06:55.690032 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:55.690025    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm podName:9a165c47-5593-4a83-a357-c1443b1116cb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:56.690014309 +0000 UTC m=+45.126941184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-glc9h" (UID: "9a165c47-5593-4a83-a357-c1443b1116cb") : configmap "kube-rbac-proxy" not found
Jul 15 04:06:55.690219 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:55.690043    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls podName:9a165c47-5593-4a83-a357-c1443b1116cb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:56.690031136 +0000 UTC m=+45.126958011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-glc9h" (UID: "9a165c47-5593-4a83-a357-c1443b1116cb") : secret "insights-runtime-extractor-tls" not found
Jul 15 04:06:55.770635 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.770604    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz"]
Jul 15 04:06:55.785011 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.784986    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz"]
Jul 15 04:06:55.785143 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.785074    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz"
Jul 15 04:06:55.787730 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.787711    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 04:06:55.788050 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.788031    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 04:06:55.788944 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.788925    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tv7zp\""
Jul 15 04:06:55.891122 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.891083    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfqjb\" (UniqueName: \"kubernetes.io/projected/64226c49-d311-4853-833e-ba1930439125-kube-api-access-vfqjb\") pod \"migrator-7f59b54f6c-nzbxz\" (UID: \"64226c49-d311-4853-833e-ba1930439125\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz"
Jul 15 04:06:55.991744 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.991695    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfqjb\" (UniqueName: \"kubernetes.io/projected/64226c49-d311-4853-833e-ba1930439125-kube-api-access-vfqjb\") pod \"migrator-7f59b54f6c-nzbxz\" (UID: \"64226c49-d311-4853-833e-ba1930439125\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz"
Jul 15 04:06:55.999384 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:55.999356    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfqjb\" (UniqueName: \"kubernetes.io/projected/64226c49-d311-4853-833e-ba1930439125-kube-api-access-vfqjb\") pod \"migrator-7f59b54f6c-nzbxz\" (UID: \"64226c49-d311-4853-833e-ba1930439125\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz"
Jul 15 04:06:56.094116 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:56.094083    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz"
Jul 15 04:06:56.230954 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:56.230812    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz"]
Jul 15 04:06:56.233316 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:06:56.233289    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64226c49_d311_4853_833e_ba1930439125.slice/crio-b554ec247f48f2d5ac332257e6467101c200e0aa095b27509e1a81086791549c WatchSource:0}: Error finding container b554ec247f48f2d5ac332257e6467101c200e0aa095b27509e1a81086791549c: Status 404 returned error can't find the container with id b554ec247f48f2d5ac332257e6467101c200e0aa095b27509e1a81086791549c
Jul 15 04:06:56.292881 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:56.292830    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:06:56.292984 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:56.292968    2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 04:06:56.293033 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:56.293024    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls podName:602469bc-8388-42c3-9fbc-0dd67634d59d nodeName:}" failed. No retries permitted until 2026-07-15 04:07:04.293008448 +0000 UTC m=+52.729935323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls") pod "dns-default-2f46c" (UID: "602469bc-8388-42c3-9fbc-0dd67634d59d") : secret "dns-default-metrics-tls" not found
Jul 15 04:06:56.435618 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:56.435585    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz" event={"ID":"64226c49-d311-4853-833e-ba1930439125","Type":"ContainerStarted","Data":"b554ec247f48f2d5ac332257e6467101c200e0aa095b27509e1a81086791549c"}
Jul 15 04:06:56.695850 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:56.695813    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:56.695998 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:56.695890    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:56.695998 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:56.695966    2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 04:06:56.695998 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:56.695983    2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 04:06:56.696112 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:56.696032    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls podName:9a165c47-5593-4a83-a357-c1443b1116cb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:58.696018555 +0000 UTC m=+47.132945433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-glc9h" (UID: "9a165c47-5593-4a83-a357-c1443b1116cb") : secret "insights-runtime-extractor-tls" not found
Jul 15 04:06:56.696112 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:56.696047    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm podName:9a165c47-5593-4a83-a357-c1443b1116cb nodeName:}" failed. No retries permitted until 2026-07-15 04:06:58.696041471 +0000 UTC m=+47.132968350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-glc9h" (UID: "9a165c47-5593-4a83-a357-c1443b1116cb") : configmap "kube-rbac-proxy" not found
Jul 15 04:06:57.238744 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:57.238721    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q7n7b_13ac8a6b-5743-4bec-b544-2da140a035d0/dns-node-resolver/0.log"
Jul 15 04:06:58.237293 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:58.237247    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dx75w_624ff61e-8c93-4956-b0a4-4b3782abaded/node-ca/0.log"
Jul 15 04:06:58.442920 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:58.442884    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz" event={"ID":"64226c49-d311-4853-833e-ba1930439125","Type":"ContainerStarted","Data":"2e63b865bd3dfe7809cd83f7de5a1757022aeb4671f00e32dacb995ef61d82a6"}
Jul 15 04:06:58.443329 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:58.442939    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz" event={"ID":"64226c49-d311-4853-833e-ba1930439125","Type":"ContainerStarted","Data":"a7ad1d32f026299583915d6611bf85756128997b80f070e85278e63d4741c41f"}
Jul 15 04:06:58.707594 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:58.707561    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:58.707740 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:58.707638    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:06:58.707740 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:58.707706    2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 04:06:58.707740 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:58.707728    2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 04:06:58.707882 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:58.707763    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls podName:9a165c47-5593-4a83-a357-c1443b1116cb nodeName:}" failed. No retries permitted until 2026-07-15 04:07:02.707749605 +0000 UTC m=+51.144676480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-glc9h" (UID: "9a165c47-5593-4a83-a357-c1443b1116cb") : secret "insights-runtime-extractor-tls" not found
Jul 15 04:06:58.707882 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:06:58.707777    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm podName:9a165c47-5593-4a83-a357-c1443b1116cb nodeName:}" failed. No retries permitted until 2026-07-15 04:07:02.707770429 +0000 UTC m=+51.144697304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-glc9h" (UID: "9a165c47-5593-4a83-a357-c1443b1116cb") : configmap "kube-rbac-proxy" not found
Jul 15 04:06:59.038105 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:06:59.038005    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vj5mn_bb89e80c-762c-462e-a309-ea754b8cbf88/serve-healthcheck-canary/0.log"
Jul 15 04:07:02.735009 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:02.734969    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:07:02.735428 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:02.735030    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:07:02.735428 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:07:02.735134    2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 04:07:02.735428 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:07:02.735149    2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 04:07:02.735428 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:07:02.735194    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm podName:9a165c47-5593-4a83-a357-c1443b1116cb nodeName:}" failed. No retries permitted until 2026-07-15 04:07:10.73518181 +0000 UTC m=+59.172108684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-glc9h" (UID: "9a165c47-5593-4a83-a357-c1443b1116cb") : configmap "kube-rbac-proxy" not found
Jul 15 04:07:02.735428 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:07:02.735214    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls podName:9a165c47-5593-4a83-a357-c1443b1116cb nodeName:}" failed. No retries permitted until 2026-07-15 04:07:10.735200205 +0000 UTC m=+59.172127080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-glc9h" (UID: "9a165c47-5593-4a83-a357-c1443b1116cb") : secret "insights-runtime-extractor-tls" not found
Jul 15 04:07:04.347080 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:04.347042    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:07:04.347456 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:07:04.347200    2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 04:07:04.347456 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:07:04.347260    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls podName:602469bc-8388-42c3-9fbc-0dd67634d59d nodeName:}" failed. No retries permitted until 2026-07-15 04:07:20.34724415 +0000 UTC m=+68.784171238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls") pod "dns-default-2f46c" (UID: "602469bc-8388-42c3-9fbc-0dd67634d59d") : secret "dns-default-metrics-tls" not found
Jul 15 04:07:10.792149 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:10.792076    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:07:10.792713 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:10.792186    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:07:10.792713 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:07:10.792227    2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 04:07:10.792713 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:07:10.792298    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls podName:9a165c47-5593-4a83-a357-c1443b1116cb nodeName:}" failed. No retries permitted until 2026-07-15 04:07:26.792281944 +0000 UTC m=+75.229208820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-glc9h" (UID: "9a165c47-5593-4a83-a357-c1443b1116cb") : secret "insights-runtime-extractor-tls" not found
Jul 15 04:07:10.792713 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:10.792636    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a165c47-5593-4a83-a357-c1443b1116cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:07:14.413111 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:14.413061    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dqkl6"
Jul 15 04:07:14.442536 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:14.442479    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-nzbxz" podStartSLOduration=17.695373118 podStartE2EDuration="19.442464871s" totalImagesPullingTime="1.747091753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:06:58.458018403 +0000 UTC m=+46.894945299" watchObservedRunningTime="2026-07-15 04:07:14.442464871 +0000 UTC m=+62.879391770"
Jul 15 04:07:16.834162 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.834124    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:07:16.834596 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.834179    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ggc\" (UniqueName: \"kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc\") pod \"network-check-target-dt2kv\" (UID: \"cbd6d3c3-1c04-4243-a133-06747bb45e10\") " pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:07:16.834596 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.834208    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:07:16.836968 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.836949    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 04:07:16.837942 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.837922    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 04:07:16.838042 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.837924    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 04:07:16.847147 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.847131    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8455199-dc31-493a-9fbd-fe6382eb83ee-original-pull-secret\") pod \"global-pull-secret-syncer-bkw6z\" (UID: \"a8455199-dc31-493a-9fbd-fe6382eb83ee\") " pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:07:16.847302 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.847283    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67a7872-e452-44f7-92e3-8afd1c0d18bb-metrics-certs\") pod \"network-metrics-daemon-vkw9q\" (UID: \"d67a7872-e452-44f7-92e3-8afd1c0d18bb\") " pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:07:16.847426 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.847414    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 04:07:16.857397 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.857379    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8ggc\" (UniqueName: \"kubernetes.io/projected/cbd6d3c3-1c04-4243-a133-06747bb45e10-kube-api-access-c8ggc\") pod \"network-check-target-dt2kv\" (UID: \"cbd6d3c3-1c04-4243-a133-06747bb45e10\") " pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:07:16.988232 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.988209    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rjwx\""
Jul 15 04:07:16.993510 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.993495    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nc2gd\""
Jul 15 04:07:16.996469 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:16.996456    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vkw9q"
Jul 15 04:07:17.002149 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:17.002132    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:07:17.084498 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:17.084440    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bkw6z"
Jul 15 04:07:17.125260 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:17.125170    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vkw9q"]
Jul 15 04:07:17.129160 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:07:17.129136    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67a7872_e452_44f7_92e3_8afd1c0d18bb.slice/crio-27711b4f2184f4b7ecaefb6964c68f59f0bc885215065ae08f4b84722a2f3cdd WatchSource:0}: Error finding container 27711b4f2184f4b7ecaefb6964c68f59f0bc885215065ae08f4b84722a2f3cdd: Status 404 returned error can't find the container with id 27711b4f2184f4b7ecaefb6964c68f59f0bc885215065ae08f4b84722a2f3cdd
Jul 15 04:07:17.136449 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:17.136415    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dt2kv"]
Jul 15 04:07:17.141287 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:07:17.141250    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd6d3c3_1c04_4243_a133_06747bb45e10.slice/crio-755a6b16381d2621b046d62a2fb12fb653801fe5a4191ca367ec25575aaa5538 WatchSource:0}: Error finding container 755a6b16381d2621b046d62a2fb12fb653801fe5a4191ca367ec25575aaa5538: Status 404 returned error can't find the container with id 755a6b16381d2621b046d62a2fb12fb653801fe5a4191ca367ec25575aaa5538
Jul 15 04:07:17.209542 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:17.209515    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bkw6z"]
Jul 15 04:07:17.213190 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:07:17.213166    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8455199_dc31_493a_9fbd_fe6382eb83ee.slice/crio-31fbc15bc3993b511b66608153789a7a98011d3662c69302c98870cdce425a32 WatchSource:0}: Error finding container 31fbc15bc3993b511b66608153789a7a98011d3662c69302c98870cdce425a32: Status 404 returned error can't find the container with id 31fbc15bc3993b511b66608153789a7a98011d3662c69302c98870cdce425a32
Jul 15 04:07:17.488875 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:17.488787    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vkw9q" event={"ID":"d67a7872-e452-44f7-92e3-8afd1c0d18bb","Type":"ContainerStarted","Data":"27711b4f2184f4b7ecaefb6964c68f59f0bc885215065ae08f4b84722a2f3cdd"}
Jul 15 04:07:17.490303 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:17.490266    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dt2kv" event={"ID":"cbd6d3c3-1c04-4243-a133-06747bb45e10","Type":"ContainerStarted","Data":"755a6b16381d2621b046d62a2fb12fb653801fe5a4191ca367ec25575aaa5538"}
Jul 15 04:07:17.491566 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:17.491522    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bkw6z" event={"ID":"a8455199-dc31-493a-9fbd-fe6382eb83ee","Type":"ContainerStarted","Data":"31fbc15bc3993b511b66608153789a7a98011d3662c69302c98870cdce425a32"}
Jul 15 04:07:18.497701 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.497175    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vkw9q" event={"ID":"d67a7872-e452-44f7-92e3-8afd1c0d18bb","Type":"ContainerStarted","Data":"fbcd6602cf916b9d9b0ecb60228ea0840fcc6f300c55d00d26469de68a5d81e2"}
Jul 15 04:07:18.497701 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.497241    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vkw9q" event={"ID":"d67a7872-e452-44f7-92e3-8afd1c0d18bb","Type":"ContainerStarted","Data":"39e7cf340ca2dfa2bcc0ba566961c7c19b819f94117df2055aeabbe40827154e"}
Jul 15 04:07:18.514127 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.514055    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vkw9q" podStartSLOduration=65.50898176 podStartE2EDuration="1m6.514037103s" totalImagesPullingTime="1.005055343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:18.512511791 +0000 UTC m=+66.949438689" watchObservedRunningTime="2026-07-15 04:07:18.514037103 +0000 UTC m=+66.950964001"
Jul 15 04:07:18.857890 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.857852    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"]
Jul 15 04:07:18.860011 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.859981    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"]
Jul 15 04:07:18.860345 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.860316    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:18.861892 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.861870    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:18.862919 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.862898    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 04:07:18.863055 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.862983    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 04:07:18.863055 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.863034    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 04:07:18.864182 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.864162    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 04:07:18.864284 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.864197    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 04:07:18.864426 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.864410    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 04:07:18.864494 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.864478    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 04:07:18.864557 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.864520    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 04:07:18.871477 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.871455    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"]
Jul 15 04:07:18.872262 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.872244    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"]
Jul 15 04:07:18.952319 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.952289    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-ca\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:18.952481 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.952329    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2z8w\" (UniqueName: \"kubernetes.io/projected/be7040bb-958b-4b70-aaaf-d1c24812a885-kube-api-access-q2z8w\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:18.952481 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.952362    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:18.952481 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.952384    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgdfn\" (UniqueName: \"kubernetes.io/projected/9b2ec9bc-ce26-4889-81ac-31a319d5feb3-kube-api-access-dgdfn\") pod \"klusterlet-addon-workmgr-fc788757d-bqws9\" (UID: \"9b2ec9bc-ce26-4889-81ac-31a319d5feb3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:18.952658 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.952497    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/be7040bb-958b-4b70-aaaf-d1c24812a885-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:18.952658 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.952558    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:18.952658 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.952587    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b2ec9bc-ce26-4889-81ac-31a319d5feb3-tmp\") pod \"klusterlet-addon-workmgr-fc788757d-bqws9\" (UID: \"9b2ec9bc-ce26-4889-81ac-31a319d5feb3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:18.952802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.952695    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-hub\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:18.952802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:18.952740    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9b2ec9bc-ce26-4889-81ac-31a319d5feb3-klusterlet-config\") pod \"klusterlet-addon-workmgr-fc788757d-bqws9\" (UID: \"9b2ec9bc-ce26-4889-81ac-31a319d5feb3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:19.053646 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.053609    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-ca\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.053825 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.053659    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2z8w\" (UniqueName: \"kubernetes.io/projected/be7040bb-958b-4b70-aaaf-d1c24812a885-kube-api-access-q2z8w\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.053825 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.053692    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.053825 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.053718    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdfn\" (UniqueName: \"kubernetes.io/projected/9b2ec9bc-ce26-4889-81ac-31a319d5feb3-kube-api-access-dgdfn\") pod \"klusterlet-addon-workmgr-fc788757d-bqws9\" (UID: \"9b2ec9bc-ce26-4889-81ac-31a319d5feb3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:19.053825 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.053768    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/be7040bb-958b-4b70-aaaf-d1c24812a885-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.053825 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.053817    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.054113 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.053841    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b2ec9bc-ce26-4889-81ac-31a319d5feb3-tmp\") pod \"klusterlet-addon-workmgr-fc788757d-bqws9\" (UID: \"9b2ec9bc-ce26-4889-81ac-31a319d5feb3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:19.054113 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.053879    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-hub\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.054113 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.053918    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9b2ec9bc-ce26-4889-81ac-31a319d5feb3-klusterlet-config\") pod \"klusterlet-addon-workmgr-fc788757d-bqws9\" (UID: \"9b2ec9bc-ce26-4889-81ac-31a319d5feb3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:19.054522 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.054495    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b2ec9bc-ce26-4889-81ac-31a319d5feb3-tmp\") pod \"klusterlet-addon-workmgr-fc788757d-bqws9\" (UID: \"9b2ec9bc-ce26-4889-81ac-31a319d5feb3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:19.055205 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.055174    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/be7040bb-958b-4b70-aaaf-d1c24812a885-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.057490 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.057464    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.057607 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.057506    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-ca\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.058461 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.058419    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-hub\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.058783 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.058751    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/be7040bb-958b-4b70-aaaf-d1c24812a885-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.060174 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.060153    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9b2ec9bc-ce26-4889-81ac-31a319d5feb3-klusterlet-config\") pod \"klusterlet-addon-workmgr-fc788757d-bqws9\" (UID: \"9b2ec9bc-ce26-4889-81ac-31a319d5feb3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:19.064331 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.064307    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2z8w\" (UniqueName: \"kubernetes.io/projected/be7040bb-958b-4b70-aaaf-d1c24812a885-kube-api-access-q2z8w\") pod \"cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j\" (UID: \"be7040bb-958b-4b70-aaaf-d1c24812a885\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.067548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.067503    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgdfn\" (UniqueName: \"kubernetes.io/projected/9b2ec9bc-ce26-4889-81ac-31a319d5feb3-kube-api-access-dgdfn\") pod \"klusterlet-addon-workmgr-fc788757d-bqws9\" (UID: \"9b2ec9bc-ce26-4889-81ac-31a319d5feb3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:19.183199 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.183116    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"
Jul 15 04:07:19.190447 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:19.190278    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:20.363438 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:20.363402    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:07:20.366070 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:20.366040    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/602469bc-8388-42c3-9fbc-0dd67634d59d-metrics-tls\") pod \"dns-default-2f46c\" (UID: \"602469bc-8388-42c3-9fbc-0dd67634d59d\") " pod="openshift-dns/dns-default-2f46c"
Jul 15 04:07:20.564924 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:20.564894    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2wv7r\""
Jul 15 04:07:20.572944 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:20.572922    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2f46c"
Jul 15 04:07:22.060375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:22.060348    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j"]
Jul 15 04:07:22.066068 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:07:22.066043    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe7040bb_958b_4b70_aaaf_d1c24812a885.slice/crio-e7c89706041eb5eb18f0c7ea3aab45060895635a5a5856517a788108855560be WatchSource:0}: Error finding container e7c89706041eb5eb18f0c7ea3aab45060895635a5a5856517a788108855560be: Status 404 returned error can't find the container with id e7c89706041eb5eb18f0c7ea3aab45060895635a5a5856517a788108855560be
Jul 15 04:07:22.280139 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:22.280045    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"]
Jul 15 04:07:22.283141 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:22.283121    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2f46c"]
Jul 15 04:07:22.284360 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:07:22.284335    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2ec9bc_ce26_4889_81ac_31a319d5feb3.slice/crio-f5d2b4e3bc86452700d8fa6b724ad637abc13d32d40a7efed40aff1d886e7300 WatchSource:0}: Error finding container f5d2b4e3bc86452700d8fa6b724ad637abc13d32d40a7efed40aff1d886e7300: Status 404 returned error can't find the container with id f5d2b4e3bc86452700d8fa6b724ad637abc13d32d40a7efed40aff1d886e7300
Jul 15 04:07:22.286048 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:07:22.286025    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602469bc_8388_42c3_9fbc_0dd67634d59d.slice/crio-26ce343c4e317d28f0e71812a7d86dcab5ad66a133665028d6a30a1e92cd17dc WatchSource:0}: Error finding container 26ce343c4e317d28f0e71812a7d86dcab5ad66a133665028d6a30a1e92cd17dc: Status 404 returned error can't find the container with id 26ce343c4e317d28f0e71812a7d86dcab5ad66a133665028d6a30a1e92cd17dc
Jul 15 04:07:22.510000 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:22.509968    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dt2kv" event={"ID":"cbd6d3c3-1c04-4243-a133-06747bb45e10","Type":"ContainerStarted","Data":"1b471cbd25cabc628f9dff2ab2f6b6e809344678acd6fa910c73d1b03198a812"}
Jul 15 04:07:22.510180 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:22.510124    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:07:22.511140 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:22.511118    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9" event={"ID":"9b2ec9bc-ce26-4889-81ac-31a319d5feb3","Type":"ContainerStarted","Data":"f5d2b4e3bc86452700d8fa6b724ad637abc13d32d40a7efed40aff1d886e7300"}
Jul 15 04:07:22.512414 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:22.512394    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bkw6z" event={"ID":"a8455199-dc31-493a-9fbd-fe6382eb83ee","Type":"ContainerStarted","Data":"319bbd6c67ddea941a3b5dc2492d61253f1f8e63096f9194275940b613e432a5"}
Jul 15 04:07:22.513532 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:22.513510    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j" event={"ID":"be7040bb-958b-4b70-aaaf-d1c24812a885","Type":"ContainerStarted","Data":"e7c89706041eb5eb18f0c7ea3aab45060895635a5a5856517a788108855560be"}
Jul 15 04:07:22.514574 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:22.514555    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2f46c" event={"ID":"602469bc-8388-42c3-9fbc-0dd67634d59d","Type":"ContainerStarted","Data":"26ce343c4e317d28f0e71812a7d86dcab5ad66a133665028d6a30a1e92cd17dc"}
Jul 15 04:07:22.525068 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:22.525022    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dt2kv" podStartSLOduration=65.763091859 podStartE2EDuration="1m10.525006067s" totalImagesPullingTime="4.761914208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:22.523686969 +0000 UTC m=+70.960613865" watchObservedRunningTime="2026-07-15 04:07:22.525006067 +0000 UTC m=+70.961932996"
Jul 15 04:07:22.538696 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:22.538627    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bkw6z" podStartSLOduration=65.834786711 podStartE2EDuration="1m10.538614869s" totalImagesPullingTime="4.703828158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:22.538394447 +0000 UTC m=+70.975321347" watchObservedRunningTime="2026-07-15 04:07:22.538614869 +0000 UTC m=+70.975541744"
Jul 15 04:07:26.816656 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:26.816609    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:07:26.819050 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:26.819016    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a165c47-5593-4a83-a357-c1443b1116cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-glc9h\" (UID: \"9a165c47-5593-4a83-a357-c1443b1116cb\") " pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:07:27.093224 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:27.093140    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tzsqp\""
Jul 15 04:07:27.100387 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:27.100360    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-glc9h"
Jul 15 04:07:27.870862 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:27.870832    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-glc9h"]
Jul 15 04:07:27.874760 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:07:27.874730    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a165c47_5593_4a83_a357_c1443b1116cb.slice/crio-e2a37841f9cb8fb39ba89bd956cb4a26f91dc03ed869b301d3cc9d419f3afd30 WatchSource:0}: Error finding container e2a37841f9cb8fb39ba89bd956cb4a26f91dc03ed869b301d3cc9d419f3afd30: Status 404 returned error can't find the container with id e2a37841f9cb8fb39ba89bd956cb4a26f91dc03ed869b301d3cc9d419f3afd30
Jul 15 04:07:28.541590 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.540560    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9" event={"ID":"9b2ec9bc-ce26-4889-81ac-31a319d5feb3","Type":"ContainerStarted","Data":"5c5a44f8c0019b228f37ebbc03cc9d224de37546e4ee64aaa2ae5618f2f014d3"}
Jul 15 04:07:28.541590 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.541546    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:28.546127 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.546066    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9"
Jul 15 04:07:28.551491 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.551460    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j" event={"ID":"be7040bb-958b-4b70-aaaf-d1c24812a885","Type":"ContainerStarted","Data":"610a635d16ef2a80a9b72f1145c86f93079753f258cf09b0898a588483d3b49d"}
Jul 15 04:07:28.551597 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.551506    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j" event={"ID":"be7040bb-958b-4b70-aaaf-d1c24812a885","Type":"ContainerStarted","Data":"00dec88f5d6a47ddbf7ba447902ddaf6e2a616457b98903e5d6d3f9131172f80"}
Jul 15 04:07:28.551597 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.551524    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j" event={"ID":"be7040bb-958b-4b70-aaaf-d1c24812a885","Type":"ContainerStarted","Data":"1143028e6f383b9d66ed6803c8e67a3f66122908cf535f73f08c84f429a118ef"}
Jul 15 04:07:28.554582 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.554557    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2f46c" event={"ID":"602469bc-8388-42c3-9fbc-0dd67634d59d","Type":"ContainerStarted","Data":"36ce093271ff323307f4d032447c2340c69ca358e0e8fced53651e9c4202b3fd"}
Jul 15 04:07:28.554705 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.554601    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2f46c" event={"ID":"602469bc-8388-42c3-9fbc-0dd67634d59d","Type":"ContainerStarted","Data":"ce3cace78d427da6d95f512e9b487d59bc869c49c020a4d93ce4436e94bc154c"}
Jul 15 04:07:28.555077 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.555031    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2f46c"
Jul 15 04:07:28.556333 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.556310    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glc9h" event={"ID":"9a165c47-5593-4a83-a357-c1443b1116cb","Type":"ContainerStarted","Data":"e2a37841f9cb8fb39ba89bd956cb4a26f91dc03ed869b301d3cc9d419f3afd30"}
Jul 15 04:07:28.559402 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.559358    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fc788757d-bqws9" podStartSLOduration=5.125671009 podStartE2EDuration="10.55934204s" totalImagesPullingTime="5.433671031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:28.558577571 +0000 UTC m=+76.995504468" watchObservedRunningTime="2026-07-15 04:07:28.55934204 +0000 UTC m=+76.996268934"
Jul 15 04:07:28.597082 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.597032    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2f46c" podStartSLOduration=35.17796559 podStartE2EDuration="40.597013679s" totalImagesPullingTime="5.419048089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:28.595765819 +0000 UTC m=+77.032692728" watchObservedRunningTime="2026-07-15 04:07:28.597013679 +0000 UTC m=+77.033940580"
Jul 15 04:07:28.612454 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:28.612392    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cdb7c8c7-jmz4j" podStartSLOduration=4.95237286 podStartE2EDuration="10.61238063s" totalImagesPullingTime="5.66000777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:28.612151249 +0000 UTC m=+77.049078145" watchObservedRunningTime="2026-07-15 04:07:28.61238063 +0000 UTC m=+77.049307518"
Jul 15 04:07:32.574067 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:32.574032    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glc9h" event={"ID":"9a165c47-5593-4a83-a357-c1443b1116cb","Type":"ContainerStarted","Data":"04b8e3c651c622e3c1a1213dff35cee30eb2338c717fe2c176fe8a9bb12ab1a5"}
Jul 15 04:07:32.574408 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:32.574140    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glc9h" event={"ID":"9a165c47-5593-4a83-a357-c1443b1116cb","Type":"ContainerStarted","Data":"219657388e5b163c037643aa35101defd3465fd3d295c359c304e4fc3fe993dd"}
Jul 15 04:07:35.587643 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:35.587601    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-glc9h" event={"ID":"9a165c47-5593-4a83-a357-c1443b1116cb","Type":"ContainerStarted","Data":"d391bbe457fc73d662081f833dec6936308ba93a1fad13d2afa7edbaa5c0326b"}
Jul 15 04:07:35.607926 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:35.607876    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-glc9h" podStartSLOduration=34.864429537 podStartE2EDuration="41.607859422s" totalImagesPullingTime="6.743429885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:06:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:35.607118033 +0000 UTC m=+84.044044931" watchObservedRunningTime="2026-07-15 04:07:35.607859422 +0000 UTC m=+84.044786320"
Jul 15 04:07:39.568398 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:39.568361    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2f46c"
Jul 15 04:07:42.687996 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.687958    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jsttq"]
Jul 15 04:07:42.692448 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.692431    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.694998 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.694976    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 04:07:42.695142 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.694998    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 04:07:42.695142 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.695012    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 04:07:42.695142 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.695029    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 04:07:42.696293 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.696275    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 04:07:42.696388 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.696311    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5l45x\""
Jul 15 04:07:42.696388 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.696337    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 04:07:42.820084 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.820061    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-tls\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.820209 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.820107    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bd27d8a-9357-45f5-afa4-e271727f5bba-root\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.820209 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.820138    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-textfile\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.820209 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.820167    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-accelerators-collector-config\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.820209 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.820192    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd27d8a-9357-45f5-afa4-e271727f5bba-metrics-client-ca\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.820330 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.820232    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-wtmp\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.820330 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.820290    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bd27d8a-9357-45f5-afa4-e271727f5bba-sys\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.820330 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.820316    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.820418 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.820335    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svbhx\" (UniqueName: \"kubernetes.io/projected/9bd27d8a-9357-45f5-afa4-e271727f5bba-kube-api-access-svbhx\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921138 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.920975    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bd27d8a-9357-45f5-afa4-e271727f5bba-sys\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921138 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921019    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921138 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921044    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svbhx\" (UniqueName: \"kubernetes.io/projected/9bd27d8a-9357-45f5-afa4-e271727f5bba-kube-api-access-svbhx\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921138 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921069    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bd27d8a-9357-45f5-afa4-e271727f5bba-sys\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921138 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921080    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-tls\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921469 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921175    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bd27d8a-9357-45f5-afa4-e271727f5bba-root\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921469 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921202    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-textfile\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921469 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921246    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-accelerators-collector-config\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921469 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921270    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd27d8a-9357-45f5-afa4-e271727f5bba-metrics-client-ca\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921469 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921299    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-wtmp\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921469 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921317    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bd27d8a-9357-45f5-afa4-e271727f5bba-root\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921469 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:07:42.921325    2539 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 04:07:42.921469 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:07:42.921412    2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-tls podName:9bd27d8a-9357-45f5-afa4-e271727f5bba nodeName:}" failed. No retries permitted until 2026-07-15 04:07:43.421391228 +0000 UTC m=+91.858318103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-tls") pod "node-exporter-jsttq" (UID: "9bd27d8a-9357-45f5-afa4-e271727f5bba") : secret "node-exporter-tls" not found
Jul 15 04:07:42.921469 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921461    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-wtmp\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.921885 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.921680    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-textfile\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.922040 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.922019    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bd27d8a-9357-45f5-afa4-e271727f5bba-metrics-client-ca\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.922165 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.922027    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-accelerators-collector-config\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.923469 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.923443    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:42.931818 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:42.931796    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svbhx\" (UniqueName: \"kubernetes.io/projected/9bd27d8a-9357-45f5-afa4-e271727f5bba-kube-api-access-svbhx\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:43.425310 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:43.425278    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-tls\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:43.427559 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:43.427542    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bd27d8a-9357-45f5-afa4-e271727f5bba-node-exporter-tls\") pod \"node-exporter-jsttq\" (UID: \"9bd27d8a-9357-45f5-afa4-e271727f5bba\") " pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:43.601756 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:43.601710    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jsttq"
Jul 15 04:07:43.614324 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:07:43.614290    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd27d8a_9357_45f5_afa4_e271727f5bba.slice/crio-7cc0f8e5d45b292deb804b764a68ef9fbd9478589bd8392c2094097fa5ccf2ec WatchSource:0}: Error finding container 7cc0f8e5d45b292deb804b764a68ef9fbd9478589bd8392c2094097fa5ccf2ec: Status 404 returned error can't find the container with id 7cc0f8e5d45b292deb804b764a68ef9fbd9478589bd8392c2094097fa5ccf2ec
Jul 15 04:07:44.615711 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:44.615687    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jsttq" event={"ID":"9bd27d8a-9357-45f5-afa4-e271727f5bba","Type":"ContainerStarted","Data":"7cc0f8e5d45b292deb804b764a68ef9fbd9478589bd8392c2094097fa5ccf2ec"}
Jul 15 04:07:45.620658 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:45.620616    2539 generic.go:356] "Generic (PLEG): container finished" podID="9bd27d8a-9357-45f5-afa4-e271727f5bba" containerID="d996709375dd0e8cccd1e131035bb95a774841d7494669a0658001b507b1add8" exitCode=0
Jul 15 04:07:45.620658 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:45.620652    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jsttq" event={"ID":"9bd27d8a-9357-45f5-afa4-e271727f5bba","Type":"ContainerDied","Data":"d996709375dd0e8cccd1e131035bb95a774841d7494669a0658001b507b1add8"}
Jul 15 04:07:46.625962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:46.625922    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jsttq" event={"ID":"9bd27d8a-9357-45f5-afa4-e271727f5bba","Type":"ContainerStarted","Data":"37efebbc9291339d5a5fec8bac26ac286a661cd1760f61a0e294d1267910aa01"}
Jul 15 04:07:46.626410 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:46.625985    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jsttq" event={"ID":"9bd27d8a-9357-45f5-afa4-e271727f5bba","Type":"ContainerStarted","Data":"18c8fce0c2a566d068585782aab619ca527b79c3ab38b80fbfd2ec531ac7e35b"}
Jul 15 04:07:46.649017 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:46.648964    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jsttq" podStartSLOduration=3.6102460450000002 podStartE2EDuration="4.648949504s" totalImagesPullingTime="968.530704ms" totalInitContainerRuntime="70.172755ms" isStatefulPod=true podCreationTimestamp="2026-07-15 04:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:07:46.648879267 +0000 UTC m=+95.085806163" watchObservedRunningTime="2026-07-15 04:07:46.648949504 +0000 UTC m=+95.085876379"
Jul 15 04:07:53.521168 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:07:53.521136    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dt2kv"
Jul 15 04:08:15.440227 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:08:15.440201    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vj5mn_bb89e80c-762c-462e-a309-ea754b8cbf88/serve-healthcheck-canary/0.log"
Jul 15 04:11:11.947267 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:11:11.947239    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:11:11.948135 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:11:11.948117    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:11:11.953961 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:11:11.953943    2539 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 04:12:06.529501 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.529414    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4"]
Jul 15 04:12:06.532567 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.532546    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4"
Jul 15 04:12:06.535263 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.535233    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dmq2r\""
Jul 15 04:12:06.535366 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.535281    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 04:12:06.535366 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.535310    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 04:12:06.543224 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.543203    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4"]
Jul 15 04:12:06.606746 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.606716    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjf9m\" (UniqueName: \"kubernetes.io/projected/e0fee1fc-1cef-4132-a0ae-31a595c30107-kube-api-access-cjf9m\") pod \"cert-manager-cainjector-559cdd8c87-qfbv4\" (UID: \"e0fee1fc-1cef-4132-a0ae-31a595c30107\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4"
Jul 15 04:12:06.606850 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.606752    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0fee1fc-1cef-4132-a0ae-31a595c30107-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qfbv4\" (UID: \"e0fee1fc-1cef-4132-a0ae-31a595c30107\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4"
Jul 15 04:12:06.707252 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.707218    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjf9m\" (UniqueName: \"kubernetes.io/projected/e0fee1fc-1cef-4132-a0ae-31a595c30107-kube-api-access-cjf9m\") pod \"cert-manager-cainjector-559cdd8c87-qfbv4\" (UID: \"e0fee1fc-1cef-4132-a0ae-31a595c30107\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4"
Jul 15 04:12:06.707343 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.707262    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0fee1fc-1cef-4132-a0ae-31a595c30107-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qfbv4\" (UID: \"e0fee1fc-1cef-4132-a0ae-31a595c30107\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4"
Jul 15 04:12:06.715965 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.715944    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0fee1fc-1cef-4132-a0ae-31a595c30107-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qfbv4\" (UID: \"e0fee1fc-1cef-4132-a0ae-31a595c30107\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4"
Jul 15 04:12:06.716058 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.716010    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjf9m\" (UniqueName: \"kubernetes.io/projected/e0fee1fc-1cef-4132-a0ae-31a595c30107-kube-api-access-cjf9m\") pod \"cert-manager-cainjector-559cdd8c87-qfbv4\" (UID: \"e0fee1fc-1cef-4132-a0ae-31a595c30107\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4"
Jul 15 04:12:06.841687 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.841664    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4"
Jul 15 04:12:06.962585 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.962516    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4"]
Jul 15 04:12:06.965064 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:12:06.965032    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0fee1fc_1cef_4132_a0ae_31a595c30107.slice/crio-6db4a8d79fd8a7a6d79f2a65fa4a3ac56928f58f7a36ed8bc6cc0aff8a1fb5b1 WatchSource:0}: Error finding container 6db4a8d79fd8a7a6d79f2a65fa4a3ac56928f58f7a36ed8bc6cc0aff8a1fb5b1: Status 404 returned error can't find the container with id 6db4a8d79fd8a7a6d79f2a65fa4a3ac56928f58f7a36ed8bc6cc0aff8a1fb5b1
Jul 15 04:12:06.966944 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:06.966927    2539 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 04:12:07.428678 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:07.428643    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4" event={"ID":"e0fee1fc-1cef-4132-a0ae-31a595c30107","Type":"ContainerStarted","Data":"6db4a8d79fd8a7a6d79f2a65fa4a3ac56928f58f7a36ed8bc6cc0aff8a1fb5b1"}
Jul 15 04:12:10.442300 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:10.442213    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4" event={"ID":"e0fee1fc-1cef-4132-a0ae-31a595c30107","Type":"ContainerStarted","Data":"94e90abde9ed44ebd7f22fc4dded3641430f1693613a6bb0abf19070442e7e9f"}
Jul 15 04:12:10.457174 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:10.457129    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qfbv4" podStartSLOduration=1.375919578 podStartE2EDuration="4.457113891s" totalImagesPullingTime="3.081194313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:12:10.45632719 +0000 UTC m=+358.893254087" watchObservedRunningTime="2026-07-15 04:12:10.457113891 +0000 UTC m=+358.894040788"
Jul 15 04:12:44.868726 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:44.868691    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"]
Jul 15 04:12:44.873008 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:44.872990    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:44.884585 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:44.884562    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 04:12:44.884689 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:44.884588    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 04:12:44.884844 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:44.884826    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 04:12:44.884890 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:44.884835    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5c9wl\""
Jul 15 04:12:44.884992 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:44.884977    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 04:12:44.892932 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:44.892912    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"]
Jul 15 04:12:45.058733 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.058705    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31f2d3a4-c275-44b3-8d5c-57974489c23c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.058913 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.058740    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkcqg\" (UniqueName: \"kubernetes.io/projected/31f2d3a4-c275-44b3-8d5c-57974489c23c-kube-api-access-wkcqg\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.058913 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.058763    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31f2d3a4-c275-44b3-8d5c-57974489c23c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.058913 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.058831    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f2d3a4-c275-44b3-8d5c-57974489c23c-tmp\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.058913 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.058875    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31f2d3a4-c275-44b3-8d5c-57974489c23c-manifests\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.159500 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.159433    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31f2d3a4-c275-44b3-8d5c-57974489c23c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.159500 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.159469    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkcqg\" (UniqueName: \"kubernetes.io/projected/31f2d3a4-c275-44b3-8d5c-57974489c23c-kube-api-access-wkcqg\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.159666 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.159500    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31f2d3a4-c275-44b3-8d5c-57974489c23c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.159666 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.159529    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f2d3a4-c275-44b3-8d5c-57974489c23c-tmp\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.159666 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.159552    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31f2d3a4-c275-44b3-8d5c-57974489c23c-manifests\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.159954 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.159930    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31f2d3a4-c275-44b3-8d5c-57974489c23c-manifests\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.161813 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.161785    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f2d3a4-c275-44b3-8d5c-57974489c23c-tmp\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.162013 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.161996    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31f2d3a4-c275-44b3-8d5c-57974489c23c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.162199 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.162178    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31f2d3a4-c275-44b3-8d5c-57974489c23c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.168532 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.168514    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkcqg\" (UniqueName: \"kubernetes.io/projected/31f2d3a4-c275-44b3-8d5c-57974489c23c-kube-api-access-wkcqg\") pod \"opendatahub-operator-controller-manager-6dddd85b7f-2llpz\" (UID: \"31f2d3a4-c275-44b3-8d5c-57974489c23c\") " pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.182779 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.182762    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:45.309416 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.309385    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"]
Jul 15 04:12:45.312655 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:12:45.312633    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f2d3a4_c275_44b3_8d5c_57974489c23c.slice/crio-a34e497ac442dcb76aef11eba678cdab922047d7610ced3df2608ded96d6553c WatchSource:0}: Error finding container a34e497ac442dcb76aef11eba678cdab922047d7610ced3df2608ded96d6553c: Status 404 returned error can't find the container with id a34e497ac442dcb76aef11eba678cdab922047d7610ced3df2608ded96d6553c
Jul 15 04:12:45.554282 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:45.554243    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz" event={"ID":"31f2d3a4-c275-44b3-8d5c-57974489c23c","Type":"ContainerStarted","Data":"a34e497ac442dcb76aef11eba678cdab922047d7610ced3df2608ded96d6553c"}
Jul 15 04:12:48.567383 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:48.567351    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz" event={"ID":"31f2d3a4-c275-44b3-8d5c-57974489c23c","Type":"ContainerStarted","Data":"87b0392ec80871b3fc42427a3a55e2e8555eabcbe68a1e9487604b0928a078bc"}
Jul 15 04:12:49.572382 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:49.572348    2539 generic.go:356] "Generic (PLEG): container finished" podID="31f2d3a4-c275-44b3-8d5c-57974489c23c" containerID="87b0392ec80871b3fc42427a3a55e2e8555eabcbe68a1e9487604b0928a078bc" exitCode=0
Jul 15 04:12:49.572759 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:49.572444    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz" event={"ID":"31f2d3a4-c275-44b3-8d5c-57974489c23c","Type":"ContainerDied","Data":"87b0392ec80871b3fc42427a3a55e2e8555eabcbe68a1e9487604b0928a078bc"}
Jul 15 04:12:50.577917 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:50.577878    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz" event={"ID":"31f2d3a4-c275-44b3-8d5c-57974489c23c","Type":"ContainerStarted","Data":"d3e03648cfc955979979b8383a6960b201764d51c1c1ebb5553d5fae80b5779c"}
Jul 15 04:12:50.578375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:50.578015    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:12:50.600519 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:12:50.600466    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz" podStartSLOduration=2.024562053 podStartE2EDuration="6.600448378s" totalImagesPullingTime="3.532982956s" totalInitContainerRuntime="1.042903369s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:12:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:12:50.598729768 +0000 UTC m=+399.035656689" watchObservedRunningTime="2026-07-15 04:12:50.600448378 +0000 UTC m=+399.037375277"
Jul 15 04:13:01.583174 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:01.583141    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dddd85b7f-2llpz"
Jul 15 04:13:05.175574 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.175543    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nc6fk"]
Jul 15 04:13:05.179857 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.179841    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk"
Jul 15 04:13:05.182517 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.182490    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 04:13:05.182650 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.182568    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-s25cm\""
Jul 15 04:13:05.189442 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.189414    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nc6fk"]
Jul 15 04:13:05.289651 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.289614    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbg8q\" (UniqueName: \"kubernetes.io/projected/f37696e7-622f-4ab8-b9b5-013522581af4-kube-api-access-hbg8q\") pod \"model-serving-api-54d89bd5fc-nc6fk\" (UID: \"f37696e7-622f-4ab8-b9b5-013522581af4\") " pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk"
Jul 15 04:13:05.289821 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.289661    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f37696e7-622f-4ab8-b9b5-013522581af4-tls-certs\") pod \"model-serving-api-54d89bd5fc-nc6fk\" (UID: \"f37696e7-622f-4ab8-b9b5-013522581af4\") " pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk"
Jul 15 04:13:05.391028 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.390986    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbg8q\" (UniqueName: \"kubernetes.io/projected/f37696e7-622f-4ab8-b9b5-013522581af4-kube-api-access-hbg8q\") pod \"model-serving-api-54d89bd5fc-nc6fk\" (UID: \"f37696e7-622f-4ab8-b9b5-013522581af4\") " pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk"
Jul 15 04:13:05.391220 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.391041    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f37696e7-622f-4ab8-b9b5-013522581af4-tls-certs\") pod \"model-serving-api-54d89bd5fc-nc6fk\" (UID: \"f37696e7-622f-4ab8-b9b5-013522581af4\") " pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk"
Jul 15 04:13:05.393664 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.393638    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f37696e7-622f-4ab8-b9b5-013522581af4-tls-certs\") pod \"model-serving-api-54d89bd5fc-nc6fk\" (UID: \"f37696e7-622f-4ab8-b9b5-013522581af4\") " pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk"
Jul 15 04:13:05.401072 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.401042    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbg8q\" (UniqueName: \"kubernetes.io/projected/f37696e7-622f-4ab8-b9b5-013522581af4-kube-api-access-hbg8q\") pod \"model-serving-api-54d89bd5fc-nc6fk\" (UID: \"f37696e7-622f-4ab8-b9b5-013522581af4\") " pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk"
Jul 15 04:13:05.491256 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.491149    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk"
Jul 15 04:13:05.621221 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.621124    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nc6fk"]
Jul 15 04:13:05.623408 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:13:05.623380    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37696e7_622f_4ab8_b9b5_013522581af4.slice/crio-49c0b4a91be734f1ad9d9d79298b6e10327400b75221b7784db76ee609f97adf WatchSource:0}: Error finding container 49c0b4a91be734f1ad9d9d79298b6e10327400b75221b7784db76ee609f97adf: Status 404 returned error can't find the container with id 49c0b4a91be734f1ad9d9d79298b6e10327400b75221b7784db76ee609f97adf
Jul 15 04:13:05.632336 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:05.632312    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk" event={"ID":"f37696e7-622f-4ab8-b9b5-013522581af4","Type":"ContainerStarted","Data":"49c0b4a91be734f1ad9d9d79298b6e10327400b75221b7784db76ee609f97adf"}
Jul 15 04:13:08.644190 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:08.644153    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk" event={"ID":"f37696e7-622f-4ab8-b9b5-013522581af4","Type":"ContainerStarted","Data":"ad26de6d317f6058081cd199000259c410cbd330c8b1cf410f18eeeae3e5fec1"}
Jul 15 04:13:08.644613 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:08.644316    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk"
Jul 15 04:13:08.660961 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:08.660910    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk" podStartSLOduration=1.533021788 podStartE2EDuration="3.660895362s" totalImagesPullingTime="2.127873574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:13:08.660381119 +0000 UTC m=+417.097308027" watchObservedRunningTime="2026-07-15 04:13:08.660895362 +0000 UTC m=+417.097822259"
Jul 15 04:13:09.674565 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.674531    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"]
Jul 15 04:13:09.677139 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.677124    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"
Jul 15 04:13:09.682482 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.682458    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 04:13:09.683646 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.683622    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-q9vx4\""
Jul 15 04:13:09.683797 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.683668    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 04:13:09.683884 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.683724    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 04:13:09.683884 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.683744    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 04:13:09.689533 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.689508    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"]
Jul 15 04:13:09.723269 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.723238    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a40edc1e-8a07-4941-b46c-86d0e7e42626-tls-certs\") pod \"kube-auth-proxy-b8bc8694c-vq8lv\" (UID: \"a40edc1e-8a07-4941-b46c-86d0e7e42626\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"
Jul 15 04:13:09.723406 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.723291    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c6gq\" (UniqueName: \"kubernetes.io/projected/a40edc1e-8a07-4941-b46c-86d0e7e42626-kube-api-access-9c6gq\") pod \"kube-auth-proxy-b8bc8694c-vq8lv\" (UID: \"a40edc1e-8a07-4941-b46c-86d0e7e42626\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"
Jul 15 04:13:09.723406 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.723358    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a40edc1e-8a07-4941-b46c-86d0e7e42626-tmp\") pod \"kube-auth-proxy-b8bc8694c-vq8lv\" (UID: \"a40edc1e-8a07-4941-b46c-86d0e7e42626\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"
Jul 15 04:13:09.824655 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.824625    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a40edc1e-8a07-4941-b46c-86d0e7e42626-tls-certs\") pod \"kube-auth-proxy-b8bc8694c-vq8lv\" (UID: \"a40edc1e-8a07-4941-b46c-86d0e7e42626\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"
Jul 15 04:13:09.824800 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.824664    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c6gq\" (UniqueName: \"kubernetes.io/projected/a40edc1e-8a07-4941-b46c-86d0e7e42626-kube-api-access-9c6gq\") pod \"kube-auth-proxy-b8bc8694c-vq8lv\" (UID: \"a40edc1e-8a07-4941-b46c-86d0e7e42626\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"
Jul 15 04:13:09.824800 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.824698    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a40edc1e-8a07-4941-b46c-86d0e7e42626-tmp\") pod \"kube-auth-proxy-b8bc8694c-vq8lv\" (UID: \"a40edc1e-8a07-4941-b46c-86d0e7e42626\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"
Jul 15 04:13:09.826962 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.826935    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a40edc1e-8a07-4941-b46c-86d0e7e42626-tmp\") pod \"kube-auth-proxy-b8bc8694c-vq8lv\" (UID: \"a40edc1e-8a07-4941-b46c-86d0e7e42626\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"
Jul 15 04:13:09.827164 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.827146    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a40edc1e-8a07-4941-b46c-86d0e7e42626-tls-certs\") pod \"kube-auth-proxy-b8bc8694c-vq8lv\" (UID: \"a40edc1e-8a07-4941-b46c-86d0e7e42626\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"
Jul 15 04:13:09.832841 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.832821    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c6gq\" (UniqueName: \"kubernetes.io/projected/a40edc1e-8a07-4941-b46c-86d0e7e42626-kube-api-access-9c6gq\") pod \"kube-auth-proxy-b8bc8694c-vq8lv\" (UID: \"a40edc1e-8a07-4941-b46c-86d0e7e42626\") " pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"
Jul 15 04:13:09.988146 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:09.988039    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"
Jul 15 04:13:10.119978 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.119945    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv"]
Jul 15 04:13:10.122752 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:13:10.122706    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40edc1e_8a07_4941_b46c_86d0e7e42626.slice/crio-374809c5a0c26f5552e2ba35b57c23ea2c5d77382edaed28d5b4108a55125725 WatchSource:0}: Error finding container 374809c5a0c26f5552e2ba35b57c23ea2c5d77382edaed28d5b4108a55125725: Status 404 returned error can't find the container with id 374809c5a0c26f5552e2ba35b57c23ea2c5d77382edaed28d5b4108a55125725
Jul 15 04:13:10.379146 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.379113    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"]
Jul 15 04:13:10.383444 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.383419    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.386212 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.386191    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 04:13:10.386335 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.386222    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 04:13:10.387409 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.387386    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 04:13:10.387542 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.387453    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 04:13:10.387542 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.387473    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w6j9x\""
Jul 15 04:13:10.387707 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.387689    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 04:13:10.398795 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.398775    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"]
Jul 15 04:13:10.429018 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.428993    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh4qj\" (UniqueName: \"kubernetes.io/projected/5e4203d8-125e-48a7-9238-b0d6a36eb099-kube-api-access-fh4qj\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.429145 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.429036    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e4203d8-125e-48a7-9238-b0d6a36eb099-manager-config\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.429145 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.429121    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e4203d8-125e-48a7-9238-b0d6a36eb099-cert\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.429242 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.429152    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e4203d8-125e-48a7-9238-b0d6a36eb099-metrics-cert\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.530307 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.530269    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh4qj\" (UniqueName: \"kubernetes.io/projected/5e4203d8-125e-48a7-9238-b0d6a36eb099-kube-api-access-fh4qj\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.530428 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.530327    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e4203d8-125e-48a7-9238-b0d6a36eb099-manager-config\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.530428 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.530375    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e4203d8-125e-48a7-9238-b0d6a36eb099-cert\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.530428 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.530402    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e4203d8-125e-48a7-9238-b0d6a36eb099-metrics-cert\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.530929 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.530911    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5e4203d8-125e-48a7-9238-b0d6a36eb099-manager-config\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.532906 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.532884    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e4203d8-125e-48a7-9238-b0d6a36eb099-metrics-cert\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.532977 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.532914    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e4203d8-125e-48a7-9238-b0d6a36eb099-cert\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.548595 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.548572    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh4qj\" (UniqueName: \"kubernetes.io/projected/5e4203d8-125e-48a7-9238-b0d6a36eb099-kube-api-access-fh4qj\") pod \"lws-controller-manager-c845c8db6-4q4wm\" (UID: \"5e4203d8-125e-48a7-9238-b0d6a36eb099\") " pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.652560 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.652499    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv" event={"ID":"a40edc1e-8a07-4941-b46c-86d0e7e42626","Type":"ContainerStarted","Data":"374809c5a0c26f5552e2ba35b57c23ea2c5d77382edaed28d5b4108a55125725"}
Jul 15 04:13:10.693358 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.693333    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:10.819487 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:10.819403    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"]
Jul 15 04:13:10.821389 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:13:10.821362    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4203d8_125e_48a7_9238_b0d6a36eb099.slice/crio-b1885256a277c120398fc0e8edf27a7a72fdfafa20e610e655a2f57119adc55e WatchSource:0}: Error finding container b1885256a277c120398fc0e8edf27a7a72fdfafa20e610e655a2f57119adc55e: Status 404 returned error can't find the container with id b1885256a277c120398fc0e8edf27a7a72fdfafa20e610e655a2f57119adc55e
Jul 15 04:13:11.657039 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:11.657005    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm" event={"ID":"5e4203d8-125e-48a7-9238-b0d6a36eb099","Type":"ContainerStarted","Data":"b1885256a277c120398fc0e8edf27a7a72fdfafa20e610e655a2f57119adc55e"}
Jul 15 04:13:14.391935 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:14.391911    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 04:13:14.670899 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:14.670812    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv" event={"ID":"a40edc1e-8a07-4941-b46c-86d0e7e42626","Type":"ContainerStarted","Data":"27d62237d091d0cd1ac6f49fd5a9aaeb1e01ddd4a60c8000ce5190c8b0b43d0b"}
Jul 15 04:13:14.672267 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:14.672233    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm" event={"ID":"5e4203d8-125e-48a7-9238-b0d6a36eb099","Type":"ContainerStarted","Data":"f08a382bfc88ff042e6b6422428ff7cbec322a8030031ed8dd01edb881b7021b"}
Jul 15 04:13:14.672400 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:14.672303    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:13:14.701886 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:14.701842    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b8bc8694c-vq8lv" podStartSLOduration=1.444386608 podStartE2EDuration="5.701829153s" totalImagesPullingTime="4.257442545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:13:14.699989666 +0000 UTC m=+423.136916555" watchObservedRunningTime="2026-07-15 04:13:14.701829153 +0000 UTC m=+423.138756050"
Jul 15 04:13:14.733682 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:14.733623    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm" podStartSLOduration=1.177430652 podStartE2EDuration="4.733606033s" totalImagesPullingTime="3.556175381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:13:14.732696125 +0000 UTC m=+423.169623022" watchObservedRunningTime="2026-07-15 04:13:14.733606033 +0000 UTC m=+423.170533123"
Jul 15 04:13:19.652150 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:19.652116    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-nc6fk"
Jul 15 04:13:25.677771 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:13:25.677743    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c845c8db6-4q4wm"
Jul 15 04:14:59.759441 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.759402    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"]
Jul 15 04:14:59.761698 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.761674    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"
Jul 15 04:14:59.764143 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.764120    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 04:14:59.764244 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.764165    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qzv8h\""
Jul 15 04:14:59.764244 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.764186    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 04:14:59.765412 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.765396    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 04:14:59.765489 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.765400    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 04:14:59.769934 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.769915    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"]
Jul 15 04:14:59.789718 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.789696    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ae64373-f614-4473-9fe3-f1a2180d573b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-p6qhq\" (UID: \"2ae64373-f614-4473-9fe3-f1a2180d573b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"
Jul 15 04:14:59.789803 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.789737    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ae64373-f614-4473-9fe3-f1a2180d573b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-p6qhq\" (UID: \"2ae64373-f614-4473-9fe3-f1a2180d573b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"
Jul 15 04:14:59.789803 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.789763    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbkgd\" (UniqueName: \"kubernetes.io/projected/2ae64373-f614-4473-9fe3-f1a2180d573b-kube-api-access-rbkgd\") pod \"kuadrant-console-plugin-66b5774985-p6qhq\" (UID: \"2ae64373-f614-4473-9fe3-f1a2180d573b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"
Jul 15 04:14:59.890788 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.890759    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ae64373-f614-4473-9fe3-f1a2180d573b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-p6qhq\" (UID: \"2ae64373-f614-4473-9fe3-f1a2180d573b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"
Jul 15 04:14:59.890890 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.890794    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbkgd\" (UniqueName: \"kubernetes.io/projected/2ae64373-f614-4473-9fe3-f1a2180d573b-kube-api-access-rbkgd\") pod \"kuadrant-console-plugin-66b5774985-p6qhq\" (UID: \"2ae64373-f614-4473-9fe3-f1a2180d573b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"
Jul 15 04:14:59.890890 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.890829    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ae64373-f614-4473-9fe3-f1a2180d573b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-p6qhq\" (UID: \"2ae64373-f614-4473-9fe3-f1a2180d573b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"
Jul 15 04:14:59.891398 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.891375    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2ae64373-f614-4473-9fe3-f1a2180d573b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-p6qhq\" (UID: \"2ae64373-f614-4473-9fe3-f1a2180d573b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"
Jul 15 04:14:59.893378 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.893359    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ae64373-f614-4473-9fe3-f1a2180d573b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-p6qhq\" (UID: \"2ae64373-f614-4473-9fe3-f1a2180d573b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"
Jul 15 04:14:59.907219 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:14:59.907191    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbkgd\" (UniqueName: \"kubernetes.io/projected/2ae64373-f614-4473-9fe3-f1a2180d573b-kube-api-access-rbkgd\") pod \"kuadrant-console-plugin-66b5774985-p6qhq\" (UID: \"2ae64373-f614-4473-9fe3-f1a2180d573b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"
Jul 15 04:15:00.071557 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:00.071531    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"
Jul 15 04:15:00.199639 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:00.199525    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq"]
Jul 15 04:15:00.202402 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:15:00.202370    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ae64373_f614_4473_9fe3_f1a2180d573b.slice/crio-a7ac2a96ccb79c026995d99f198f440bb84290837daeb353d3839cd45931bbea WatchSource:0}: Error finding container a7ac2a96ccb79c026995d99f198f440bb84290837daeb353d3839cd45931bbea: Status 404 returned error can't find the container with id a7ac2a96ccb79c026995d99f198f440bb84290837daeb353d3839cd45931bbea
Jul 15 04:15:01.041155 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:01.041118    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq" event={"ID":"2ae64373-f614-4473-9fe3-f1a2180d573b","Type":"ContainerStarted","Data":"a7ac2a96ccb79c026995d99f198f440bb84290837daeb353d3839cd45931bbea"}
Jul 15 04:15:23.127218 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:23.127135    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq" event={"ID":"2ae64373-f614-4473-9fe3-f1a2180d573b","Type":"ContainerStarted","Data":"e9be0324d39c0be2c19aa384a2b66f68099b57d3ad8f6344a84e6299f75bb044"}
Jul 15 04:15:23.163000 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:23.162952    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-p6qhq" podStartSLOduration=1.5449362770000001 podStartE2EDuration="24.162940146s" totalImagesPullingTime="22.618003869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:15:23.161277124 +0000 UTC m=+551.598204035" watchObservedRunningTime="2026-07-15 04:15:23.162940146 +0000 UTC m=+551.599867043"
Jul 15 04:15:54.765998 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:54.765937    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-m2kzg"]
Jul 15 04:15:54.823388 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:54.823360    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-m2kzg"]
Jul 15 04:15:54.823544 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:54.823459    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m2kzg"
Jul 15 04:15:54.825988 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:54.825970    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fh46n\""
Jul 15 04:15:54.875715 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:54.875690    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crr75\" (UniqueName: \"kubernetes.io/projected/f3b23991-8590-4dec-903c-583e76d72d51-kube-api-access-crr75\") pod \"authorino-58cd955675-m2kzg\" (UID: \"f3b23991-8590-4dec-903c-583e76d72d51\") " pod="kuadrant-system/authorino-58cd955675-m2kzg"
Jul 15 04:15:54.881081 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:54.881060    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfhdf"]
Jul 15 04:15:54.884084 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:54.884069    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nfhdf"
Jul 15 04:15:54.891232 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:54.891210    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfhdf"]
Jul 15 04:15:54.976838 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:54.976809    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4jc7\" (UniqueName: \"kubernetes.io/projected/9cb9dbd6-1c17-42e5-984e-74d867bbd8dd-kube-api-access-w4jc7\") pod \"authorino-75d556bd77-nfhdf\" (UID: \"9cb9dbd6-1c17-42e5-984e-74d867bbd8dd\") " pod="kuadrant-system/authorino-75d556bd77-nfhdf"
Jul 15 04:15:54.976955 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:54.976858    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crr75\" (UniqueName: \"kubernetes.io/projected/f3b23991-8590-4dec-903c-583e76d72d51-kube-api-access-crr75\") pod \"authorino-58cd955675-m2kzg\" (UID: \"f3b23991-8590-4dec-903c-583e76d72d51\") " pod="kuadrant-system/authorino-58cd955675-m2kzg"
Jul 15 04:15:54.984938 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:54.984918    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crr75\" (UniqueName: \"kubernetes.io/projected/f3b23991-8590-4dec-903c-583e76d72d51-kube-api-access-crr75\") pod \"authorino-58cd955675-m2kzg\" (UID: \"f3b23991-8590-4dec-903c-583e76d72d51\") " pod="kuadrant-system/authorino-58cd955675-m2kzg"
Jul 15 04:15:55.077534 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:55.077510    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4jc7\" (UniqueName: \"kubernetes.io/projected/9cb9dbd6-1c17-42e5-984e-74d867bbd8dd-kube-api-access-w4jc7\") pod \"authorino-75d556bd77-nfhdf\" (UID: \"9cb9dbd6-1c17-42e5-984e-74d867bbd8dd\") " pod="kuadrant-system/authorino-75d556bd77-nfhdf"
Jul 15 04:15:55.085420 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:55.085396    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4jc7\" (UniqueName: \"kubernetes.io/projected/9cb9dbd6-1c17-42e5-984e-74d867bbd8dd-kube-api-access-w4jc7\") pod \"authorino-75d556bd77-nfhdf\" (UID: \"9cb9dbd6-1c17-42e5-984e-74d867bbd8dd\") " pod="kuadrant-system/authorino-75d556bd77-nfhdf"
Jul 15 04:15:55.132723 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:55.132702    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m2kzg"
Jul 15 04:15:55.192597 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:55.192567    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nfhdf"
Jul 15 04:15:55.261878 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:55.261849    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-m2kzg"]
Jul 15 04:15:55.264995 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:15:55.264955    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3b23991_8590_4dec_903c_583e76d72d51.slice/crio-8a8575294b85f746b086d29db82dc057c1b11187d4063a367f47cb09b98d3ae0 WatchSource:0}: Error finding container 8a8575294b85f746b086d29db82dc057c1b11187d4063a367f47cb09b98d3ae0: Status 404 returned error can't find the container with id 8a8575294b85f746b086d29db82dc057c1b11187d4063a367f47cb09b98d3ae0
Jul 15 04:15:55.322567 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:55.322538    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfhdf"]
Jul 15 04:15:55.325242 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:15:55.325218    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cb9dbd6_1c17_42e5_984e_74d867bbd8dd.slice/crio-0be673cda594816da42ec86c51687104fc9833f1c2e09d0e58db7dd951f91062 WatchSource:0}: Error finding container 0be673cda594816da42ec86c51687104fc9833f1c2e09d0e58db7dd951f91062: Status 404 returned error can't find the container with id 0be673cda594816da42ec86c51687104fc9833f1c2e09d0e58db7dd951f91062
Jul 15 04:15:56.238259 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:56.238154    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nfhdf" event={"ID":"9cb9dbd6-1c17-42e5-984e-74d867bbd8dd","Type":"ContainerStarted","Data":"0be673cda594816da42ec86c51687104fc9833f1c2e09d0e58db7dd951f91062"}
Jul 15 04:15:56.241265 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:56.241169    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m2kzg" event={"ID":"f3b23991-8590-4dec-903c-583e76d72d51","Type":"ContainerStarted","Data":"8a8575294b85f746b086d29db82dc057c1b11187d4063a367f47cb09b98d3ae0"}
Jul 15 04:15:59.253070 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:59.253033    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nfhdf" event={"ID":"9cb9dbd6-1c17-42e5-984e-74d867bbd8dd","Type":"ContainerStarted","Data":"c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610"}
Jul 15 04:15:59.254532 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:59.254504    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m2kzg" event={"ID":"f3b23991-8590-4dec-903c-583e76d72d51","Type":"ContainerStarted","Data":"81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351"}
Jul 15 04:15:59.268696 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:59.268654    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nfhdf" podStartSLOduration=1.9216381839999999 podStartE2EDuration="5.268639449s" totalImagesPullingTime="3.347001265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:15:59.267996013 +0000 UTC m=+587.704922911" watchObservedRunningTime="2026-07-15 04:15:59.268639449 +0000 UTC m=+587.705566346"
Jul 15 04:15:59.283163 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:59.283113    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-m2kzg" podStartSLOduration=1.862086251 podStartE2EDuration="5.28306901s" totalImagesPullingTime="3.420982759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:15:59.281836033 +0000 UTC m=+587.718762930" watchObservedRunningTime="2026-07-15 04:15:59.28306901 +0000 UTC m=+587.719995908"
Jul 15 04:15:59.309936 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:15:59.309911    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-m2kzg"]
Jul 15 04:16:01.263156 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:01.263099    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-m2kzg" podUID="f3b23991-8590-4dec-903c-583e76d72d51" containerName="authorino" containerID="cri-o://81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351" gracePeriod=30
Jul 15 04:16:01.502406 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:01.502382    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m2kzg"
Jul 15 04:16:01.625758 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:01.625732    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crr75\" (UniqueName: \"kubernetes.io/projected/f3b23991-8590-4dec-903c-583e76d72d51-kube-api-access-crr75\") pod \"f3b23991-8590-4dec-903c-583e76d72d51\" (UID: \"f3b23991-8590-4dec-903c-583e76d72d51\") "
Jul 15 04:16:01.627941 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:01.627911    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b23991-8590-4dec-903c-583e76d72d51-kube-api-access-crr75" (OuterVolumeSpecName: "kube-api-access-crr75") pod "f3b23991-8590-4dec-903c-583e76d72d51" (UID: "f3b23991-8590-4dec-903c-583e76d72d51"). InnerVolumeSpecName "kube-api-access-crr75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:16:01.726178 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:01.726146    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crr75\" (UniqueName: \"kubernetes.io/projected/f3b23991-8590-4dec-903c-583e76d72d51-kube-api-access-crr75\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:16:02.267516 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:02.267482    2539 generic.go:356] "Generic (PLEG): container finished" podID="f3b23991-8590-4dec-903c-583e76d72d51" containerID="81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351" exitCode=0
Jul 15 04:16:02.267895 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:02.267524    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-m2kzg"
Jul 15 04:16:02.267895 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:02.267563    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m2kzg" event={"ID":"f3b23991-8590-4dec-903c-583e76d72d51","Type":"ContainerDied","Data":"81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351"}
Jul 15 04:16:02.267895 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:02.267608    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-m2kzg" event={"ID":"f3b23991-8590-4dec-903c-583e76d72d51","Type":"ContainerDied","Data":"8a8575294b85f746b086d29db82dc057c1b11187d4063a367f47cb09b98d3ae0"}
Jul 15 04:16:02.267895 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:02.267630    2539 scope.go:117] "RemoveContainer" containerID="81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351"
Jul 15 04:16:02.275445 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:02.275424    2539 scope.go:117] "RemoveContainer" containerID="81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351"
Jul 15 04:16:02.275711 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:16:02.275689    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351\": container with ID starting with 81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351 not found: ID does not exist" containerID="81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351"
Jul 15 04:16:02.275762 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:02.275723    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351"} err="failed to get container status \"81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351\": rpc error: code = NotFound desc = could not find container \"81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351\": container with ID starting with 81790c67bda015f43fb2a471e5e1fb303250e593042ac3ebdbc48a8955cfd351 not found: ID does not exist"
Jul 15 04:16:02.301487 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:02.301455    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-m2kzg"]
Jul 15 04:16:02.313882 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:02.313857    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-m2kzg"]
Jul 15 04:16:04.078275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:04.078246    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b23991-8590-4dec-903c-583e76d72d51" path="/var/lib/kubelet/pods/f3b23991-8590-4dec-903c-583e76d72d51/volumes"
Jul 15 04:16:11.974117 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:11.974076    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:16:11.974496 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:11.974081    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:16:25.799685 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:25.799645    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sj8nm"]
Jul 15 04:16:25.800220 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:25.799902    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b23991-8590-4dec-903c-583e76d72d51" containerName="authorino"
Jul 15 04:16:25.800220 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:25.799912    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b23991-8590-4dec-903c-583e76d72d51" containerName="authorino"
Jul 15 04:16:25.800220 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:25.799964    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b23991-8590-4dec-903c-583e76d72d51" containerName="authorino"
Jul 15 04:16:25.802180 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:25.802163    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sj8nm"
Jul 15 04:16:25.810055 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:25.810032    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sj8nm"]
Jul 15 04:16:25.882936 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:25.882909    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvtcd\" (UniqueName: \"kubernetes.io/projected/4305cd0d-196c-4b6e-aa4b-55b91ef69087-kube-api-access-zvtcd\") pod \"authorino-5d4b67c446-sj8nm\" (UID: \"4305cd0d-196c-4b6e-aa4b-55b91ef69087\") " pod="kuadrant-system/authorino-5d4b67c446-sj8nm"
Jul 15 04:16:25.983970 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:25.983945    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvtcd\" (UniqueName: \"kubernetes.io/projected/4305cd0d-196c-4b6e-aa4b-55b91ef69087-kube-api-access-zvtcd\") pod \"authorino-5d4b67c446-sj8nm\" (UID: \"4305cd0d-196c-4b6e-aa4b-55b91ef69087\") " pod="kuadrant-system/authorino-5d4b67c446-sj8nm"
Jul 15 04:16:25.994499 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:25.994468    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvtcd\" (UniqueName: \"kubernetes.io/projected/4305cd0d-196c-4b6e-aa4b-55b91ef69087-kube-api-access-zvtcd\") pod \"authorino-5d4b67c446-sj8nm\" (UID: \"4305cd0d-196c-4b6e-aa4b-55b91ef69087\") " pod="kuadrant-system/authorino-5d4b67c446-sj8nm"
Jul 15 04:16:26.079816 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.079760    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sj8nm"]
Jul 15 04:16:26.079950 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.079938    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sj8nm"
Jul 15 04:16:26.108317 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.108287    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f6d578c67-4wkxn"]
Jul 15 04:16:26.110365 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.110349    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f6d578c67-4wkxn"
Jul 15 04:16:26.117776 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.117726    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f6d578c67-4wkxn"]
Jul 15 04:16:26.185584 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.185552    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw6dr\" (UniqueName: \"kubernetes.io/projected/00a3ed2a-5243-4625-bb24-fd33b0d666c5-kube-api-access-hw6dr\") pod \"authorino-f6d578c67-4wkxn\" (UID: \"00a3ed2a-5243-4625-bb24-fd33b0d666c5\") " pod="kuadrant-system/authorino-f6d578c67-4wkxn"
Jul 15 04:16:26.205895 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.205873    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sj8nm"]
Jul 15 04:16:26.208331 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:16:26.208300    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4305cd0d_196c_4b6e_aa4b_55b91ef69087.slice/crio-bbedce73c33180feb9bf20e6a9af594e60c67eece94f7d2fc39ecc92d3306339 WatchSource:0}: Error finding container bbedce73c33180feb9bf20e6a9af594e60c67eece94f7d2fc39ecc92d3306339: Status 404 returned error can't find the container with id bbedce73c33180feb9bf20e6a9af594e60c67eece94f7d2fc39ecc92d3306339
Jul 15 04:16:26.286462 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.286435    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw6dr\" (UniqueName: \"kubernetes.io/projected/00a3ed2a-5243-4625-bb24-fd33b0d666c5-kube-api-access-hw6dr\") pod \"authorino-f6d578c67-4wkxn\" (UID: \"00a3ed2a-5243-4625-bb24-fd33b0d666c5\") " pod="kuadrant-system/authorino-f6d578c67-4wkxn"
Jul 15 04:16:26.293968 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.293945    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw6dr\" (UniqueName: \"kubernetes.io/projected/00a3ed2a-5243-4625-bb24-fd33b0d666c5-kube-api-access-hw6dr\") pod \"authorino-f6d578c67-4wkxn\" (UID: \"00a3ed2a-5243-4625-bb24-fd33b0d666c5\") " pod="kuadrant-system/authorino-f6d578c67-4wkxn"
Jul 15 04:16:26.339937 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.339878    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f6d578c67-4wkxn"]
Jul 15 04:16:26.340064 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.340052    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f6d578c67-4wkxn"
Jul 15 04:16:26.355787 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.355759    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sj8nm" event={"ID":"4305cd0d-196c-4b6e-aa4b-55b91ef69087","Type":"ContainerStarted","Data":"bbedce73c33180feb9bf20e6a9af594e60c67eece94f7d2fc39ecc92d3306339"}
Jul 15 04:16:26.367720 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.367690    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68ffd9d4f5-lpdfx"]
Jul 15 04:16:26.369897 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.369874    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx"
Jul 15 04:16:26.372493 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.372466    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 04:16:26.379693 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.379656    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68ffd9d4f5-lpdfx"]
Jul 15 04:16:26.466331 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.466297    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f6d578c67-4wkxn"]
Jul 15 04:16:26.470368 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:16:26.470344    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00a3ed2a_5243_4625_bb24_fd33b0d666c5.slice/crio-640e6a983e0a7c3661b6d0c5686cd386e3b89075363b3c697ef5ad0df2baaa6a WatchSource:0}: Error finding container 640e6a983e0a7c3661b6d0c5686cd386e3b89075363b3c697ef5ad0df2baaa6a: Status 404 returned error can't find the container with id 640e6a983e0a7c3661b6d0c5686cd386e3b89075363b3c697ef5ad0df2baaa6a
Jul 15 04:16:26.487515 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.487494    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e10521f-3382-4211-a64c-575b8233f19b-tls-cert\") pod \"authorino-68ffd9d4f5-lpdfx\" (UID: \"4e10521f-3382-4211-a64c-575b8233f19b\") " pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx"
Jul 15 04:16:26.487604 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.487531    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbpzc\" (UniqueName: \"kubernetes.io/projected/4e10521f-3382-4211-a64c-575b8233f19b-kube-api-access-sbpzc\") pod \"authorino-68ffd9d4f5-lpdfx\" (UID: \"4e10521f-3382-4211-a64c-575b8233f19b\") " pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx"
Jul 15 04:16:26.588396 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.588369    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e10521f-3382-4211-a64c-575b8233f19b-tls-cert\") pod \"authorino-68ffd9d4f5-lpdfx\" (UID: \"4e10521f-3382-4211-a64c-575b8233f19b\") " pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx"
Jul 15 04:16:26.588492 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.588414    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbpzc\" (UniqueName: \"kubernetes.io/projected/4e10521f-3382-4211-a64c-575b8233f19b-kube-api-access-sbpzc\") pod \"authorino-68ffd9d4f5-lpdfx\" (UID: \"4e10521f-3382-4211-a64c-575b8233f19b\") " pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx"
Jul 15 04:16:26.590788 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.590735    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e10521f-3382-4211-a64c-575b8233f19b-tls-cert\") pod \"authorino-68ffd9d4f5-lpdfx\" (UID: \"4e10521f-3382-4211-a64c-575b8233f19b\") " pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx"
Jul 15 04:16:26.596061 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.596037    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbpzc\" (UniqueName: \"kubernetes.io/projected/4e10521f-3382-4211-a64c-575b8233f19b-kube-api-access-sbpzc\") pod \"authorino-68ffd9d4f5-lpdfx\" (UID: \"4e10521f-3382-4211-a64c-575b8233f19b\") " pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx"
Jul 15 04:16:26.679870 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.679845    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx"
Jul 15 04:16:26.807746 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:26.807716    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68ffd9d4f5-lpdfx"]
Jul 15 04:16:26.810639 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:16:26.810611    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e10521f_3382_4211_a64c_575b8233f19b.slice/crio-006a2ba28740ac9878e5f671a46570855e9788f5c1f7fc1b844c82c957552f74 WatchSource:0}: Error finding container 006a2ba28740ac9878e5f671a46570855e9788f5c1f7fc1b844c82c957552f74: Status 404 returned error can't find the container with id 006a2ba28740ac9878e5f671a46570855e9788f5c1f7fc1b844c82c957552f74
Jul 15 04:16:27.361363 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.361330    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sj8nm" event={"ID":"4305cd0d-196c-4b6e-aa4b-55b91ef69087","Type":"ContainerStarted","Data":"1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9"}
Jul 15 04:16:27.361525 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.361376    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-sj8nm" podUID="4305cd0d-196c-4b6e-aa4b-55b91ef69087" containerName="authorino" containerID="cri-o://1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9" gracePeriod=30
Jul 15 04:16:27.362929 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.362902    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx" event={"ID":"4e10521f-3382-4211-a64c-575b8233f19b","Type":"ContainerStarted","Data":"576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777"}
Jul 15 04:16:27.363037 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.362942    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx" event={"ID":"4e10521f-3382-4211-a64c-575b8233f19b","Type":"ContainerStarted","Data":"006a2ba28740ac9878e5f671a46570855e9788f5c1f7fc1b844c82c957552f74"}
Jul 15 04:16:27.364323 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.364301    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f6d578c67-4wkxn" event={"ID":"00a3ed2a-5243-4625-bb24-fd33b0d666c5","Type":"ContainerStarted","Data":"5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b"}
Jul 15 04:16:27.364459 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.364334    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f6d578c67-4wkxn" event={"ID":"00a3ed2a-5243-4625-bb24-fd33b0d666c5","Type":"ContainerStarted","Data":"640e6a983e0a7c3661b6d0c5686cd386e3b89075363b3c697ef5ad0df2baaa6a"}
Jul 15 04:16:27.364459 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.364398    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-f6d578c67-4wkxn" podUID="00a3ed2a-5243-4625-bb24-fd33b0d666c5" containerName="authorino" containerID="cri-o://5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b" gracePeriod=30
Jul 15 04:16:27.376771 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.376731    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-sj8nm" podStartSLOduration=1.9620349799999999 podStartE2EDuration="2.376718038s" totalImagesPullingTime="414.683058ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:16:27.375263709 +0000 UTC m=+615.812190605" watchObservedRunningTime="2026-07-15 04:16:27.376718038 +0000 UTC m=+615.813644935"
Jul 15 04:16:27.395209 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.395172    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f6d578c67-4wkxn" podStartSLOduration=0.909015403 podStartE2EDuration="1.395159198s" totalImagesPullingTime="486.143795ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:16:27.394175214 +0000 UTC m=+615.831102111" watchObservedRunningTime="2026-07-15 04:16:27.395159198 +0000 UTC m=+615.832086095"
Jul 15 04:16:27.408362 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.408323    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx" podStartSLOduration=1.102885861 podStartE2EDuration="1.408310424s" totalImagesPullingTime="305.424563ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:16:27.407537778 +0000 UTC m=+615.844464676" watchObservedRunningTime="2026-07-15 04:16:27.408310424 +0000 UTC m=+615.845237361"
Jul 15 04:16:27.430958 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.430931    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfhdf"]
Jul 15 04:16:27.431133 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.431110    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nfhdf" podUID="9cb9dbd6-1c17-42e5-984e-74d867bbd8dd" containerName="authorino" containerID="cri-o://c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610" gracePeriod=30
Jul 15 04:16:27.664829 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.664806    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sj8nm"
Jul 15 04:16:27.696826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.696802    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f6d578c67-4wkxn"
Jul 15 04:16:27.703829 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.703809    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nfhdf"
Jul 15 04:16:27.796872 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.796846    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvtcd\" (UniqueName: \"kubernetes.io/projected/4305cd0d-196c-4b6e-aa4b-55b91ef69087-kube-api-access-zvtcd\") pod \"4305cd0d-196c-4b6e-aa4b-55b91ef69087\" (UID: \"4305cd0d-196c-4b6e-aa4b-55b91ef69087\") "
Jul 15 04:16:27.797016 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.796884    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hw6dr\" (UniqueName: \"kubernetes.io/projected/00a3ed2a-5243-4625-bb24-fd33b0d666c5-kube-api-access-hw6dr\") pod \"00a3ed2a-5243-4625-bb24-fd33b0d666c5\" (UID: \"00a3ed2a-5243-4625-bb24-fd33b0d666c5\") "
Jul 15 04:16:27.797016 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.796912    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4jc7\" (UniqueName: \"kubernetes.io/projected/9cb9dbd6-1c17-42e5-984e-74d867bbd8dd-kube-api-access-w4jc7\") pod \"9cb9dbd6-1c17-42e5-984e-74d867bbd8dd\" (UID: \"9cb9dbd6-1c17-42e5-984e-74d867bbd8dd\") "
Jul 15 04:16:27.799041 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.799007    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4305cd0d-196c-4b6e-aa4b-55b91ef69087-kube-api-access-zvtcd" (OuterVolumeSpecName: "kube-api-access-zvtcd") pod "4305cd0d-196c-4b6e-aa4b-55b91ef69087" (UID: "4305cd0d-196c-4b6e-aa4b-55b91ef69087"). InnerVolumeSpecName "kube-api-access-zvtcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:16:27.799041 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.799019    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00a3ed2a-5243-4625-bb24-fd33b0d666c5-kube-api-access-hw6dr" (OuterVolumeSpecName: "kube-api-access-hw6dr") pod "00a3ed2a-5243-4625-bb24-fd33b0d666c5" (UID: "00a3ed2a-5243-4625-bb24-fd33b0d666c5"). InnerVolumeSpecName "kube-api-access-hw6dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:16:27.799041 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.799042    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb9dbd6-1c17-42e5-984e-74d867bbd8dd-kube-api-access-w4jc7" (OuterVolumeSpecName: "kube-api-access-w4jc7") pod "9cb9dbd6-1c17-42e5-984e-74d867bbd8dd" (UID: "9cb9dbd6-1c17-42e5-984e-74d867bbd8dd"). InnerVolumeSpecName "kube-api-access-w4jc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:16:27.897359 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.897304    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4jc7\" (UniqueName: \"kubernetes.io/projected/9cb9dbd6-1c17-42e5-984e-74d867bbd8dd-kube-api-access-w4jc7\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:16:27.897359 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.897324    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvtcd\" (UniqueName: \"kubernetes.io/projected/4305cd0d-196c-4b6e-aa4b-55b91ef69087-kube-api-access-zvtcd\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:16:27.897359 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:27.897333    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw6dr\" (UniqueName: \"kubernetes.io/projected/00a3ed2a-5243-4625-bb24-fd33b0d666c5-kube-api-access-hw6dr\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:16:28.369667 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.369639    2539 generic.go:356] "Generic (PLEG): container finished" podID="4305cd0d-196c-4b6e-aa4b-55b91ef69087" containerID="1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9" exitCode=0
Jul 15 04:16:28.369813 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.369676    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sj8nm"
Jul 15 04:16:28.369813 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.369720    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sj8nm" event={"ID":"4305cd0d-196c-4b6e-aa4b-55b91ef69087","Type":"ContainerDied","Data":"1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9"}
Jul 15 04:16:28.369813 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.369753    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sj8nm" event={"ID":"4305cd0d-196c-4b6e-aa4b-55b91ef69087","Type":"ContainerDied","Data":"bbedce73c33180feb9bf20e6a9af594e60c67eece94f7d2fc39ecc92d3306339"}
Jul 15 04:16:28.369813 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.369771    2539 scope.go:117] "RemoveContainer" containerID="1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9"
Jul 15 04:16:28.371141 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.370832    2539 generic.go:356] "Generic (PLEG): container finished" podID="9cb9dbd6-1c17-42e5-984e-74d867bbd8dd" containerID="c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610" exitCode=0
Jul 15 04:16:28.371141 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.370876    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nfhdf"
Jul 15 04:16:28.371141 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.370918    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nfhdf" event={"ID":"9cb9dbd6-1c17-42e5-984e-74d867bbd8dd","Type":"ContainerDied","Data":"c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610"}
Jul 15 04:16:28.371141 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.370950    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nfhdf" event={"ID":"9cb9dbd6-1c17-42e5-984e-74d867bbd8dd","Type":"ContainerDied","Data":"0be673cda594816da42ec86c51687104fc9833f1c2e09d0e58db7dd951f91062"}
Jul 15 04:16:28.372428 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.372405    2539 generic.go:356] "Generic (PLEG): container finished" podID="00a3ed2a-5243-4625-bb24-fd33b0d666c5" containerID="5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b" exitCode=0
Jul 15 04:16:28.372526 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.372459    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f6d578c67-4wkxn"
Jul 15 04:16:28.372526 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.372490    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f6d578c67-4wkxn" event={"ID":"00a3ed2a-5243-4625-bb24-fd33b0d666c5","Type":"ContainerDied","Data":"5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b"}
Jul 15 04:16:28.372526 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.372523    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f6d578c67-4wkxn" event={"ID":"00a3ed2a-5243-4625-bb24-fd33b0d666c5","Type":"ContainerDied","Data":"640e6a983e0a7c3661b6d0c5686cd386e3b89075363b3c697ef5ad0df2baaa6a"}
Jul 15 04:16:28.378283 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.378267    2539 scope.go:117] "RemoveContainer" containerID="1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9"
Jul 15 04:16:28.378521 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:16:28.378504    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9\": container with ID starting with 1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9 not found: ID does not exist" containerID="1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9"
Jul 15 04:16:28.378572 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.378529    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9"} err="failed to get container status \"1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9\": rpc error: code = NotFound desc = could not find container \"1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9\": container with ID starting with 1cf38896768e77d0eb8177d4fb3c333defe4b73f696661ca340727078c596ab9 not found: ID does not exist"
Jul 15 04:16:28.378572 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.378546    2539 scope.go:117] "RemoveContainer" containerID="c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610"
Jul 15 04:16:28.385565 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.385549    2539 scope.go:117] "RemoveContainer" containerID="c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610"
Jul 15 04:16:28.385805 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:16:28.385787    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610\": container with ID starting with c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610 not found: ID does not exist" containerID="c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610"
Jul 15 04:16:28.385860 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.385811    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610"} err="failed to get container status \"c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610\": rpc error: code = NotFound desc = could not find container \"c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610\": container with ID starting with c344ced0e7cb0ce8d018c18678b66b129c475bcc083409b030f98adf1dd00610 not found: ID does not exist"
Jul 15 04:16:28.385860 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.385825    2539 scope.go:117] "RemoveContainer" containerID="5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b"
Jul 15 04:16:28.392429 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.392415    2539 scope.go:117] "RemoveContainer" containerID="5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b"
Jul 15 04:16:28.392659 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:16:28.392642    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b\": container with ID starting with 5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b not found: ID does not exist" containerID="5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b"
Jul 15 04:16:28.392702 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.392665    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b"} err="failed to get container status \"5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b\": rpc error: code = NotFound desc = could not find container \"5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b\": container with ID starting with 5922c02af1f709a4c7711a6eee6573b3ec1ffa6b58ae7ddb9ef4143657e65a1b not found: ID does not exist"
Jul 15 04:16:28.399705 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.399684    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f6d578c67-4wkxn"]
Jul 15 04:16:28.406502 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.406484    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f6d578c67-4wkxn"]
Jul 15 04:16:28.436799 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.436769    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sj8nm"]
Jul 15 04:16:28.439574 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.439557    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sj8nm"]
Jul 15 04:16:28.462590 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.462559    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfhdf"]
Jul 15 04:16:28.465707 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:28.465686    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfhdf"]
Jul 15 04:16:30.078778 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:30.078744    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00a3ed2a-5243-4625-bb24-fd33b0d666c5" path="/var/lib/kubelet/pods/00a3ed2a-5243-4625-bb24-fd33b0d666c5/volumes"
Jul 15 04:16:30.079123 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:30.079020    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4305cd0d-196c-4b6e-aa4b-55b91ef69087" path="/var/lib/kubelet/pods/4305cd0d-196c-4b6e-aa4b-55b91ef69087/volumes"
Jul 15 04:16:30.079324 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:16:30.079310    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cb9dbd6-1c17-42e5-984e-74d867bbd8dd" path="/var/lib/kubelet/pods/9cb9dbd6-1c17-42e5-984e-74d867bbd8dd/volumes"
Jul 15 04:17:26.687976 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.687947    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"]
Jul 15 04:17:26.688375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.688226    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4305cd0d-196c-4b6e-aa4b-55b91ef69087" containerName="authorino"
Jul 15 04:17:26.688375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.688238    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="4305cd0d-196c-4b6e-aa4b-55b91ef69087" containerName="authorino"
Jul 15 04:17:26.688375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.688248    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00a3ed2a-5243-4625-bb24-fd33b0d666c5" containerName="authorino"
Jul 15 04:17:26.688375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.688254    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="00a3ed2a-5243-4625-bb24-fd33b0d666c5" containerName="authorino"
Jul 15 04:17:26.688375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.688262    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb9dbd6-1c17-42e5-984e-74d867bbd8dd" containerName="authorino"
Jul 15 04:17:26.688375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.688267    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb9dbd6-1c17-42e5-984e-74d867bbd8dd" containerName="authorino"
Jul 15 04:17:26.688375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.688308    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="00a3ed2a-5243-4625-bb24-fd33b0d666c5" containerName="authorino"
Jul 15 04:17:26.688375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.688315    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="4305cd0d-196c-4b6e-aa4b-55b91ef69087" containerName="authorino"
Jul 15 04:17:26.688375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.688322    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb9dbd6-1c17-42e5-984e-74d867bbd8dd" containerName="authorino"
Jul 15 04:17:26.692633 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.692616    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.695349 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.695327    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 04:17:26.695444 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.695427    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 04:17:26.695495 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.695429    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 04:17:26.696414 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.696397    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wlffh\""
Jul 15 04:17:26.701584 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.701561    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"]
Jul 15 04:17:26.798725 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.798701    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.798846 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.798732    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.798846 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.798748    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd8c1ee-9690-490d-8d36-0913f34755b2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.798846 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.798770    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.798985 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.798848    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9ssc\" (UniqueName: \"kubernetes.io/projected/8bd8c1ee-9690-490d-8d36-0913f34755b2-kube-api-access-h9ssc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.798985 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.798892    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.899562 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.899523    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9ssc\" (UniqueName: \"kubernetes.io/projected/8bd8c1ee-9690-490d-8d36-0913f34755b2-kube-api-access-h9ssc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.899688 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.899585    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.899688 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.899625    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.899688 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.899657    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.899688 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.899680    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd8c1ee-9690-490d-8d36-0913f34755b2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.899861 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.899711    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.900028 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.900006    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.900120 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.900049    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.900120 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.900078    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.902019 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.902000    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bd8c1ee-9690-490d-8d36-0913f34755b2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.902352 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.902337    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd8c1ee-9690-490d-8d36-0913f34755b2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:26.906966 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:26.906946    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9ssc\" (UniqueName: \"kubernetes.io/projected/8bd8c1ee-9690-490d-8d36-0913f34755b2-kube-api-access-h9ssc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk\" (UID: \"8bd8c1ee-9690-490d-8d36-0913f34755b2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:27.003884 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:27.003815    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:27.129294 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:27.129268    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"]
Jul 15 04:17:27.131666 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:17:27.131638    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd8c1ee_9690_490d_8d36_0913f34755b2.slice/crio-50452dfee13f9502f4a595625d76af685fcc7c9238a27dcfc65423e1a44e7b2a WatchSource:0}: Error finding container 50452dfee13f9502f4a595625d76af685fcc7c9238a27dcfc65423e1a44e7b2a: Status 404 returned error can't find the container with id 50452dfee13f9502f4a595625d76af685fcc7c9238a27dcfc65423e1a44e7b2a
Jul 15 04:17:27.132909 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:27.132891    2539 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 04:17:27.607124 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:27.607057    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk" event={"ID":"8bd8c1ee-9690-490d-8d36-0913f34755b2","Type":"ContainerStarted","Data":"50452dfee13f9502f4a595625d76af685fcc7c9238a27dcfc65423e1a44e7b2a"}
Jul 15 04:17:28.612758 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:28.612722    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk" event={"ID":"8bd8c1ee-9690-490d-8d36-0913f34755b2","Type":"ContainerStarted","Data":"ef65f3a3fb124fcc9701bcef9a657bf171fe18428c97ca62013bc72c9b4400b0"}
Jul 15 04:17:28.630626 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:28.630584    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk" podStartSLOduration=1.493579743 podStartE2EDuration="2.630569857s" totalImagesPullingTime="1.136990114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:17:28.629326472 +0000 UTC m=+677.066253381" watchObservedRunningTime="2026-07-15 04:17:28.630569857 +0000 UTC m=+677.067496754"
Jul 15 04:17:35.378202 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.378165    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"]
Jul 15 04:17:35.381804 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.381782    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.384080 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.384061    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 04:17:35.392169 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.392145    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"]
Jul 15 04:17:35.457166 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.457143    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68ec28cd-555b-4405-860c-98ace8f1f09f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.457274 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.457171    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.457274 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.457196    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.457274 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.457220    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.457274 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.457265    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.457398 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.457298    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zr7r\" (UniqueName: \"kubernetes.io/projected/68ec28cd-555b-4405-860c-98ace8f1f09f-kube-api-access-7zr7r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.558061 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.558033    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68ec28cd-555b-4405-860c-98ace8f1f09f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.558173 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.558067    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.558173 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.558113    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.558173 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.558139    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.558173 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.558161    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.558338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.558259    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zr7r\" (UniqueName: \"kubernetes.io/projected/68ec28cd-555b-4405-860c-98ace8f1f09f-kube-api-access-7zr7r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.558508 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.558490    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.558577 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.558541    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.558577 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.558560    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.560500 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.560475    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68ec28cd-555b-4405-860c-98ace8f1f09f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.560736 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.560718    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68ec28cd-555b-4405-860c-98ace8f1f09f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.566019 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.565994    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zr7r\" (UniqueName: \"kubernetes.io/projected/68ec28cd-555b-4405-860c-98ace8f1f09f-kube-api-access-7zr7r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bzsdd\" (UID: \"68ec28cd-555b-4405-860c-98ace8f1f09f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.693733 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.693675    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:35.821753 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:35.821721    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"]
Jul 15 04:17:35.825387 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:17:35.825361    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ec28cd_555b_4405_860c_98ace8f1f09f.slice/crio-52044866a2b232b40d06922ed18e01a2e82981002f26b4dd65fc6107726658c4 WatchSource:0}: Error finding container 52044866a2b232b40d06922ed18e01a2e82981002f26b4dd65fc6107726658c4: Status 404 returned error can't find the container with id 52044866a2b232b40d06922ed18e01a2e82981002f26b4dd65fc6107726658c4
Jul 15 04:17:36.646211 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:36.646134    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd" event={"ID":"68ec28cd-555b-4405-860c-98ace8f1f09f","Type":"ContainerStarted","Data":"349c75cb8026bbf4d0c18ca71f18b88e7cf5d4b4822efcb17c03140dcca47c23"}
Jul 15 04:17:36.646211 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:36.646181    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd" event={"ID":"68ec28cd-555b-4405-860c-98ace8f1f09f","Type":"ContainerStarted","Data":"52044866a2b232b40d06922ed18e01a2e82981002f26b4dd65fc6107726658c4"}
Jul 15 04:17:36.663827 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:36.663780    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd" podStartSLOduration=1.418225235 podStartE2EDuration="1.663765086s" totalImagesPullingTime="245.539851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:17:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:17:36.661955382 +0000 UTC m=+685.098882279" watchObservedRunningTime="2026-07-15 04:17:36.663765086 +0000 UTC m=+685.100691986"
Jul 15 04:17:37.004719 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:37.004631    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:37.004719 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:37.004703    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:37.017170 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:37.017136    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:37.661999 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:37.661969    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk"
Jul 15 04:17:45.694039 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:45.694005    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:45.694625 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:45.694073    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:45.705846 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:45.705823    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:17:46.695898 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:17:46.695866    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bzsdd"
Jul 15 04:18:16.477388 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.477295    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"]
Jul 15 04:18:16.480497 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.480474    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.483226 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.483208    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 04:18:16.492304 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.492285    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"]
Jul 15 04:18:16.556466 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.556434    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.556466 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.556467    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.556637 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.556572    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.556637 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.556607    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.556637 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.556623    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/384ce8f5-f2f3-432a-89c2-a36aab24f587-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.556732 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.556649    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztrrq\" (UniqueName: \"kubernetes.io/projected/384ce8f5-f2f3-432a-89c2-a36aab24f587-kube-api-access-ztrrq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.657748 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.657714    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.657888 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.657755    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.657888 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.657784    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/384ce8f5-f2f3-432a-89c2-a36aab24f587-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.657888 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.657812    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztrrq\" (UniqueName: \"kubernetes.io/projected/384ce8f5-f2f3-432a-89c2-a36aab24f587-kube-api-access-ztrrq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.657888 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.657839    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.658051 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.657901    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.658223 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.658200    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.658301 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.658269    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.658351 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.658297    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.660206 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.660188    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/384ce8f5-f2f3-432a-89c2-a36aab24f587-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.660586 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.660564    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/384ce8f5-f2f3-432a-89c2-a36aab24f587-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.666043 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.666019    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztrrq\" (UniqueName: \"kubernetes.io/projected/384ce8f5-f2f3-432a-89c2-a36aab24f587-kube-api-access-ztrrq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw\" (UID: \"384ce8f5-f2f3-432a-89c2-a36aab24f587\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.789642 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.789573    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:16.919966 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:16.919938    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"]
Jul 15 04:18:16.922557 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:18:16.922521    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod384ce8f5_f2f3_432a_89c2_a36aab24f587.slice/crio-0d159265eb99c5faa8c46dedb56a0b1b6b5d67c25d3b7a3b910ec89a2ba7aeff WatchSource:0}: Error finding container 0d159265eb99c5faa8c46dedb56a0b1b6b5d67c25d3b7a3b910ec89a2ba7aeff: Status 404 returned error can't find the container with id 0d159265eb99c5faa8c46dedb56a0b1b6b5d67c25d3b7a3b910ec89a2ba7aeff
Jul 15 04:18:17.814463 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:17.814427    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw" event={"ID":"384ce8f5-f2f3-432a-89c2-a36aab24f587","Type":"ContainerStarted","Data":"4b51d18e01ff5e13c5789a654e11844bfb6661849574f05c0652c007a617d950"}
Jul 15 04:18:17.814849 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:17.814475    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw" event={"ID":"384ce8f5-f2f3-432a-89c2-a36aab24f587","Type":"ContainerStarted","Data":"0d159265eb99c5faa8c46dedb56a0b1b6b5d67c25d3b7a3b910ec89a2ba7aeff"}
Jul 15 04:18:17.831404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:17.831358    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw" podStartSLOduration=1.640807626 podStartE2EDuration="1.831343744s" totalImagesPullingTime="190.536118ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:18:17.830206727 +0000 UTC m=+726.267133625" watchObservedRunningTime="2026-07-15 04:18:17.831343744 +0000 UTC m=+726.268270641"
Jul 15 04:18:26.790420 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:26.790381    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:26.790800 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:26.790470    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:26.802436 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:26.802413    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:18:26.861744 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:18:26.861721    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw"
Jul 15 04:19:39.962785 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:39.962709    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cf8c54c94-9cqdh"]
Jul 15 04:19:39.965780 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:39.965762    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cf8c54c94-9cqdh"
Jul 15 04:19:39.976442 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:39.976414    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cf8c54c94-9cqdh"]
Jul 15 04:19:40.021579 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:40.021548    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/18fdfb41-9570-4410-ad37-01e0a13e3bf7-tls-cert\") pod \"authorino-cf8c54c94-9cqdh\" (UID: \"18fdfb41-9570-4410-ad37-01e0a13e3bf7\") " pod="kuadrant-system/authorino-cf8c54c94-9cqdh"
Jul 15 04:19:40.021681 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:40.021586    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4fdl\" (UniqueName: \"kubernetes.io/projected/18fdfb41-9570-4410-ad37-01e0a13e3bf7-kube-api-access-g4fdl\") pod \"authorino-cf8c54c94-9cqdh\" (UID: \"18fdfb41-9570-4410-ad37-01e0a13e3bf7\") " pod="kuadrant-system/authorino-cf8c54c94-9cqdh"
Jul 15 04:19:40.122342 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:40.122311    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/18fdfb41-9570-4410-ad37-01e0a13e3bf7-tls-cert\") pod \"authorino-cf8c54c94-9cqdh\" (UID: \"18fdfb41-9570-4410-ad37-01e0a13e3bf7\") " pod="kuadrant-system/authorino-cf8c54c94-9cqdh"
Jul 15 04:19:40.122454 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:40.122350    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4fdl\" (UniqueName: \"kubernetes.io/projected/18fdfb41-9570-4410-ad37-01e0a13e3bf7-kube-api-access-g4fdl\") pod \"authorino-cf8c54c94-9cqdh\" (UID: \"18fdfb41-9570-4410-ad37-01e0a13e3bf7\") " pod="kuadrant-system/authorino-cf8c54c94-9cqdh"
Jul 15 04:19:40.125037 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:40.125014    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/18fdfb41-9570-4410-ad37-01e0a13e3bf7-tls-cert\") pod \"authorino-cf8c54c94-9cqdh\" (UID: \"18fdfb41-9570-4410-ad37-01e0a13e3bf7\") " pod="kuadrant-system/authorino-cf8c54c94-9cqdh"
Jul 15 04:19:40.132796 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:40.132777    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4fdl\" (UniqueName: \"kubernetes.io/projected/18fdfb41-9570-4410-ad37-01e0a13e3bf7-kube-api-access-g4fdl\") pod \"authorino-cf8c54c94-9cqdh\" (UID: \"18fdfb41-9570-4410-ad37-01e0a13e3bf7\") " pod="kuadrant-system/authorino-cf8c54c94-9cqdh"
Jul 15 04:19:40.273643 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:40.273581    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cf8c54c94-9cqdh"
Jul 15 04:19:40.417678 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:40.417653    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cf8c54c94-9cqdh"]
Jul 15 04:19:40.419928 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:19:40.419901    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18fdfb41_9570_4410_ad37_01e0a13e3bf7.slice/crio-19654a6f42640b68fc26c503b602250cfeaf0c9ffd2255c968692ec5792b1c47 WatchSource:0}: Error finding container 19654a6f42640b68fc26c503b602250cfeaf0c9ffd2255c968692ec5792b1c47: Status 404 returned error can't find the container with id 19654a6f42640b68fc26c503b602250cfeaf0c9ffd2255c968692ec5792b1c47
Jul 15 04:19:41.151596 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.151556    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cf8c54c94-9cqdh" event={"ID":"18fdfb41-9570-4410-ad37-01e0a13e3bf7","Type":"ContainerStarted","Data":"06d1842d2efa1af7af61104934a3e23371d30dfb08c26b14d97946660d767875"}
Jul 15 04:19:41.152055 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.151612    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cf8c54c94-9cqdh" event={"ID":"18fdfb41-9570-4410-ad37-01e0a13e3bf7","Type":"ContainerStarted","Data":"19654a6f42640b68fc26c503b602250cfeaf0c9ffd2255c968692ec5792b1c47"}
Jul 15 04:19:41.169871 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.169807    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cf8c54c94-9cqdh" podStartSLOduration=1.569872278 podStartE2EDuration="2.169784546s" totalImagesPullingTime="599.912268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:19:41.167971938 +0000 UTC m=+809.604898831" watchObservedRunningTime="2026-07-15 04:19:41.169784546 +0000 UTC m=+809.606711445"
Jul 15 04:19:41.193542 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.193512    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68ffd9d4f5-lpdfx"]
Jul 15 04:19:41.193724 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.193686    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx" podUID="4e10521f-3382-4211-a64c-575b8233f19b" containerName="authorino" containerID="cri-o://576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777" gracePeriod=30
Jul 15 04:19:41.448137 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.448110    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx"
Jul 15 04:19:41.535811 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.535779    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e10521f-3382-4211-a64c-575b8233f19b-tls-cert\") pod \"4e10521f-3382-4211-a64c-575b8233f19b\" (UID: \"4e10521f-3382-4211-a64c-575b8233f19b\") "
Jul 15 04:19:41.535980 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.535819    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbpzc\" (UniqueName: \"kubernetes.io/projected/4e10521f-3382-4211-a64c-575b8233f19b-kube-api-access-sbpzc\") pod \"4e10521f-3382-4211-a64c-575b8233f19b\" (UID: \"4e10521f-3382-4211-a64c-575b8233f19b\") "
Jul 15 04:19:41.538482 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.538447    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e10521f-3382-4211-a64c-575b8233f19b-kube-api-access-sbpzc" (OuterVolumeSpecName: "kube-api-access-sbpzc") pod "4e10521f-3382-4211-a64c-575b8233f19b" (UID: "4e10521f-3382-4211-a64c-575b8233f19b"). InnerVolumeSpecName "kube-api-access-sbpzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:19:41.545682 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.545660    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e10521f-3382-4211-a64c-575b8233f19b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4e10521f-3382-4211-a64c-575b8233f19b" (UID: "4e10521f-3382-4211-a64c-575b8233f19b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 04:19:41.636621 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.636539    2539 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4e10521f-3382-4211-a64c-575b8233f19b-tls-cert\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:19:41.636621 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:41.636571    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbpzc\" (UniqueName: \"kubernetes.io/projected/4e10521f-3382-4211-a64c-575b8233f19b-kube-api-access-sbpzc\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:19:42.157778 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:42.157741    2539 generic.go:356] "Generic (PLEG): container finished" podID="4e10521f-3382-4211-a64c-575b8233f19b" containerID="576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777" exitCode=0
Jul 15 04:19:42.158232 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:42.157793    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx"
Jul 15 04:19:42.158232 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:42.157845    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx" event={"ID":"4e10521f-3382-4211-a64c-575b8233f19b","Type":"ContainerDied","Data":"576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777"}
Jul 15 04:19:42.158232 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:42.157912    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68ffd9d4f5-lpdfx" event={"ID":"4e10521f-3382-4211-a64c-575b8233f19b","Type":"ContainerDied","Data":"006a2ba28740ac9878e5f671a46570855e9788f5c1f7fc1b844c82c957552f74"}
Jul 15 04:19:42.158232 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:42.157938    2539 scope.go:117] "RemoveContainer" containerID="576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777"
Jul 15 04:19:42.167929 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:42.167914    2539 scope.go:117] "RemoveContainer" containerID="576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777"
Jul 15 04:19:42.168214 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:19:42.168178    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777\": container with ID starting with 576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777 not found: ID does not exist" containerID="576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777"
Jul 15 04:19:42.168303 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:42.168224    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777"} err="failed to get container status \"576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777\": rpc error: code = NotFound desc = could not find container \"576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777\": container with ID starting with 576081f5705b741f7c96fa8700e4a60929f6bd9c49c7f10b35f0284bafb78777 not found: ID does not exist"
Jul 15 04:19:42.174712 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:42.174686    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68ffd9d4f5-lpdfx"]
Jul 15 04:19:42.178249 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:42.178230    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68ffd9d4f5-lpdfx"]
Jul 15 04:19:44.078954 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:19:44.078921    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e10521f-3382-4211-a64c-575b8233f19b" path="/var/lib/kubelet/pods/4e10521f-3382-4211-a64c-575b8233f19b/volumes"
Jul 15 04:21:11.995530 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:21:11.995502    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:21:11.996529 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:21:11.996510    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:26:12.018783 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:26:12.018749    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:26:12.021119 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:26:12.021081    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:31:12.040398 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:31:12.040370    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:31:12.042810 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:31:12.042782    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:33:07.886153 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:07.886117    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7"]
Jul 15 04:33:07.886580 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:07.886380    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e10521f-3382-4211-a64c-575b8233f19b" containerName="authorino"
Jul 15 04:33:07.886580 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:07.886391    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e10521f-3382-4211-a64c-575b8233f19b" containerName="authorino"
Jul 15 04:33:07.886580 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:07.886452    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e10521f-3382-4211-a64c-575b8233f19b" containerName="authorino"
Jul 15 04:33:07.889315 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:07.889297    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7"
Jul 15 04:33:07.891706 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:07.891685    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:33:07.891803 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:07.891733    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:33:07.895707 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:07.895682    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7"]
Jul 15 04:33:07.956544 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:07.956519    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef326e3-7878-46c4-8f2a-6c1a08a57253-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7\" (UID: \"bef326e3-7878-46c4-8f2a-6c1a08a57253\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7"
Jul 15 04:33:08.057840 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:08.057812    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef326e3-7878-46c4-8f2a-6c1a08a57253-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7\" (UID: \"bef326e3-7878-46c4-8f2a-6c1a08a57253\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7"
Jul 15 04:33:08.058396 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:08.058378    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef326e3-7878-46c4-8f2a-6c1a08a57253-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7\" (UID: \"bef326e3-7878-46c4-8f2a-6c1a08a57253\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7"
Jul 15 04:33:08.200366 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:08.200313    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7"
Jul 15 04:33:08.327965 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:08.327937    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7"]
Jul 15 04:33:08.331480 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:33:08.331449    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef326e3_7878_46c4_8f2a_6c1a08a57253.slice/crio-ce47d8b13e66774e0382e32da5a67fb0c384022281bad2c4662c7ff291319d1d WatchSource:0}: Error finding container ce47d8b13e66774e0382e32da5a67fb0c384022281bad2c4662c7ff291319d1d: Status 404 returned error can't find the container with id ce47d8b13e66774e0382e32da5a67fb0c384022281bad2c4662c7ff291319d1d
Jul 15 04:33:08.333371 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:08.333356    2539 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 04:33:09.301748 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:09.301710    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7" event={"ID":"bef326e3-7878-46c4-8f2a-6c1a08a57253","Type":"ContainerStarted","Data":"ce47d8b13e66774e0382e32da5a67fb0c384022281bad2c4662c7ff291319d1d"}
Jul 15 04:33:11.313844 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:11.313808    2539 generic.go:356] "Generic (PLEG): container finished" podID="bef326e3-7878-46c4-8f2a-6c1a08a57253" containerID="8b1b40d5ca68691d2d4f66768b7743f4517ae581b90888ca349f39860d5821ab" exitCode=7
Jul 15 04:33:11.314229 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:11.313888    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7" event={"ID":"bef326e3-7878-46c4-8f2a-6c1a08a57253","Type":"ContainerDied","Data":"8b1b40d5ca68691d2d4f66768b7743f4517ae581b90888ca349f39860d5821ab"}
Jul 15 04:33:11.314229 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:11.314038    2539 scope.go:117] "RemoveContainer" containerID="8b1b40d5ca68691d2d4f66768b7743f4517ae581b90888ca349f39860d5821ab"
Jul 15 04:33:12.319441 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:12.319407    2539 generic.go:356] "Generic (PLEG): container finished" podID="bef326e3-7878-46c4-8f2a-6c1a08a57253" containerID="82c457bbbaceae46424180daa89270b56a1b72e17d5ac7b6b3e3e0ee61c01aae" exitCode=0
Jul 15 04:33:12.319779 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:12.319498    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7" event={"ID":"bef326e3-7878-46c4-8f2a-6c1a08a57253","Type":"ContainerDied","Data":"82c457bbbaceae46424180daa89270b56a1b72e17d5ac7b6b3e3e0ee61c01aae"}
Jul 15 04:33:12.319779 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:12.319561    2539 scope.go:117] "RemoveContainer" containerID="8b1b40d5ca68691d2d4f66768b7743f4517ae581b90888ca349f39860d5821ab"
Jul 15 04:33:13.448495 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:13.448471    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7"
Jul 15 04:33:13.500397 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:13.500372    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef326e3-7878-46c4-8f2a-6c1a08a57253-maas-api-service-ca\") pod \"bef326e3-7878-46c4-8f2a-6c1a08a57253\" (UID: \"bef326e3-7878-46c4-8f2a-6c1a08a57253\") "
Jul 15 04:33:13.500679 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:13.500658    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bef326e3-7878-46c4-8f2a-6c1a08a57253-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bef326e3-7878-46c4-8f2a-6c1a08a57253" (UID: "bef326e3-7878-46c4-8f2a-6c1a08a57253"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:33:13.601359 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:13.601293    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bef326e3-7878-46c4-8f2a-6c1a08a57253-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:33:14.330545 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:14.330519    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7"
Jul 15 04:33:14.330545 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:14.330537    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7" event={"ID":"bef326e3-7878-46c4-8f2a-6c1a08a57253","Type":"ContainerDied","Data":"ce47d8b13e66774e0382e32da5a67fb0c384022281bad2c4662c7ff291319d1d"}
Jul 15 04:33:14.330767 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:14.330578    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce47d8b13e66774e0382e32da5a67fb0c384022281bad2c4662c7ff291319d1d"
Jul 15 04:33:39.474456 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.474423    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"]
Jul 15 04:33:39.474867 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.474683    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef326e3-7878-46c4-8f2a-6c1a08a57253" containerName="revoke-keys"
Jul 15 04:33:39.474867 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.474694    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef326e3-7878-46c4-8f2a-6c1a08a57253" containerName="revoke-keys"
Jul 15 04:33:39.474867 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.474717    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef326e3-7878-46c4-8f2a-6c1a08a57253" containerName="revoke-keys"
Jul 15 04:33:39.474867 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.474725    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef326e3-7878-46c4-8f2a-6c1a08a57253" containerName="revoke-keys"
Jul 15 04:33:39.474867 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.474779    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="bef326e3-7878-46c4-8f2a-6c1a08a57253" containerName="revoke-keys"
Jul 15 04:33:39.474867 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.474787    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="bef326e3-7878-46c4-8f2a-6c1a08a57253" containerName="revoke-keys"
Jul 15 04:33:39.477596 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.477580    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"
Jul 15 04:33:39.480212 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.480177    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:33:39.480338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.480178    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:33:39.483907 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.483885    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"]
Jul 15 04:33:39.583192 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.583163    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/910e140e-0adc-46fd-a4b2-18289af9836e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45\" (UID: \"910e140e-0adc-46fd-a4b2-18289af9836e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"
Jul 15 04:33:39.683797 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.683771    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/910e140e-0adc-46fd-a4b2-18289af9836e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45\" (UID: \"910e140e-0adc-46fd-a4b2-18289af9836e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"
Jul 15 04:33:39.684364 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.684347    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/910e140e-0adc-46fd-a4b2-18289af9836e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45\" (UID: \"910e140e-0adc-46fd-a4b2-18289af9836e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"
Jul 15 04:33:39.789395 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.789363    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"
Jul 15 04:33:39.920546 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:39.920520    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"]
Jul 15 04:33:39.922761 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:33:39.922728    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910e140e_0adc_46fd_a4b2_18289af9836e.slice/crio-7bf75d191ebe44676b2100e9e2f93f88d16f78fa7176d34b45d18258c881c0ff WatchSource:0}: Error finding container 7bf75d191ebe44676b2100e9e2f93f88d16f78fa7176d34b45d18258c881c0ff: Status 404 returned error can't find the container with id 7bf75d191ebe44676b2100e9e2f93f88d16f78fa7176d34b45d18258c881c0ff
Jul 15 04:33:40.434005 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:40.433924    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45" event={"ID":"910e140e-0adc-46fd-a4b2-18289af9836e","Type":"ContainerStarted","Data":"a840079acafc0c087142fc3f0bedf4eba024806e0312c2887c82d486bc38d281"}
Jul 15 04:33:40.434005 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:40.433973    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45" event={"ID":"910e140e-0adc-46fd-a4b2-18289af9836e","Type":"ContainerStarted","Data":"7bf75d191ebe44676b2100e9e2f93f88d16f78fa7176d34b45d18258c881c0ff"}
Jul 15 04:33:40.451976 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:40.451926    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45" podStartSLOduration=1.45191186 podStartE2EDuration="1.45191186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:33:40.45106838 +0000 UTC m=+1648.887995277" watchObservedRunningTime="2026-07-15 04:33:40.45191186 +0000 UTC m=+1648.888838791"
Jul 15 04:33:41.439025 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:41.438989    2539 generic.go:356] "Generic (PLEG): container finished" podID="910e140e-0adc-46fd-a4b2-18289af9836e" containerID="a840079acafc0c087142fc3f0bedf4eba024806e0312c2887c82d486bc38d281" exitCode=7
Jul 15 04:33:41.439391 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:41.439078    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45" event={"ID":"910e140e-0adc-46fd-a4b2-18289af9836e","Type":"ContainerDied","Data":"a840079acafc0c087142fc3f0bedf4eba024806e0312c2887c82d486bc38d281"}
Jul 15 04:33:41.439391 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:41.439263    2539 scope.go:117] "RemoveContainer" containerID="a840079acafc0c087142fc3f0bedf4eba024806e0312c2887c82d486bc38d281"
Jul 15 04:33:42.444902 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:42.444868    2539 generic.go:356] "Generic (PLEG): container finished" podID="910e140e-0adc-46fd-a4b2-18289af9836e" containerID="e5159adddcc97bec2fa7b458cfb74039854cef7a6de72872aef2373426a1b171" exitCode=7
Jul 15 04:33:42.445362 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:42.444945    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45" event={"ID":"910e140e-0adc-46fd-a4b2-18289af9836e","Type":"ContainerDied","Data":"e5159adddcc97bec2fa7b458cfb74039854cef7a6de72872aef2373426a1b171"}
Jul 15 04:33:42.445362 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:42.444997    2539 scope.go:117] "RemoveContainer" containerID="a840079acafc0c087142fc3f0bedf4eba024806e0312c2887c82d486bc38d281"
Jul 15 04:33:42.445362 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:42.445183    2539 scope.go:117] "RemoveContainer" containerID="e5159adddcc97bec2fa7b458cfb74039854cef7a6de72872aef2373426a1b171"
Jul 15 04:33:42.445500 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:33:42.445403    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45_odh-ai-gateway-infra(910e140e-0adc-46fd-a4b2-18289af9836e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45" podUID="910e140e-0adc-46fd-a4b2-18289af9836e"
Jul 15 04:33:43.451001 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:43.450929    2539 scope.go:117] "RemoveContainer" containerID="e5159adddcc97bec2fa7b458cfb74039854cef7a6de72872aef2373426a1b171"
Jul 15 04:33:43.451331 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:33:43.451129    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45_odh-ai-gateway-infra(910e140e-0adc-46fd-a4b2-18289af9836e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45" podUID="910e140e-0adc-46fd-a4b2-18289af9836e"
Jul 15 04:33:56.074417 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:56.074388    2539 scope.go:117] "RemoveContainer" containerID="e5159adddcc97bec2fa7b458cfb74039854cef7a6de72872aef2373426a1b171"
Jul 15 04:33:56.503579 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:56.503507    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45" event={"ID":"910e140e-0adc-46fd-a4b2-18289af9836e","Type":"ContainerStarted","Data":"c72aa4507845df1149f77848e3b1d2cce2f754b935dbeaede14f128ba263b676"}
Jul 15 04:33:57.508900 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:57.508869    2539 generic.go:356] "Generic (PLEG): container finished" podID="910e140e-0adc-46fd-a4b2-18289af9836e" containerID="c72aa4507845df1149f77848e3b1d2cce2f754b935dbeaede14f128ba263b676" exitCode=0
Jul 15 04:33:57.509291 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:57.508928    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45" event={"ID":"910e140e-0adc-46fd-a4b2-18289af9836e","Type":"ContainerDied","Data":"c72aa4507845df1149f77848e3b1d2cce2f754b935dbeaede14f128ba263b676"}
Jul 15 04:33:57.509291 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:57.508973    2539 scope.go:117] "RemoveContainer" containerID="e5159adddcc97bec2fa7b458cfb74039854cef7a6de72872aef2373426a1b171"
Jul 15 04:33:57.529515 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:57.529483    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"]
Jul 15 04:33:58.643058 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:58.643037    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"
Jul 15 04:33:58.825470 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:58.825447    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/910e140e-0adc-46fd-a4b2-18289af9836e-maas-api-service-ca\") pod \"910e140e-0adc-46fd-a4b2-18289af9836e\" (UID: \"910e140e-0adc-46fd-a4b2-18289af9836e\") "
Jul 15 04:33:58.825792 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:58.825769    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/910e140e-0adc-46fd-a4b2-18289af9836e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "910e140e-0adc-46fd-a4b2-18289af9836e" (UID: "910e140e-0adc-46fd-a4b2-18289af9836e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:33:58.926502 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:58.926475    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/910e140e-0adc-46fd-a4b2-18289af9836e-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:33:59.519563 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:59.519536    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"
Jul 15 04:33:59.519729 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:59.519535    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45" event={"ID":"910e140e-0adc-46fd-a4b2-18289af9836e","Type":"ContainerDied","Data":"7bf75d191ebe44676b2100e9e2f93f88d16f78fa7176d34b45d18258c881c0ff"}
Jul 15 04:33:59.519729 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:59.519652    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bf75d191ebe44676b2100e9e2f93f88d16f78fa7176d34b45d18258c881c0ff"
Jul 15 04:33:59.550989 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:59.550962    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"]
Jul 15 04:33:59.555431 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:33:59.555410    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-j4g45"]
Jul 15 04:34:00.078753 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:00.078723    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="910e140e-0adc-46fd-a4b2-18289af9836e" path="/var/lib/kubelet/pods/910e140e-0adc-46fd-a4b2-18289af9836e/volumes"
Jul 15 04:34:39.537495 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.535225    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn"]
Jul 15 04:34:39.537495 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.535805    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="910e140e-0adc-46fd-a4b2-18289af9836e" containerName="revoke-keys"
Jul 15 04:34:39.537495 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.535826    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="910e140e-0adc-46fd-a4b2-18289af9836e" containerName="revoke-keys"
Jul 15 04:34:39.537495 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.535861    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="910e140e-0adc-46fd-a4b2-18289af9836e" containerName="revoke-keys"
Jul 15 04:34:39.537495 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.535869    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="910e140e-0adc-46fd-a4b2-18289af9836e" containerName="revoke-keys"
Jul 15 04:34:39.537495 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.536001    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="910e140e-0adc-46fd-a4b2-18289af9836e" containerName="revoke-keys"
Jul 15 04:34:39.537495 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.536012    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="910e140e-0adc-46fd-a4b2-18289af9836e" containerName="revoke-keys"
Jul 15 04:34:39.537495 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.536021    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="910e140e-0adc-46fd-a4b2-18289af9836e" containerName="revoke-keys"
Jul 15 04:34:39.539622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.539591    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn"
Jul 15 04:34:39.542430 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.542402    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:34:39.542545 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.542433    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:34:39.545261 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.545236    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn"]
Jul 15 04:34:39.592313 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.592279    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5a21d5-c67f-493e-a291-a7783ea684a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn\" (UID: \"4d5a21d5-c67f-493e-a291-a7783ea684a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn"
Jul 15 04:34:39.692755 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.692730    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5a21d5-c67f-493e-a291-a7783ea684a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn\" (UID: \"4d5a21d5-c67f-493e-a291-a7783ea684a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn"
Jul 15 04:34:39.693333 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.693315    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5a21d5-c67f-493e-a291-a7783ea684a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn\" (UID: \"4d5a21d5-c67f-493e-a291-a7783ea684a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn"
Jul 15 04:34:39.851057 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.851034    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn"
Jul 15 04:34:39.977158 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:39.977031    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn"]
Jul 15 04:34:39.979822 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:34:39.979793    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5a21d5_c67f_493e_a291_a7783ea684a6.slice/crio-f0834abb6a715d1748fa6afb4447b004ea7964d76e901b92760a5b123eb8cb24 WatchSource:0}: Error finding container f0834abb6a715d1748fa6afb4447b004ea7964d76e901b92760a5b123eb8cb24: Status 404 returned error can't find the container with id f0834abb6a715d1748fa6afb4447b004ea7964d76e901b92760a5b123eb8cb24
Jul 15 04:34:40.685517 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:40.685487    2539 generic.go:356] "Generic (PLEG): container finished" podID="4d5a21d5-c67f-493e-a291-a7783ea684a6" containerID="d1618f7f3cfbe163cebd990501aca777c058d5968cdf0857d6f8a7711a552705" exitCode=0
Jul 15 04:34:40.685811 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:40.685558    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn" event={"ID":"4d5a21d5-c67f-493e-a291-a7783ea684a6","Type":"ContainerDied","Data":"d1618f7f3cfbe163cebd990501aca777c058d5968cdf0857d6f8a7711a552705"}
Jul 15 04:34:40.685811 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:40.685603    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn" event={"ID":"4d5a21d5-c67f-493e-a291-a7783ea684a6","Type":"ContainerStarted","Data":"f0834abb6a715d1748fa6afb4447b004ea7964d76e901b92760a5b123eb8cb24"}
Jul 15 04:34:41.811638 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:41.811611    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn"
Jul 15 04:34:41.905509 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:41.905479    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5a21d5-c67f-493e-a291-a7783ea684a6-maas-api-service-ca\") pod \"4d5a21d5-c67f-493e-a291-a7783ea684a6\" (UID: \"4d5a21d5-c67f-493e-a291-a7783ea684a6\") "
Jul 15 04:34:41.905782 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:41.905760    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d5a21d5-c67f-493e-a291-a7783ea684a6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4d5a21d5-c67f-493e-a291-a7783ea684a6" (UID: "4d5a21d5-c67f-493e-a291-a7783ea684a6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:34:42.006325 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:42.006271    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d5a21d5-c67f-493e-a291-a7783ea684a6-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:34:42.695596 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:42.695569    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn"
Jul 15 04:34:42.695596 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:42.695577    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn" event={"ID":"4d5a21d5-c67f-493e-a291-a7783ea684a6","Type":"ContainerDied","Data":"f0834abb6a715d1748fa6afb4447b004ea7964d76e901b92760a5b123eb8cb24"}
Jul 15 04:34:42.695849 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:42.695619    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0834abb6a715d1748fa6afb4447b004ea7964d76e901b92760a5b123eb8cb24"
Jul 15 04:34:57.667240 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.667207    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"]
Jul 15 04:34:57.667681 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.667585    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="910e140e-0adc-46fd-a4b2-18289af9836e" containerName="revoke-keys"
Jul 15 04:34:57.667681 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.667603    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="910e140e-0adc-46fd-a4b2-18289af9836e" containerName="revoke-keys"
Jul 15 04:34:57.667681 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.667624    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d5a21d5-c67f-493e-a291-a7783ea684a6" containerName="revoke-keys"
Jul 15 04:34:57.667681 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.667632    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d5a21d5-c67f-493e-a291-a7783ea684a6" containerName="revoke-keys"
Jul 15 04:34:57.667874 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.667710    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d5a21d5-c67f-493e-a291-a7783ea684a6" containerName="revoke-keys"
Jul 15 04:34:57.670741 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.670722    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"
Jul 15 04:34:57.673326 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.673300    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:34:57.673455 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.673354    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:34:57.677379 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.677357    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"]
Jul 15 04:34:57.715227 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.715205    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/458f1d2f-7e6b-402c-9431-b1d27e53edcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv\" (UID: \"458f1d2f-7e6b-402c-9431-b1d27e53edcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"
Jul 15 04:34:57.816412 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.816381    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/458f1d2f-7e6b-402c-9431-b1d27e53edcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv\" (UID: \"458f1d2f-7e6b-402c-9431-b1d27e53edcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"
Jul 15 04:34:57.816933 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.816914    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/458f1d2f-7e6b-402c-9431-b1d27e53edcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv\" (UID: \"458f1d2f-7e6b-402c-9431-b1d27e53edcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"
Jul 15 04:34:57.981833 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:57.981773    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"
Jul 15 04:34:58.112318 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:58.112293    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"]
Jul 15 04:34:58.114533 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:34:58.114507    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458f1d2f_7e6b_402c_9431_b1d27e53edcf.slice/crio-33eec166b47a63da667970c9e5c13858d67199c626e43169ef962e33b8934dcf WatchSource:0}: Error finding container 33eec166b47a63da667970c9e5c13858d67199c626e43169ef962e33b8934dcf: Status 404 returned error can't find the container with id 33eec166b47a63da667970c9e5c13858d67199c626e43169ef962e33b8934dcf
Jul 15 04:34:58.760780 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:58.760751    2539 generic.go:356] "Generic (PLEG): container finished" podID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerID="3b212cc24e02437e6496ec263fbdebc08699aa1af4cfd3838ead13e2b6afbd3a" exitCode=7
Jul 15 04:34:58.761067 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:58.760807    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv" event={"ID":"458f1d2f-7e6b-402c-9431-b1d27e53edcf","Type":"ContainerDied","Data":"3b212cc24e02437e6496ec263fbdebc08699aa1af4cfd3838ead13e2b6afbd3a"}
Jul 15 04:34:58.761067 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:58.760849    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv" event={"ID":"458f1d2f-7e6b-402c-9431-b1d27e53edcf","Type":"ContainerStarted","Data":"33eec166b47a63da667970c9e5c13858d67199c626e43169ef962e33b8934dcf"}
Jul 15 04:34:58.761067 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:58.761010    2539 scope.go:117] "RemoveContainer" containerID="3b212cc24e02437e6496ec263fbdebc08699aa1af4cfd3838ead13e2b6afbd3a"
Jul 15 04:34:59.767365 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:59.767324    2539 generic.go:356] "Generic (PLEG): container finished" podID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerID="b55decebc43641dfe48131fc408c7aaa801b88f8434d3a4eb70c6931bbe4b1c8" exitCode=7
Jul 15 04:34:59.767783 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:59.767405    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv" event={"ID":"458f1d2f-7e6b-402c-9431-b1d27e53edcf","Type":"ContainerDied","Data":"b55decebc43641dfe48131fc408c7aaa801b88f8434d3a4eb70c6931bbe4b1c8"}
Jul 15 04:34:59.767783 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:59.767465    2539 scope.go:117] "RemoveContainer" containerID="3b212cc24e02437e6496ec263fbdebc08699aa1af4cfd3838ead13e2b6afbd3a"
Jul 15 04:34:59.767783 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:34:59.767679    2539 scope.go:117] "RemoveContainer" containerID="b55decebc43641dfe48131fc408c7aaa801b88f8434d3a4eb70c6931bbe4b1c8"
Jul 15 04:34:59.767897 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:34:59.767866    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv_odh-ai-gateway-infra(458f1d2f-7e6b-402c-9431-b1d27e53edcf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf"
Jul 15 04:35:00.773115 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:00.773065    2539 scope.go:117] "RemoveContainer" containerID="b55decebc43641dfe48131fc408c7aaa801b88f8434d3a4eb70c6931bbe4b1c8"
Jul 15 04:35:00.773489 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:35:00.773251    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv_odh-ai-gateway-infra(458f1d2f-7e6b-402c-9431-b1d27e53edcf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf"
Jul 15 04:35:15.074341 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:15.074311    2539 scope.go:117] "RemoveContainer" containerID="b55decebc43641dfe48131fc408c7aaa801b88f8434d3a4eb70c6931bbe4b1c8"
Jul 15 04:35:15.834199 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:15.834165    2539 generic.go:356] "Generic (PLEG): container finished" podID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerID="e0eaf5cfa1b3fbd69f94501ab58047286fefc4bcdfc8b61baa8fc5d7ced71b04" exitCode=0
Jul 15 04:35:15.834351 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:15.834227    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv" event={"ID":"458f1d2f-7e6b-402c-9431-b1d27e53edcf","Type":"ContainerDied","Data":"e0eaf5cfa1b3fbd69f94501ab58047286fefc4bcdfc8b61baa8fc5d7ced71b04"}
Jul 15 04:35:15.834351 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:15.834291    2539 scope.go:117] "RemoveContainer" containerID="b55decebc43641dfe48131fc408c7aaa801b88f8434d3a4eb70c6931bbe4b1c8"
Jul 15 04:35:16.865197 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:16.865163    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"]
Jul 15 04:35:16.968173 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:16.968152    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"
Jul 15 04:35:17.059593 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:17.059567    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/458f1d2f-7e6b-402c-9431-b1d27e53edcf-maas-api-service-ca\") pod \"458f1d2f-7e6b-402c-9431-b1d27e53edcf\" (UID: \"458f1d2f-7e6b-402c-9431-b1d27e53edcf\") "
Jul 15 04:35:17.059899 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:17.059876    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/458f1d2f-7e6b-402c-9431-b1d27e53edcf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "458f1d2f-7e6b-402c-9431-b1d27e53edcf" (UID: "458f1d2f-7e6b-402c-9431-b1d27e53edcf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:35:17.160372 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:17.160300    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/458f1d2f-7e6b-402c-9431-b1d27e53edcf-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:35:17.845214 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:17.845189    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"
Jul 15 04:35:17.845376 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:17.845189    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv" event={"ID":"458f1d2f-7e6b-402c-9431-b1d27e53edcf","Type":"ContainerDied","Data":"33eec166b47a63da667970c9e5c13858d67199c626e43169ef962e33b8934dcf"}
Jul 15 04:35:17.845376 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:17.845320    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33eec166b47a63da667970c9e5c13858d67199c626e43169ef962e33b8934dcf"
Jul 15 04:35:17.874846 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:17.874820    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"]
Jul 15 04:35:17.877899 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:17.877880    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-tq4vv"]
Jul 15 04:35:18.079795 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:18.079765    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" path="/var/lib/kubelet/pods/458f1d2f-7e6b-402c-9431-b1d27e53edcf/volumes"
Jul 15 04:35:57.708984 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.708948    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7"]
Jul 15 04:35:57.709484 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.709228    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerName="revoke-keys"
Jul 15 04:35:57.709484 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.709238    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerName="revoke-keys"
Jul 15 04:35:57.709484 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.709249    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerName="revoke-keys"
Jul 15 04:35:57.709484 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.709254    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerName="revoke-keys"
Jul 15 04:35:57.709484 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.709264    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerName="revoke-keys"
Jul 15 04:35:57.709484 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.709271    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerName="revoke-keys"
Jul 15 04:35:57.709484 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.709318    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerName="revoke-keys"
Jul 15 04:35:57.709484 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.709327    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerName="revoke-keys"
Jul 15 04:35:57.712084 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.712068    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7"
Jul 15 04:35:57.714579 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.714554    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:35:57.714579 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.714574    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:35:57.718665 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.718641    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7"]
Jul 15 04:35:57.837566 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.837536    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43349651-aacb-4fb1-a4be-797e11138d29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c27a526e-645w7\" (UID: \"43349651-aacb-4fb1-a4be-797e11138d29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7"
Jul 15 04:35:57.938058 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.938028    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43349651-aacb-4fb1-a4be-797e11138d29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c27a526e-645w7\" (UID: \"43349651-aacb-4fb1-a4be-797e11138d29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7"
Jul 15 04:35:57.938628 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:57.938611    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43349651-aacb-4fb1-a4be-797e11138d29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c27a526e-645w7\" (UID: \"43349651-aacb-4fb1-a4be-797e11138d29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7"
Jul 15 04:35:58.022888 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:58.022824    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7"
Jul 15 04:35:58.152964 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:58.152938    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7"]
Jul 15 04:35:58.155632 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:35:58.155603    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43349651_aacb_4fb1_a4be_797e11138d29.slice/crio-f97361d8fad1292f3822a71069c3ba5abddc3cf89d0735dca23e6845697cbd60 WatchSource:0}: Error finding container f97361d8fad1292f3822a71069c3ba5abddc3cf89d0735dca23e6845697cbd60: Status 404 returned error can't find the container with id f97361d8fad1292f3822a71069c3ba5abddc3cf89d0735dca23e6845697cbd60
Jul 15 04:35:59.012486 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:59.012452    2539 generic.go:356] "Generic (PLEG): container finished" podID="43349651-aacb-4fb1-a4be-797e11138d29" containerID="24cd1fb7c250d406f56b1612a0cda1ee92ebc802d7d42bda801a4b7d38d360fb" exitCode=0
Jul 15 04:35:59.012778 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:59.012500    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7" event={"ID":"43349651-aacb-4fb1-a4be-797e11138d29","Type":"ContainerDied","Data":"24cd1fb7c250d406f56b1612a0cda1ee92ebc802d7d42bda801a4b7d38d360fb"}
Jul 15 04:35:59.012778 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:35:59.012537    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7" event={"ID":"43349651-aacb-4fb1-a4be-797e11138d29","Type":"ContainerStarted","Data":"f97361d8fad1292f3822a71069c3ba5abddc3cf89d0735dca23e6845697cbd60"}
Jul 15 04:36:00.145650 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:00.145626    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7"
Jul 15 04:36:00.253597 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:00.253571    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43349651-aacb-4fb1-a4be-797e11138d29-maas-api-service-ca\") pod \"43349651-aacb-4fb1-a4be-797e11138d29\" (UID: \"43349651-aacb-4fb1-a4be-797e11138d29\") "
Jul 15 04:36:00.253884 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:00.253865    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43349651-aacb-4fb1-a4be-797e11138d29-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "43349651-aacb-4fb1-a4be-797e11138d29" (UID: "43349651-aacb-4fb1-a4be-797e11138d29"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:36:00.354677 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:00.354653    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43349651-aacb-4fb1-a4be-797e11138d29-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:36:01.021886 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:01.021854    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7" event={"ID":"43349651-aacb-4fb1-a4be-797e11138d29","Type":"ContainerDied","Data":"f97361d8fad1292f3822a71069c3ba5abddc3cf89d0735dca23e6845697cbd60"}
Jul 15 04:36:01.021886 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:01.021879    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c27a526e-645w7"
Jul 15 04:36:01.022075 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:01.021901    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f97361d8fad1292f3822a71069c3ba5abddc3cf89d0735dca23e6845697cbd60"
Jul 15 04:36:12.063313 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:12.063285    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:36:12.066460 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:12.066432    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:36:29.663632 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.663594    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"]
Jul 15 04:36:29.664017 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.663869    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43349651-aacb-4fb1-a4be-797e11138d29" containerName="revoke-keys"
Jul 15 04:36:29.664017 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.663879    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="43349651-aacb-4fb1-a4be-797e11138d29" containerName="revoke-keys"
Jul 15 04:36:29.664017 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.663931    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="458f1d2f-7e6b-402c-9431-b1d27e53edcf" containerName="revoke-keys"
Jul 15 04:36:29.664017 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.663941    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="43349651-aacb-4fb1-a4be-797e11138d29" containerName="revoke-keys"
Jul 15 04:36:29.666806 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.666790    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"
Jul 15 04:36:29.669360 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.669338    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:36:29.669491 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.669418    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:36:29.673913 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.673816    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"]
Jul 15 04:36:29.758821 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.758791    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fcb3ff5-dfe0-4f51-9940-d7a625463d99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f6197270-nqt4v\" (UID: \"0fcb3ff5-dfe0-4f51-9940-d7a625463d99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"
Jul 15 04:36:29.859816 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.859784    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fcb3ff5-dfe0-4f51-9940-d7a625463d99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f6197270-nqt4v\" (UID: \"0fcb3ff5-dfe0-4f51-9940-d7a625463d99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"
Jul 15 04:36:29.860404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.860380    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fcb3ff5-dfe0-4f51-9940-d7a625463d99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f6197270-nqt4v\" (UID: \"0fcb3ff5-dfe0-4f51-9940-d7a625463d99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"
Jul 15 04:36:29.977227 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:29.977175    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"
Jul 15 04:36:30.104739 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:30.104713    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"]
Jul 15 04:36:30.106992 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:36:30.106965    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fcb3ff5_dfe0_4f51_9940_d7a625463d99.slice/crio-eaaf12770150cd5f69ce60c47b73b2ae0b7fc835ba63148ccbff23ad1ad2572e WatchSource:0}: Error finding container eaaf12770150cd5f69ce60c47b73b2ae0b7fc835ba63148ccbff23ad1ad2572e: Status 404 returned error can't find the container with id eaaf12770150cd5f69ce60c47b73b2ae0b7fc835ba63148ccbff23ad1ad2572e
Jul 15 04:36:30.142613 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:30.142581    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v" event={"ID":"0fcb3ff5-dfe0-4f51-9940-d7a625463d99","Type":"ContainerStarted","Data":"eaaf12770150cd5f69ce60c47b73b2ae0b7fc835ba63148ccbff23ad1ad2572e"}
Jul 15 04:36:31.148748 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:31.148715    2539 generic.go:356] "Generic (PLEG): container finished" podID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerID="6ee4318d5633da971da5c7a73e0916a8d7a0fa66850310eec4d0d9a5e68d3170" exitCode=7
Jul 15 04:36:31.149144 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:31.148791    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v" event={"ID":"0fcb3ff5-dfe0-4f51-9940-d7a625463d99","Type":"ContainerDied","Data":"6ee4318d5633da971da5c7a73e0916a8d7a0fa66850310eec4d0d9a5e68d3170"}
Jul 15 04:36:31.149144 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:31.148957    2539 scope.go:117] "RemoveContainer" containerID="6ee4318d5633da971da5c7a73e0916a8d7a0fa66850310eec4d0d9a5e68d3170"
Jul 15 04:36:32.155297 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:32.155268    2539 generic.go:356] "Generic (PLEG): container finished" podID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerID="2a6c5dfa114872cd65fb1bce2e49739c9eb14730b65defc44e73b753d899a6ed" exitCode=7
Jul 15 04:36:32.155669 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:32.155349    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v" event={"ID":"0fcb3ff5-dfe0-4f51-9940-d7a625463d99","Type":"ContainerDied","Data":"2a6c5dfa114872cd65fb1bce2e49739c9eb14730b65defc44e73b753d899a6ed"}
Jul 15 04:36:32.155669 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:32.155405    2539 scope.go:117] "RemoveContainer" containerID="6ee4318d5633da971da5c7a73e0916a8d7a0fa66850310eec4d0d9a5e68d3170"
Jul 15 04:36:32.155669 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:32.155613    2539 scope.go:117] "RemoveContainer" containerID="2a6c5dfa114872cd65fb1bce2e49739c9eb14730b65defc44e73b753d899a6ed"
Jul 15 04:36:32.155813 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:36:32.155796    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f6197270-nqt4v_odh-ai-gateway-infra(0fcb3ff5-dfe0-4f51-9940-d7a625463d99)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99"
Jul 15 04:36:33.160855 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:33.160825    2539 scope.go:117] "RemoveContainer" containerID="2a6c5dfa114872cd65fb1bce2e49739c9eb14730b65defc44e73b753d899a6ed"
Jul 15 04:36:33.161269 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:36:33.160986    2539 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f6197270-nqt4v_odh-ai-gateway-infra(0fcb3ff5-dfe0-4f51-9940-d7a625463d99)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99"
Jul 15 04:36:48.079173 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:48.079144    2539 scope.go:117] "RemoveContainer" containerID="2a6c5dfa114872cd65fb1bce2e49739c9eb14730b65defc44e73b753d899a6ed"
Jul 15 04:36:49.230499 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:49.230468    2539 generic.go:356] "Generic (PLEG): container finished" podID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerID="a7022c01ef668905115fb50f2cffa77b209a7a904b8354cbf6b9a3183fd84eaf" exitCode=0
Jul 15 04:36:49.230499 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:49.230503    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v" event={"ID":"0fcb3ff5-dfe0-4f51-9940-d7a625463d99","Type":"ContainerDied","Data":"a7022c01ef668905115fb50f2cffa77b209a7a904b8354cbf6b9a3183fd84eaf"}
Jul 15 04:36:49.230960 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:49.230552    2539 scope.go:117] "RemoveContainer" containerID="2a6c5dfa114872cd65fb1bce2e49739c9eb14730b65defc44e73b753d899a6ed"
Jul 15 04:36:50.261224 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:50.261195    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"]
Jul 15 04:36:50.363976 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:50.363949    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"
Jul 15 04:36:50.401859 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:50.401831    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fcb3ff5-dfe0-4f51-9940-d7a625463d99-maas-api-service-ca\") pod \"0fcb3ff5-dfe0-4f51-9940-d7a625463d99\" (UID: \"0fcb3ff5-dfe0-4f51-9940-d7a625463d99\") "
Jul 15 04:36:50.402166 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:50.402143    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fcb3ff5-dfe0-4f51-9940-d7a625463d99-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0fcb3ff5-dfe0-4f51-9940-d7a625463d99" (UID: "0fcb3ff5-dfe0-4f51-9940-d7a625463d99"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:36:50.502869 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:50.502810    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fcb3ff5-dfe0-4f51-9940-d7a625463d99-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:36:51.241775 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:51.241741    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"
Jul 15 04:36:51.241775 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:51.241750    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v" event={"ID":"0fcb3ff5-dfe0-4f51-9940-d7a625463d99","Type":"ContainerDied","Data":"eaaf12770150cd5f69ce60c47b73b2ae0b7fc835ba63148ccbff23ad1ad2572e"}
Jul 15 04:36:51.242012 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:51.241804    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eaaf12770150cd5f69ce60c47b73b2ae0b7fc835ba63148ccbff23ad1ad2572e"
Jul 15 04:36:51.273583 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:51.273559    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"]
Jul 15 04:36:51.279037 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:51.279015    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-nqt4v"]
Jul 15 04:36:52.079050 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:36:52.079022    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" path="/var/lib/kubelet/pods/0fcb3ff5-dfe0-4f51-9940-d7a625463d99/volumes"
Jul 15 04:37:29.712615 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.712585    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg"]
Jul 15 04:37:29.713053 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.712881    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerName="revoke-keys"
Jul 15 04:37:29.713053 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.712894    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerName="revoke-keys"
Jul 15 04:37:29.713053 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.712910    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerName="revoke-keys"
Jul 15 04:37:29.713053 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.712919    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerName="revoke-keys"
Jul 15 04:37:29.713053 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.712979    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerName="revoke-keys"
Jul 15 04:37:29.713053 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.712992    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerName="revoke-keys"
Jul 15 04:37:29.716014 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.715998    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg"
Jul 15 04:37:29.718821 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.718799    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:37:29.718966 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.718834    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:37:29.724343 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.724319    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg"]
Jul 15 04:37:29.788633 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.788609    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23311a69-6a96-4332-84d2-94dc477b1230-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f6197270-4r2gg\" (UID: \"23311a69-6a96-4332-84d2-94dc477b1230\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg"
Jul 15 04:37:29.889961 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.889933    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23311a69-6a96-4332-84d2-94dc477b1230-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f6197270-4r2gg\" (UID: \"23311a69-6a96-4332-84d2-94dc477b1230\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg"
Jul 15 04:37:29.890530 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:29.890512    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23311a69-6a96-4332-84d2-94dc477b1230-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f6197270-4r2gg\" (UID: \"23311a69-6a96-4332-84d2-94dc477b1230\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg"
Jul 15 04:37:30.027547 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:30.027487    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg"
Jul 15 04:37:30.156328 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:30.156302    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg"]
Jul 15 04:37:30.158658 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:37:30.158634    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23311a69_6a96_4332_84d2_94dc477b1230.slice/crio-f0dca802a62ccf934224a4d80615c3f2d0763f9d0465cfc0bcefc9808a2698ce WatchSource:0}: Error finding container f0dca802a62ccf934224a4d80615c3f2d0763f9d0465cfc0bcefc9808a2698ce: Status 404 returned error can't find the container with id f0dca802a62ccf934224a4d80615c3f2d0763f9d0465cfc0bcefc9808a2698ce
Jul 15 04:37:30.408500 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:30.408475    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg" event={"ID":"23311a69-6a96-4332-84d2-94dc477b1230","Type":"ContainerStarted","Data":"f0dca802a62ccf934224a4d80615c3f2d0763f9d0465cfc0bcefc9808a2698ce"}
Jul 15 04:37:31.414826 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:31.414791    2539 generic.go:356] "Generic (PLEG): container finished" podID="23311a69-6a96-4332-84d2-94dc477b1230" containerID="0f6cd7ced8f22031a2e742c5ced1d9bcd2984c8cc183446900fa403f6aab0b30" exitCode=0
Jul 15 04:37:31.415275 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:31.414887    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg" event={"ID":"23311a69-6a96-4332-84d2-94dc477b1230","Type":"ContainerDied","Data":"0f6cd7ced8f22031a2e742c5ced1d9bcd2984c8cc183446900fa403f6aab0b30"}
Jul 15 04:37:32.538327 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:32.538303    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg"
Jul 15 04:37:32.709928 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:32.709867    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23311a69-6a96-4332-84d2-94dc477b1230-maas-api-service-ca\") pod \"23311a69-6a96-4332-84d2-94dc477b1230\" (UID: \"23311a69-6a96-4332-84d2-94dc477b1230\") "
Jul 15 04:37:32.710229 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:32.710206    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23311a69-6a96-4332-84d2-94dc477b1230-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "23311a69-6a96-4332-84d2-94dc477b1230" (UID: "23311a69-6a96-4332-84d2-94dc477b1230"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:37:32.810731 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:32.810706    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23311a69-6a96-4332-84d2-94dc477b1230-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:37:33.424482 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:33.424455    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg"
Jul 15 04:37:33.424667 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:33.424506    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f6197270-4r2gg" event={"ID":"23311a69-6a96-4332-84d2-94dc477b1230","Type":"ContainerDied","Data":"f0dca802a62ccf934224a4d80615c3f2d0763f9d0465cfc0bcefc9808a2698ce"}
Jul 15 04:37:33.424667 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:37:33.424564    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0dca802a62ccf934224a4d80615c3f2d0763f9d0465cfc0bcefc9808a2698ce"
Jul 15 04:39:45.320110 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.320056    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w"]
Jul 15 04:39:45.320535 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.320364    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23311a69-6a96-4332-84d2-94dc477b1230" containerName="revoke-keys"
Jul 15 04:39:45.320535 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.320376    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="23311a69-6a96-4332-84d2-94dc477b1230" containerName="revoke-keys"
Jul 15 04:39:45.320535 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.320386    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerName="revoke-keys"
Jul 15 04:39:45.320535 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.320393    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerName="revoke-keys"
Jul 15 04:39:45.320535 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.320455    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fcb3ff5-dfe0-4f51-9940-d7a625463d99" containerName="revoke-keys"
Jul 15 04:39:45.320535 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.320464    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="23311a69-6a96-4332-84d2-94dc477b1230" containerName="revoke-keys"
Jul 15 04:39:45.323245 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.323228    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w"
Jul 15 04:39:45.325797 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.325775    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:39:45.325905 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.325818    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:39:45.330023 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.329998    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w"]
Jul 15 04:39:45.352201 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.352175    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85e16c6b-cf06-4a08-8626-05d8b04dfe62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w\" (UID: \"85e16c6b-cf06-4a08-8626-05d8b04dfe62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w"
Jul 15 04:39:45.452882 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.452849    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85e16c6b-cf06-4a08-8626-05d8b04dfe62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w\" (UID: \"85e16c6b-cf06-4a08-8626-05d8b04dfe62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w"
Jul 15 04:39:45.453453 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.453435    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85e16c6b-cf06-4a08-8626-05d8b04dfe62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w\" (UID: \"85e16c6b-cf06-4a08-8626-05d8b04dfe62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w"
Jul 15 04:39:45.634282 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.634215    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w"
Jul 15 04:39:45.761009 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.760984    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w"]
Jul 15 04:39:45.763313 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:39:45.763287    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e16c6b_cf06_4a08_8626_05d8b04dfe62.slice/crio-6192190aef9befabf24773bfd84121904939bf67351fd5721789afcfcb065639 WatchSource:0}: Error finding container 6192190aef9befabf24773bfd84121904939bf67351fd5721789afcfcb065639: Status 404 returned error can't find the container with id 6192190aef9befabf24773bfd84121904939bf67351fd5721789afcfcb065639
Jul 15 04:39:45.979604 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:45.979570    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w" event={"ID":"85e16c6b-cf06-4a08-8626-05d8b04dfe62","Type":"ContainerStarted","Data":"6192190aef9befabf24773bfd84121904939bf67351fd5721789afcfcb065639"}
Jul 15 04:39:46.985158 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:46.985125    2539 generic.go:356] "Generic (PLEG): container finished" podID="85e16c6b-cf06-4a08-8626-05d8b04dfe62" containerID="82c2dc68e0f63a533ced0c94180ee26ee3578e1752a14ba7136652985cd7f231" exitCode=0
Jul 15 04:39:46.985545 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:46.985218    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w" event={"ID":"85e16c6b-cf06-4a08-8626-05d8b04dfe62","Type":"ContainerDied","Data":"82c2dc68e0f63a533ced0c94180ee26ee3578e1752a14ba7136652985cd7f231"}
Jul 15 04:39:48.111556 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:48.111532    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w"
Jul 15 04:39:48.167222 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:48.167191    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85e16c6b-cf06-4a08-8626-05d8b04dfe62-maas-api-service-ca\") pod \"85e16c6b-cf06-4a08-8626-05d8b04dfe62\" (UID: \"85e16c6b-cf06-4a08-8626-05d8b04dfe62\") "
Jul 15 04:39:48.167500 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:48.167479    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85e16c6b-cf06-4a08-8626-05d8b04dfe62-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "85e16c6b-cf06-4a08-8626-05d8b04dfe62" (UID: "85e16c6b-cf06-4a08-8626-05d8b04dfe62"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:39:48.268251 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:48.268193    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85e16c6b-cf06-4a08-8626-05d8b04dfe62-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:39:48.995012 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:48.994983    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w"
Jul 15 04:39:48.995210 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:48.994984    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w" event={"ID":"85e16c6b-cf06-4a08-8626-05d8b04dfe62","Type":"ContainerDied","Data":"6192190aef9befabf24773bfd84121904939bf67351fd5721789afcfcb065639"}
Jul 15 04:39:48.995210 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:39:48.995142    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6192190aef9befabf24773bfd84121904939bf67351fd5721789afcfcb065639"
Jul 15 04:40:12.147193 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:12.147160    2539 scope.go:117] "RemoveContainer" containerID="c72aa4507845df1149f77848e3b1d2cce2f754b935dbeaede14f128ba263b676"
Jul 15 04:40:44.796578 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.796541    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"]
Jul 15 04:40:44.797021 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.796954    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85e16c6b-cf06-4a08-8626-05d8b04dfe62" containerName="revoke-keys"
Jul 15 04:40:44.797021 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.796972    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="85e16c6b-cf06-4a08-8626-05d8b04dfe62" containerName="revoke-keys"
Jul 15 04:40:44.797115 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.797051    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="85e16c6b-cf06-4a08-8626-05d8b04dfe62" containerName="revoke-keys"
Jul 15 04:40:44.800014 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.799994    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.802942 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.802917    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-699a3596\"/\"default-dockercfg-t66jm\""
Jul 15 04:40:44.803235 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.803218    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-699a3596\"/\"kube-root-ca.crt\""
Jul 15 04:40:44.804193 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.804167    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-699a3596\"/\"e2e-lifecycle-model-699a3596-kserve-self-signed-certs\""
Jul 15 04:40:44.804279 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.804204    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-699a3596\"/\"openshift-service-ca.crt\""
Jul 15 04:40:44.812642 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.812618    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"]
Jul 15 04:40:44.849756 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.849733    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a24c44-fd6d-4341-8993-c1dfb4014e18-tls-certs\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.849849 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.849767    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-dshm\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.849849 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.849788    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-model-cache\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.849849 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.849819    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9wqp\" (UniqueName: \"kubernetes.io/projected/62a24c44-fd6d-4341-8993-c1dfb4014e18-kube-api-access-g9wqp\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.850010 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.849861    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-tmp-dir\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.850010 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.849883    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-home\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.951166 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.951140    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-home\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.951264 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.951176    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a24c44-fd6d-4341-8993-c1dfb4014e18-tls-certs\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.951264 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.951201    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-dshm\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.951264 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.951219    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-model-cache\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.951264 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.951245    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9wqp\" (UniqueName: \"kubernetes.io/projected/62a24c44-fd6d-4341-8993-c1dfb4014e18-kube-api-access-g9wqp\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.951466 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.951295    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-tmp-dir\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.951597 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.951575    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-home\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.951649 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.951623    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-model-cache\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.951684 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.951661    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-tmp-dir\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.953545 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.953523    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-dshm\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.953727 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.953712    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a24c44-fd6d-4341-8993-c1dfb4014e18-tls-certs\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:44.959793 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:44.959769    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9wqp\" (UniqueName: \"kubernetes.io/projected/62a24c44-fd6d-4341-8993-c1dfb4014e18-kube-api-access-g9wqp\") pod \"e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") " pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:45.109749 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:45.109690    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:45.241956 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:45.241931    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"]
Jul 15 04:40:45.244487 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:40:45.244456    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62a24c44_fd6d_4341_8993_c1dfb4014e18.slice/crio-d6907d2711acfd6d852fb2ea3f9673f23b0338244cc96d166229a898f80200fc WatchSource:0}: Error finding container d6907d2711acfd6d852fb2ea3f9673f23b0338244cc96d166229a898f80200fc: Status 404 returned error can't find the container with id d6907d2711acfd6d852fb2ea3f9673f23b0338244cc96d166229a898f80200fc
Jul 15 04:40:46.245581 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:46.245544    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp" event={"ID":"62a24c44-fd6d-4341-8993-c1dfb4014e18","Type":"ContainerStarted","Data":"7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741"}
Jul 15 04:40:46.245937 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:46.245588    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp" event={"ID":"62a24c44-fd6d-4341-8993-c1dfb4014e18","Type":"ContainerStarted","Data":"d6907d2711acfd6d852fb2ea3f9673f23b0338244cc96d166229a898f80200fc"}
Jul 15 04:40:46.269056 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:46.269011    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp" podStartSLOduration=2.268996404 podStartE2EDuration="2.268996404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:40:46.268543943 +0000 UTC m=+2074.705470852" watchObservedRunningTime="2026-07-15 04:40:46.268996404 +0000 UTC m=+2074.705923302"
Jul 15 04:40:55.110290 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:55.110252    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:55.110883 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:55.110314    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:55.122600 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:55.122568    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:40:55.291503 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:40:55.291473    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:41:06.800709 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:06.800676    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl"]
Jul 15 04:41:06.803991 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:06.803971    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl"
Jul 15 04:41:06.806538 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:06.806519    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:41:06.806657 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:06.806574    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:41:06.812221 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:06.812198    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl"]
Jul 15 04:41:06.911297 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:06.911273    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a56f6e-f262-4959-8923-62a043247641-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-699a3596-tttbl\" (UID: \"d6a56f6e-f262-4959-8923-62a043247641\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl"
Jul 15 04:41:07.012506 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:07.012480    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a56f6e-f262-4959-8923-62a043247641-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-699a3596-tttbl\" (UID: \"d6a56f6e-f262-4959-8923-62a043247641\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl"
Jul 15 04:41:07.013054 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:07.013036    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a56f6e-f262-4959-8923-62a043247641-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-699a3596-tttbl\" (UID: \"d6a56f6e-f262-4959-8923-62a043247641\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl"
Jul 15 04:41:07.114770 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:07.114707    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl"
Jul 15 04:41:07.243081 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:07.243056    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl"]
Jul 15 04:41:07.245198 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:41:07.245153    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a56f6e_f262_4959_8923_62a043247641.slice/crio-30532c8ff632eea5b449ed1655615f71198ab60869461ab53cd4fc225800c229 WatchSource:0}: Error finding container 30532c8ff632eea5b449ed1655615f71198ab60869461ab53cd4fc225800c229: Status 404 returned error can't find the container with id 30532c8ff632eea5b449ed1655615f71198ab60869461ab53cd4fc225800c229
Jul 15 04:41:07.331760 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:07.331730    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl" event={"ID":"d6a56f6e-f262-4959-8923-62a043247641","Type":"ContainerStarted","Data":"30532c8ff632eea5b449ed1655615f71198ab60869461ab53cd4fc225800c229"}
Jul 15 04:41:08.337208 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:08.337179    2539 generic.go:356] "Generic (PLEG): container finished" podID="d6a56f6e-f262-4959-8923-62a043247641" containerID="f599bdf22987342bfc7b589a80987494fa8db8470040002d19f83f22ef439edd" exitCode=0
Jul 15 04:41:08.337552 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:08.337237    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl" event={"ID":"d6a56f6e-f262-4959-8923-62a043247641","Type":"ContainerDied","Data":"f599bdf22987342bfc7b589a80987494fa8db8470040002d19f83f22ef439edd"}
Jul 15 04:41:09.465279 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:09.465255    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl"
Jul 15 04:41:09.531806 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:09.531777    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a56f6e-f262-4959-8923-62a043247641-maas-api-service-ca\") pod \"d6a56f6e-f262-4959-8923-62a043247641\" (UID: \"d6a56f6e-f262-4959-8923-62a043247641\") "
Jul 15 04:41:09.532156 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:09.532138    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a56f6e-f262-4959-8923-62a043247641-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d6a56f6e-f262-4959-8923-62a043247641" (UID: "d6a56f6e-f262-4959-8923-62a043247641"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:41:09.632699 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:09.632634    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6a56f6e-f262-4959-8923-62a043247641-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:41:10.351229 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:10.351151    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl"
Jul 15 04:41:10.351229 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:10.351164    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-699a3596-tttbl" event={"ID":"d6a56f6e-f262-4959-8923-62a043247641","Type":"ContainerDied","Data":"30532c8ff632eea5b449ed1655615f71198ab60869461ab53cd4fc225800c229"}
Jul 15 04:41:10.351407 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:10.351245    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30532c8ff632eea5b449ed1655615f71198ab60869461ab53cd4fc225800c229"
Jul 15 04:41:12.090686 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:12.090650    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:41:12.095701 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:12.095681    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:41:26.880432 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:26.880391    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"]
Jul 15 04:41:41.900663 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:41.900619    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp" podUID="62a24c44-fd6d-4341-8993-c1dfb4014e18" containerName="main" containerID="cri-o://7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741" gracePeriod=45
Jul 15 04:41:42.143320 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.143295    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:41:42.269204 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.269122    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-home\") pod \"62a24c44-fd6d-4341-8993-c1dfb4014e18\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") "
Jul 15 04:41:42.269204 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.269175    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-tmp-dir\") pod \"62a24c44-fd6d-4341-8993-c1dfb4014e18\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") "
Jul 15 04:41:42.269204 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.269203    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9wqp\" (UniqueName: \"kubernetes.io/projected/62a24c44-fd6d-4341-8993-c1dfb4014e18-kube-api-access-g9wqp\") pod \"62a24c44-fd6d-4341-8993-c1dfb4014e18\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") "
Jul 15 04:41:42.269475 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.269225    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a24c44-fd6d-4341-8993-c1dfb4014e18-tls-certs\") pod \"62a24c44-fd6d-4341-8993-c1dfb4014e18\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") "
Jul 15 04:41:42.269475 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.269239    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-dshm\") pod \"62a24c44-fd6d-4341-8993-c1dfb4014e18\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") "
Jul 15 04:41:42.269475 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.269268    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-model-cache\") pod \"62a24c44-fd6d-4341-8993-c1dfb4014e18\" (UID: \"62a24c44-fd6d-4341-8993-c1dfb4014e18\") "
Jul 15 04:41:42.269475 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.269392    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-home" (OuterVolumeSpecName: "home") pod "62a24c44-fd6d-4341-8993-c1dfb4014e18" (UID: "62a24c44-fd6d-4341-8993-c1dfb4014e18"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:41:42.269696 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.269555    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "62a24c44-fd6d-4341-8993-c1dfb4014e18" (UID: "62a24c44-fd6d-4341-8993-c1dfb4014e18"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:41:42.269696 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.269582    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-model-cache" (OuterVolumeSpecName: "model-cache") pod "62a24c44-fd6d-4341-8993-c1dfb4014e18" (UID: "62a24c44-fd6d-4341-8993-c1dfb4014e18"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:41:42.269804 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.269776    2539 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-home\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:41:42.271524 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.271495    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-dshm" (OuterVolumeSpecName: "dshm") pod "62a24c44-fd6d-4341-8993-c1dfb4014e18" (UID: "62a24c44-fd6d-4341-8993-c1dfb4014e18"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:41:42.271524 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.271511    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62a24c44-fd6d-4341-8993-c1dfb4014e18-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "62a24c44-fd6d-4341-8993-c1dfb4014e18" (UID: "62a24c44-fd6d-4341-8993-c1dfb4014e18"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 04:41:42.271664 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.271592    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a24c44-fd6d-4341-8993-c1dfb4014e18-kube-api-access-g9wqp" (OuterVolumeSpecName: "kube-api-access-g9wqp") pod "62a24c44-fd6d-4341-8993-c1dfb4014e18" (UID: "62a24c44-fd6d-4341-8993-c1dfb4014e18"). InnerVolumeSpecName "kube-api-access-g9wqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:41:42.370699 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.370673    2539 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-tmp-dir\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:41:42.370699 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.370696    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9wqp\" (UniqueName: \"kubernetes.io/projected/62a24c44-fd6d-4341-8993-c1dfb4014e18-kube-api-access-g9wqp\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:41:42.370847 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.370712    2539 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a24c44-fd6d-4341-8993-c1dfb4014e18-tls-certs\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:41:42.370847 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.370725    2539 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-dshm\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:41:42.370847 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.370736    2539 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a24c44-fd6d-4341-8993-c1dfb4014e18-model-cache\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:41:42.486824 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.486795    2539 generic.go:356] "Generic (PLEG): container finished" podID="62a24c44-fd6d-4341-8993-c1dfb4014e18" containerID="7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741" exitCode=0
Jul 15 04:41:42.486985 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.486833    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"
Jul 15 04:41:42.486985 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.486838    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp" event={"ID":"62a24c44-fd6d-4341-8993-c1dfb4014e18","Type":"ContainerDied","Data":"7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741"}
Jul 15 04:41:42.486985 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.486866    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp" event={"ID":"62a24c44-fd6d-4341-8993-c1dfb4014e18","Type":"ContainerDied","Data":"d6907d2711acfd6d852fb2ea3f9673f23b0338244cc96d166229a898f80200fc"}
Jul 15 04:41:42.486985 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.486882    2539 scope.go:117] "RemoveContainer" containerID="7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741"
Jul 15 04:41:42.495311 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.495291    2539 scope.go:117] "RemoveContainer" containerID="7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741"
Jul 15 04:41:42.495539 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:41:42.495520    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741\": container with ID starting with 7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741 not found: ID does not exist" containerID="7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741"
Jul 15 04:41:42.495588 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.495546    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741"} err="failed to get container status \"7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741\": rpc error: code = NotFound desc = could not find container \"7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741\": container with ID starting with 7701d7331e5bcc165eff78eda171b2c66a8971601fc9e1b4a8e880cc42e15741 not found: ID does not exist"
Jul 15 04:41:42.506535 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.506509    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"]
Jul 15 04:41:42.510535 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:42.510517    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-699a3596/e2e-lifecycle-model-699a3596-kserve-6cc687d795-wr6rp"]
Jul 15 04:41:44.078830 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:41:44.078795    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a24c44-fd6d-4341-8993-c1dfb4014e18" path="/var/lib/kubelet/pods/62a24c44-fd6d-4341-8993-c1dfb4014e18/volumes"
Jul 15 04:42:12.170967 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:42:12.170898    2539 scope.go:117] "RemoveContainer" containerID="e0eaf5cfa1b3fbd69f94501ab58047286fefc4bcdfc8b61baa8fc5d7ced71b04"
Jul 15 04:43:12.190638 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:12.190609    2539 scope.go:117] "RemoveContainer" containerID="a7022c01ef668905115fb50f2cffa77b209a7a904b8354cbf6b9a3183fd84eaf"
Jul 15 04:43:30.579457 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.579420    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"]
Jul 15 04:43:30.579898 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.579810    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a56f6e-f262-4959-8923-62a043247641" containerName="revoke-keys"
Jul 15 04:43:30.579898 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.579826    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a56f6e-f262-4959-8923-62a043247641" containerName="revoke-keys"
Jul 15 04:43:30.579898 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.579845    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a24c44-fd6d-4341-8993-c1dfb4014e18" containerName="main"
Jul 15 04:43:30.579898 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.579855    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a24c44-fd6d-4341-8993-c1dfb4014e18" containerName="main"
Jul 15 04:43:30.580121 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.579925    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a24c44-fd6d-4341-8993-c1dfb4014e18" containerName="main"
Jul 15 04:43:30.580121 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.579940    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a56f6e-f262-4959-8923-62a043247641" containerName="revoke-keys"
Jul 15 04:43:30.582886 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.582866    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.585579 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.585558    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-005cfa\"/\"openshift-service-ca.crt\""
Jul 15 04:43:30.586759 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.586731    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-005cfa\"/\"default-dockercfg-lv4xk\""
Jul 15 04:43:30.586861 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.586806    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-005cfa\"/\"kube-root-ca.crt\""
Jul 15 04:43:30.586861 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.586837    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-005cfa\"/\"test-model-005cfa-kserve-self-signed-certs\""
Jul 15 04:43:30.592814 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.592791    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"]
Jul 15 04:43:30.707947 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.707923    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpzvz\" (UniqueName: \"kubernetes.io/projected/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-kube-api-access-vpzvz\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.708067 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.707953    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-home\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.708067 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.707997    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tls-certs\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.708067 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.708035    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-model-cache\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.708067 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.708058    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tmp-dir\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.708232 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.708131    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-dshm\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.808670 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.808643    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-dshm\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.808766 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.808688    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpzvz\" (UniqueName: \"kubernetes.io/projected/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-kube-api-access-vpzvz\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.808766 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.808713    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-home\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.808847 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.808826    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tls-certs\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.808882 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.808871    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-model-cache\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.808922 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.808904    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tmp-dir\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.809125 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.809077    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-home\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.809176 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.809161    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-model-cache\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.809296 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.809275    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tmp-dir\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.811187 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.811162    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-dshm\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.811282 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.811266    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tls-certs\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.816817 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.816795    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpzvz\" (UniqueName: \"kubernetes.io/projected/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-kube-api-access-vpzvz\") pod \"test-model-005cfa-kserve-6c7d6d75d7-bthwb\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") " pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:30.892515 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:30.892453    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:31.022397 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:31.022373    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"]
Jul 15 04:43:31.024917 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:43:31.024881    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5db1aab_1653_4cb6_8cf7_2ddf5a95d8fe.slice/crio-3b596e415ab8219f0b485fff1a466743c8ddb9493372f830565682d60cf4e346 WatchSource:0}: Error finding container 3b596e415ab8219f0b485fff1a466743c8ddb9493372f830565682d60cf4e346: Status 404 returned error can't find the container with id 3b596e415ab8219f0b485fff1a466743c8ddb9493372f830565682d60cf4e346
Jul 15 04:43:31.958263 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:31.958226    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb" event={"ID":"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe","Type":"ContainerStarted","Data":"f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978"}
Jul 15 04:43:31.958630 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:31.958272    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb" event={"ID":"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe","Type":"ContainerStarted","Data":"3b596e415ab8219f0b485fff1a466743c8ddb9493372f830565682d60cf4e346"}
Jul 15 04:43:31.978778 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:31.978719    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb" podStartSLOduration=1.978708143 podStartE2EDuration="1.978708143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:43:31.977539307 +0000 UTC m=+2240.414466208" watchObservedRunningTime="2026-07-15 04:43:31.978708143 +0000 UTC m=+2240.415635039"
Jul 15 04:43:40.893065 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:40.893023    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:40.893556 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:40.893110    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:40.905924 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:40.905861    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:43:41.007485 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:43:41.007458    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:44:04.675416 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.675384    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"]
Jul 15 04:44:04.678751 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.678731    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.684838 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.682107    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-194ff1\"/\"kube-root-ca.crt\""
Jul 15 04:44:04.684838 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.683743    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-194ff1\"/\"test-model-194ff1-kserve-self-signed-certs\""
Jul 15 04:44:04.684838 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.683992    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-194ff1\"/\"openshift-service-ca.crt\""
Jul 15 04:44:04.684838 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.684274    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-194ff1\"/\"default-dockercfg-fmb7m\""
Jul 15 04:44:04.689401 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.689374    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"]
Jul 15 04:44:04.853694 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.853647    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/307c54c0-905a-45dc-955f-561d3bc20b76-tls-certs\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.853694 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.853707    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-tmp-dir\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.853891 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.853762    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-home\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.853891 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.853800    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-model-cache\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.853891 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.853859    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2ccx\" (UniqueName: \"kubernetes.io/projected/307c54c0-905a-45dc-955f-561d3bc20b76-kube-api-access-v2ccx\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.853986 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.853896    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-dshm\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.955169 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.955042    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-dshm\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.955169 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.955125    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/307c54c0-905a-45dc-955f-561d3bc20b76-tls-certs\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.955169 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.955154    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-tmp-dir\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.955169 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.955171    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-home\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.955491 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.955189    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-model-cache\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.955491 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.955222    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2ccx\" (UniqueName: \"kubernetes.io/projected/307c54c0-905a-45dc-955f-561d3bc20b76-kube-api-access-v2ccx\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.955582 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.955564    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-tmp-dir\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.955639 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.955601    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-home\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.955639 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.955620    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-model-cache\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.957491 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.957469    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-dshm\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.957762 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.957746    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/307c54c0-905a-45dc-955f-561d3bc20b76-tls-certs\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.962760 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.962742    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2ccx\" (UniqueName: \"kubernetes.io/projected/307c54c0-905a-45dc-955f-561d3bc20b76-kube-api-access-v2ccx\") pod \"test-model-194ff1-kserve-7b88fb488c-6d8p6\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") " pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:04.991679 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:04.991655    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:05.121009 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:05.120980    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"]
Jul 15 04:44:05.122065 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:44:05.122038    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod307c54c0_905a_45dc_955f_561d3bc20b76.slice/crio-c136e1a3a1bdbd213a7a8bffaaa582380498bf9c24517c4e911c565d39b76328 WatchSource:0}: Error finding container c136e1a3a1bdbd213a7a8bffaaa582380498bf9c24517c4e911c565d39b76328: Status 404 returned error can't find the container with id c136e1a3a1bdbd213a7a8bffaaa582380498bf9c24517c4e911c565d39b76328
Jul 15 04:44:06.110308 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:06.110275    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6" event={"ID":"307c54c0-905a-45dc-955f-561d3bc20b76","Type":"ContainerStarted","Data":"579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed"}
Jul 15 04:44:06.110308 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:06.110311    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6" event={"ID":"307c54c0-905a-45dc-955f-561d3bc20b76","Type":"ContainerStarted","Data":"c136e1a3a1bdbd213a7a8bffaaa582380498bf9c24517c4e911c565d39b76328"}
Jul 15 04:44:06.128222 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:06.128169    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6" podStartSLOduration=2.128154576 podStartE2EDuration="2.128154576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:44:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:44:06.126941622 +0000 UTC m=+2274.563868520" watchObservedRunningTime="2026-07-15 04:44:06.128154576 +0000 UTC m=+2274.565081472"
Jul 15 04:44:14.992770 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:14.992731    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:14.992770 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:14.992777    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:15.005176 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:15.005154    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:15.161205 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:15.161179    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:22.908779 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:22.908745    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"]
Jul 15 04:44:23.826498 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:23.826470    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"]
Jul 15 04:44:23.984208 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:23.984176    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224"]
Jul 15 04:44:23.987255 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:23.987234    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224"
Jul 15 04:44:23.989757 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:23.989738    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:44:23.989834 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:23.989743    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:44:23.994234 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:23.994050    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224"]
Jul 15 04:44:24.086994 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:24.086916    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afba0960-6027-4bdc-b4fb-b15ef4ef4af2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-005cfa-j6224\" (UID: \"afba0960-6027-4bdc-b4fb-b15ef4ef4af2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224"
Jul 15 04:44:24.187633 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:24.187603    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afba0960-6027-4bdc-b4fb-b15ef4ef4af2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-005cfa-j6224\" (UID: \"afba0960-6027-4bdc-b4fb-b15ef4ef4af2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224"
Jul 15 04:44:24.188259 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:24.188240    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afba0960-6027-4bdc-b4fb-b15ef4ef4af2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-005cfa-j6224\" (UID: \"afba0960-6027-4bdc-b4fb-b15ef4ef4af2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224"
Jul 15 04:44:24.298123 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:24.298084    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224"
Jul 15 04:44:24.426024 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:24.425993    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224"]
Jul 15 04:44:24.429001 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:44:24.428972    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafba0960_6027_4bdc_b4fb_b15ef4ef4af2.slice/crio-a12f8b11f3252e3fa9f612740969f0e44988d24cf647ef5a79641b45a9b00ad0 WatchSource:0}: Error finding container a12f8b11f3252e3fa9f612740969f0e44988d24cf647ef5a79641b45a9b00ad0: Status 404 returned error can't find the container with id a12f8b11f3252e3fa9f612740969f0e44988d24cf647ef5a79641b45a9b00ad0
Jul 15 04:44:25.195713 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:25.195683    2539 generic.go:356] "Generic (PLEG): container finished" podID="afba0960-6027-4bdc-b4fb-b15ef4ef4af2" containerID="0415807b0911598e0ef6fb90b6224192c1e05aec67d111d49931ed8d2b6a8e47" exitCode=0
Jul 15 04:44:25.196072 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:25.195770    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224" event={"ID":"afba0960-6027-4bdc-b4fb-b15ef4ef4af2","Type":"ContainerDied","Data":"0415807b0911598e0ef6fb90b6224192c1e05aec67d111d49931ed8d2b6a8e47"}
Jul 15 04:44:25.196072 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:25.195852    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224" event={"ID":"afba0960-6027-4bdc-b4fb-b15ef4ef4af2","Type":"ContainerStarted","Data":"a12f8b11f3252e3fa9f612740969f0e44988d24cf647ef5a79641b45a9b00ad0"}
Jul 15 04:44:26.325374 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:26.325346    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224"
Jul 15 04:44:26.403775 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:26.403749    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afba0960-6027-4bdc-b4fb-b15ef4ef4af2-maas-api-service-ca\") pod \"afba0960-6027-4bdc-b4fb-b15ef4ef4af2\" (UID: \"afba0960-6027-4bdc-b4fb-b15ef4ef4af2\") "
Jul 15 04:44:26.404073 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:26.404051    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afba0960-6027-4bdc-b4fb-b15ef4ef4af2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "afba0960-6027-4bdc-b4fb-b15ef4ef4af2" (UID: "afba0960-6027-4bdc-b4fb-b15ef4ef4af2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:44:26.504535 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:26.504470    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afba0960-6027-4bdc-b4fb-b15ef4ef4af2-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:27.205123 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:27.205073    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224" event={"ID":"afba0960-6027-4bdc-b4fb-b15ef4ef4af2","Type":"ContainerDied","Data":"a12f8b11f3252e3fa9f612740969f0e44988d24cf647ef5a79641b45a9b00ad0"}
Jul 15 04:44:27.205123 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:27.205110    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-005cfa-j6224"
Jul 15 04:44:27.205316 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:27.205134    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a12f8b11f3252e3fa9f612740969f0e44988d24cf647ef5a79641b45a9b00ad0"
Jul 15 04:44:37.928565 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:37.928520    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb" podUID="a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" containerName="main" containerID="cri-o://f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978" gracePeriod=45
Jul 15 04:44:38.174129 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.174081    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:44:38.252568 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.252501    2539 generic.go:356] "Generic (PLEG): container finished" podID="a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" containerID="f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978" exitCode=0
Jul 15 04:44:38.252568 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.252547    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"
Jul 15 04:44:38.252707 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.252593    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb" event={"ID":"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe","Type":"ContainerDied","Data":"f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978"}
Jul 15 04:44:38.252707 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.252640    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb" event={"ID":"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe","Type":"ContainerDied","Data":"3b596e415ab8219f0b485fff1a466743c8ddb9493372f830565682d60cf4e346"}
Jul 15 04:44:38.252707 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.252662    2539 scope.go:117] "RemoveContainer" containerID="f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978"
Jul 15 04:44:38.260465 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.260449    2539 scope.go:117] "RemoveContainer" containerID="f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978"
Jul 15 04:44:38.260701 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:44:38.260683    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978\": container with ID starting with f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978 not found: ID does not exist" containerID="f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978"
Jul 15 04:44:38.260765 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.260708    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978"} err="failed to get container status \"f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978\": rpc error: code = NotFound desc = could not find container \"f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978\": container with ID starting with f1f675285ca8291aac473422e698927477ff6d3657659abd54bccee8101f1978 not found: ID does not exist"
Jul 15 04:44:38.291970 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.291951    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-model-cache\") pod \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") "
Jul 15 04:44:38.292047 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.291981    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tmp-dir\") pod \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") "
Jul 15 04:44:38.292047 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.292030    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-dshm\") pod \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") "
Jul 15 04:44:38.292146 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.292050    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpzvz\" (UniqueName: \"kubernetes.io/projected/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-kube-api-access-vpzvz\") pod \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") "
Jul 15 04:44:38.292146 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.292079    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tls-certs\") pod \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") "
Jul 15 04:44:38.292146 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.292120    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-home\") pod \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\" (UID: \"a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe\") "
Jul 15 04:44:38.292298 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.292198    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" (UID: "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:44:38.292379 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.292359    2539 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-model-cache\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:38.292432 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.292394    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" (UID: "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:44:38.292473 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.292430    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-home" (OuterVolumeSpecName: "home") pod "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" (UID: "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:44:38.294346 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.294313    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-dshm" (OuterVolumeSpecName: "dshm") pod "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" (UID: "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:44:38.294431 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.294374    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-kube-api-access-vpzvz" (OuterVolumeSpecName: "kube-api-access-vpzvz") pod "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" (UID: "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe"). InnerVolumeSpecName "kube-api-access-vpzvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:44:38.294431 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.294417    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" (UID: "a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 04:44:38.393002 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.392977    2539 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tls-certs\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:38.393002 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.392998    2539 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-home\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:38.393151 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.393009    2539 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-tmp-dir\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:38.393151 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.393017    2539 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-dshm\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:38.393151 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.393025    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpzvz\" (UniqueName: \"kubernetes.io/projected/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe-kube-api-access-vpzvz\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:38.574056 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.574029    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"]
Jul 15 04:44:38.579872 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.579852    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-005cfa/test-model-005cfa-kserve-6c7d6d75d7-bthwb"]
Jul 15 04:44:38.846535 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:38.846456    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6" podUID="307c54c0-905a-45dc-955f-561d3bc20b76" containerName="main" containerID="cri-o://579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed" gracePeriod=45
Jul 15 04:44:39.087514 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.087493    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:39.200685 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.200615    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-dshm\") pod \"307c54c0-905a-45dc-955f-561d3bc20b76\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") "
Jul 15 04:44:39.200685 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.200657    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-model-cache\") pod \"307c54c0-905a-45dc-955f-561d3bc20b76\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") "
Jul 15 04:44:39.200875 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.200689    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-home\") pod \"307c54c0-905a-45dc-955f-561d3bc20b76\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") "
Jul 15 04:44:39.200875 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.200712    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2ccx\" (UniqueName: \"kubernetes.io/projected/307c54c0-905a-45dc-955f-561d3bc20b76-kube-api-access-v2ccx\") pod \"307c54c0-905a-45dc-955f-561d3bc20b76\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") "
Jul 15 04:44:39.200875 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.200763    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-tmp-dir\") pod \"307c54c0-905a-45dc-955f-561d3bc20b76\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") "
Jul 15 04:44:39.200875 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.200809    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/307c54c0-905a-45dc-955f-561d3bc20b76-tls-certs\") pod \"307c54c0-905a-45dc-955f-561d3bc20b76\" (UID: \"307c54c0-905a-45dc-955f-561d3bc20b76\") "
Jul 15 04:44:39.201077 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.200898    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-model-cache" (OuterVolumeSpecName: "model-cache") pod "307c54c0-905a-45dc-955f-561d3bc20b76" (UID: "307c54c0-905a-45dc-955f-561d3bc20b76"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:44:39.201077 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.200938    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-home" (OuterVolumeSpecName: "home") pod "307c54c0-905a-45dc-955f-561d3bc20b76" (UID: "307c54c0-905a-45dc-955f-561d3bc20b76"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:44:39.201077 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.201057    2539 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-model-cache\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:39.201077 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.201069    2539 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-home\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:39.201281 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.201072    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "307c54c0-905a-45dc-955f-561d3bc20b76" (UID: "307c54c0-905a-45dc-955f-561d3bc20b76"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:44:39.203036 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.203008    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-dshm" (OuterVolumeSpecName: "dshm") pod "307c54c0-905a-45dc-955f-561d3bc20b76" (UID: "307c54c0-905a-45dc-955f-561d3bc20b76"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:44:39.203036 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.203009    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/307c54c0-905a-45dc-955f-561d3bc20b76-kube-api-access-v2ccx" (OuterVolumeSpecName: "kube-api-access-v2ccx") pod "307c54c0-905a-45dc-955f-561d3bc20b76" (UID: "307c54c0-905a-45dc-955f-561d3bc20b76"). InnerVolumeSpecName "kube-api-access-v2ccx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:44:39.203225 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.203060    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/307c54c0-905a-45dc-955f-561d3bc20b76-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "307c54c0-905a-45dc-955f-561d3bc20b76" (UID: "307c54c0-905a-45dc-955f-561d3bc20b76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 04:44:39.258644 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.258620    2539 generic.go:356] "Generic (PLEG): container finished" podID="307c54c0-905a-45dc-955f-561d3bc20b76" containerID="579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed" exitCode=0
Jul 15 04:44:39.258743 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.258649    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6" event={"ID":"307c54c0-905a-45dc-955f-561d3bc20b76","Type":"ContainerDied","Data":"579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed"}
Jul 15 04:44:39.258743 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.258664    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"
Jul 15 04:44:39.258743 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.258686    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6" event={"ID":"307c54c0-905a-45dc-955f-561d3bc20b76","Type":"ContainerDied","Data":"c136e1a3a1bdbd213a7a8bffaaa582380498bf9c24517c4e911c565d39b76328"}
Jul 15 04:44:39.258743 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.258704    2539 scope.go:117] "RemoveContainer" containerID="579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed"
Jul 15 04:44:39.269202 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.269189    2539 scope.go:117] "RemoveContainer" containerID="579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed"
Jul 15 04:44:39.269430 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:44:39.269414    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed\": container with ID starting with 579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed not found: ID does not exist" containerID="579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed"
Jul 15 04:44:39.269484 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.269437    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed"} err="failed to get container status \"579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed\": rpc error: code = NotFound desc = could not find container \"579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed\": container with ID starting with 579584442bca4c4f4b53453dc7ea852565d97e81d23e53e0d4fa34291152f4ed not found: ID does not exist"
Jul 15 04:44:39.281071 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.281049    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"]
Jul 15 04:44:39.284458 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.284440    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-194ff1/test-model-194ff1-kserve-7b88fb488c-6d8p6"]
Jul 15 04:44:39.301802 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.301781    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2ccx\" (UniqueName: \"kubernetes.io/projected/307c54c0-905a-45dc-955f-561d3bc20b76-kube-api-access-v2ccx\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:39.301860 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.301803    2539 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-tmp-dir\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:39.301860 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.301812    2539 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/307c54c0-905a-45dc-955f-561d3bc20b76-tls-certs\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:39.301860 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:39.301824    2539 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/307c54c0-905a-45dc-955f-561d3bc20b76-dshm\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:40.078806 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:40.078774    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="307c54c0-905a-45dc-955f-561d3bc20b76" path="/var/lib/kubelet/pods/307c54c0-905a-45dc-955f-561d3bc20b76/volumes"
Jul 15 04:44:40.079160 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:40.079147    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" path="/var/lib/kubelet/pods/a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe/volumes"
Jul 15 04:44:50.150988 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.150949    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj"]
Jul 15 04:44:50.151508 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.151376    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" containerName="main"
Jul 15 04:44:50.151508 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.151395    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" containerName="main"
Jul 15 04:44:50.151508 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.151415    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afba0960-6027-4bdc-b4fb-b15ef4ef4af2" containerName="revoke-keys"
Jul 15 04:44:50.151508 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.151423    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="afba0960-6027-4bdc-b4fb-b15ef4ef4af2" containerName="revoke-keys"
Jul 15 04:44:50.151508 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.151435    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307c54c0-905a-45dc-955f-561d3bc20b76" containerName="main"
Jul 15 04:44:50.151508 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.151443    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="307c54c0-905a-45dc-955f-561d3bc20b76" containerName="main"
Jul 15 04:44:50.151793 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.151520    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="307c54c0-905a-45dc-955f-561d3bc20b76" containerName="main"
Jul 15 04:44:50.151793 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.151532    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5db1aab-1653-4cb6-8cf7-2ddf5a95d8fe" containerName="main"
Jul 15 04:44:50.151793 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.151544    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="afba0960-6027-4bdc-b4fb-b15ef4ef4af2" containerName="revoke-keys"
Jul 15 04:44:50.154452 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.154430    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj"
Jul 15 04:44:50.156890 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.156868    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:44:50.156987 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.156902    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:44:50.161487 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.161426    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj"]
Jul 15 04:44:50.282295 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.282263    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51b04c18-8aef-4ae6-9af5-233bd4cfbc59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj\" (UID: \"51b04c18-8aef-4ae6-9af5-233bd4cfbc59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj"
Jul 15 04:44:50.382686 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.382658    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51b04c18-8aef-4ae6-9af5-233bd4cfbc59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj\" (UID: \"51b04c18-8aef-4ae6-9af5-233bd4cfbc59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj"
Jul 15 04:44:50.383243 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.383224    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51b04c18-8aef-4ae6-9af5-233bd4cfbc59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj\" (UID: \"51b04c18-8aef-4ae6-9af5-233bd4cfbc59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj"
Jul 15 04:44:50.465039 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.464983    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj"
Jul 15 04:44:50.589423 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:50.589372    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj"]
Jul 15 04:44:50.591425 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:44:50.591393    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b04c18_8aef_4ae6_9af5_233bd4cfbc59.slice/crio-8febcfd99e80120a4e3a2f287c967e6b478bb7517c6ea6a879c20913b12a0e35 WatchSource:0}: Error finding container 8febcfd99e80120a4e3a2f287c967e6b478bb7517c6ea6a879c20913b12a0e35: Status 404 returned error can't find the container with id 8febcfd99e80120a4e3a2f287c967e6b478bb7517c6ea6a879c20913b12a0e35
Jul 15 04:44:51.310961 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:51.310934    2539 generic.go:356] "Generic (PLEG): container finished" podID="51b04c18-8aef-4ae6-9af5-233bd4cfbc59" containerID="7debe3e145c83c0be04d26a56824432b3633b357726c3babbf9a70aca3b73dd0" exitCode=0
Jul 15 04:44:51.311312 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:51.311027    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj" event={"ID":"51b04c18-8aef-4ae6-9af5-233bd4cfbc59","Type":"ContainerDied","Data":"7debe3e145c83c0be04d26a56824432b3633b357726c3babbf9a70aca3b73dd0"}
Jul 15 04:44:51.311312 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:51.311076    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj" event={"ID":"51b04c18-8aef-4ae6-9af5-233bd4cfbc59","Type":"ContainerStarted","Data":"8febcfd99e80120a4e3a2f287c967e6b478bb7517c6ea6a879c20913b12a0e35"}
Jul 15 04:44:52.443739 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:52.443716    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj"
Jul 15 04:44:52.496752 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:52.496729    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51b04c18-8aef-4ae6-9af5-233bd4cfbc59-maas-api-service-ca\") pod \"51b04c18-8aef-4ae6-9af5-233bd4cfbc59\" (UID: \"51b04c18-8aef-4ae6-9af5-233bd4cfbc59\") "
Jul 15 04:44:52.497039 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:52.497020    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51b04c18-8aef-4ae6-9af5-233bd4cfbc59-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "51b04c18-8aef-4ae6-9af5-233bd4cfbc59" (UID: "51b04c18-8aef-4ae6-9af5-233bd4cfbc59"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:44:52.597616 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:52.597535    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51b04c18-8aef-4ae6-9af5-233bd4cfbc59-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:44:53.320642 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:53.320615    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj"
Jul 15 04:44:53.320788 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:53.320644    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj" event={"ID":"51b04c18-8aef-4ae6-9af5-233bd4cfbc59","Type":"ContainerDied","Data":"8febcfd99e80120a4e3a2f287c967e6b478bb7517c6ea6a879c20913b12a0e35"}
Jul 15 04:44:53.320788 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:44:53.320689    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8febcfd99e80120a4e3a2f287c967e6b478bb7517c6ea6a879c20913b12a0e35"
Jul 15 04:45:00.141255 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:00.141218    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv"]
Jul 15 04:45:00.141612 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:00.141498    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b04c18-8aef-4ae6-9af5-233bd4cfbc59" containerName="revoke-keys"
Jul 15 04:45:00.141612 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:00.141509    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b04c18-8aef-4ae6-9af5-233bd4cfbc59" containerName="revoke-keys"
Jul 15 04:45:00.141612 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:00.141557    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="51b04c18-8aef-4ae6-9af5-233bd4cfbc59" containerName="revoke-keys"
Jul 15 04:45:00.144421 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:00.144406    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv"
Jul 15 04:45:00.146946 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:00.146924    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:45:00.151496 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:00.151454    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv"]
Jul 15 04:45:00.154955 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:00.154937    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv"
Jul 15 04:45:00.285497 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:00.285402    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv"]
Jul 15 04:45:00.288134 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:45:00.288075    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9d0b18_9ed3_4554_81b0_5519d9cbe16c.slice/crio-b7b69a3cd23fa8ef61f0a3d103e439f776712cac85b722d3d751cb0e59ec01b0 WatchSource:0}: Error finding container b7b69a3cd23fa8ef61f0a3d103e439f776712cac85b722d3d751cb0e59ec01b0: Status 404 returned error can't find the container with id b7b69a3cd23fa8ef61f0a3d103e439f776712cac85b722d3d751cb0e59ec01b0
Jul 15 04:45:00.349798 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:00.349767    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv" event={"ID":"3c9d0b18-9ed3-4554-81b0-5519d9cbe16c","Type":"ContainerStarted","Data":"b7b69a3cd23fa8ef61f0a3d103e439f776712cac85b722d3d751cb0e59ec01b0"}
Jul 15 04:45:00.678704 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:00.678675    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv"]
Jul 15 04:45:01.356018 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:01.355985    2539 generic.go:356] "Generic (PLEG): container finished" podID="3c9d0b18-9ed3-4554-81b0-5519d9cbe16c" containerID="db3e62f3e5e7e8592b43010fd0bd388d4c0022f36ebf5529fb34d590f56dfccc" exitCode=6
Jul 15 04:45:01.356369 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:01.356027    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv" event={"ID":"3c9d0b18-9ed3-4554-81b0-5519d9cbe16c","Type":"ContainerDied","Data":"db3e62f3e5e7e8592b43010fd0bd388d4c0022f36ebf5529fb34d590f56dfccc"}
Jul 15 04:45:01.356369 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:01.356137    2539 scope.go:117] "RemoveContainer" containerID="db3e62f3e5e7e8592b43010fd0bd388d4c0022f36ebf5529fb34d590f56dfccc"
Jul 15 04:45:02.362713 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:02.362679    2539 generic.go:356] "Generic (PLEG): container finished" podID="3c9d0b18-9ed3-4554-81b0-5519d9cbe16c" containerID="72189a91e47554e593c837af1b210538b965b1f45e7c59323a1d799e58ab1bfa" exitCode=6
Jul 15 04:45:02.363109 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:02.362781    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv" event={"ID":"3c9d0b18-9ed3-4554-81b0-5519d9cbe16c","Type":"ContainerDied","Data":"72189a91e47554e593c837af1b210538b965b1f45e7c59323a1d799e58ab1bfa"}
Jul 15 04:45:02.363109 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:02.362827    2539 scope.go:117] "RemoveContainer" containerID="db3e62f3e5e7e8592b43010fd0bd388d4c0022f36ebf5529fb34d590f56dfccc"
Jul 15 04:45:02.488084 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:02.488063    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv"
Jul 15 04:45:03.368345 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:03.368313    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv"
Jul 15 04:45:03.368345 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:03.368337    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv" event={"ID":"3c9d0b18-9ed3-4554-81b0-5519d9cbe16c","Type":"ContainerDied","Data":"b7b69a3cd23fa8ef61f0a3d103e439f776712cac85b722d3d751cb0e59ec01b0"}
Jul 15 04:45:03.368787 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:03.368392    2539 scope.go:117] "RemoveContainer" containerID="72189a91e47554e593c837af1b210538b965b1f45e7c59323a1d799e58ab1bfa"
Jul 15 04:45:03.388991 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:03.388970    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv"]
Jul 15 04:45:03.394815 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:03.394788    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-194ff1-29734845-5tsmv"]
Jul 15 04:45:04.079428 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:04.079395    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c9d0b18-9ed3-4554-81b0-5519d9cbe16c" path="/var/lib/kubelet/pods/3c9d0b18-9ed3-4554-81b0-5519d9cbe16c/volumes"
Jul 15 04:45:41.162313 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.162273    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd"]
Jul 15 04:45:41.162811 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.162685    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9d0b18-9ed3-4554-81b0-5519d9cbe16c" containerName="cleanup"
Jul 15 04:45:41.162811 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.162703    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9d0b18-9ed3-4554-81b0-5519d9cbe16c" containerName="cleanup"
Jul 15 04:45:41.162811 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.162733    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9d0b18-9ed3-4554-81b0-5519d9cbe16c" containerName="cleanup"
Jul 15 04:45:41.162811 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.162740    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9d0b18-9ed3-4554-81b0-5519d9cbe16c" containerName="cleanup"
Jul 15 04:45:41.163011 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.162820    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9d0b18-9ed3-4554-81b0-5519d9cbe16c" containerName="cleanup"
Jul 15 04:45:41.163011 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.162835    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9d0b18-9ed3-4554-81b0-5519d9cbe16c" containerName="cleanup"
Jul 15 04:45:41.165787 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.165764    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd"
Jul 15 04:45:41.168611 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.168593    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:45:41.168731 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.168594    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:45:41.173402 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.173379    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd"]
Jul 15 04:45:41.234879 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.234845    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d564f76b-ede2-4174-af4b-cdf6ad136c4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd\" (UID: \"d564f76b-ede2-4174-af4b-cdf6ad136c4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd"
Jul 15 04:45:41.335404 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.335373    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d564f76b-ede2-4174-af4b-cdf6ad136c4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd\" (UID: \"d564f76b-ede2-4174-af4b-cdf6ad136c4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd"
Jul 15 04:45:41.335942 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.335925    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d564f76b-ede2-4174-af4b-cdf6ad136c4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd\" (UID: \"d564f76b-ede2-4174-af4b-cdf6ad136c4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd"
Jul 15 04:45:41.476124 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.476059    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd"
Jul 15 04:45:41.602799 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:41.602775    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd"]
Jul 15 04:45:41.605345 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:45:41.605312    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd564f76b_ede2_4174_af4b_cdf6ad136c4b.slice/crio-5610397d7ec94d026b36dd1baa7ca2edeb6685b2e2c364d134c0c8a3ff8238a7 WatchSource:0}: Error finding container 5610397d7ec94d026b36dd1baa7ca2edeb6685b2e2c364d134c0c8a3ff8238a7: Status 404 returned error can't find the container with id 5610397d7ec94d026b36dd1baa7ca2edeb6685b2e2c364d134c0c8a3ff8238a7
Jul 15 04:45:42.545997 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:42.545963    2539 generic.go:356] "Generic (PLEG): container finished" podID="d564f76b-ede2-4174-af4b-cdf6ad136c4b" containerID="402d673a859a5054f12930572404eccda747f0fa57b26b872e0265c774acc576" exitCode=0
Jul 15 04:45:42.546402 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:42.546023    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd" event={"ID":"d564f76b-ede2-4174-af4b-cdf6ad136c4b","Type":"ContainerDied","Data":"402d673a859a5054f12930572404eccda747f0fa57b26b872e0265c774acc576"}
Jul 15 04:45:42.546402 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:42.546068    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd" event={"ID":"d564f76b-ede2-4174-af4b-cdf6ad136c4b","Type":"ContainerStarted","Data":"5610397d7ec94d026b36dd1baa7ca2edeb6685b2e2c364d134c0c8a3ff8238a7"}
Jul 15 04:45:43.687505 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:43.687480    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd"
Jul 15 04:45:43.860068 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:43.859996    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d564f76b-ede2-4174-af4b-cdf6ad136c4b-maas-api-service-ca\") pod \"d564f76b-ede2-4174-af4b-cdf6ad136c4b\" (UID: \"d564f76b-ede2-4174-af4b-cdf6ad136c4b\") "
Jul 15 04:45:43.860311 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:43.860292    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d564f76b-ede2-4174-af4b-cdf6ad136c4b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d564f76b-ede2-4174-af4b-cdf6ad136c4b" (UID: "d564f76b-ede2-4174-af4b-cdf6ad136c4b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:45:43.960466 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:43.960429    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d564f76b-ede2-4174-af4b-cdf6ad136c4b-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:45:44.555738 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:44.555699    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd" event={"ID":"d564f76b-ede2-4174-af4b-cdf6ad136c4b","Type":"ContainerDied","Data":"5610397d7ec94d026b36dd1baa7ca2edeb6685b2e2c364d134c0c8a3ff8238a7"}
Jul 15 04:45:44.555885 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:44.555763    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5610397d7ec94d026b36dd1baa7ca2edeb6685b2e2c364d134c0c8a3ff8238a7"
Jul 15 04:45:44.555885 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:45:44.555717    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd"
Jul 15 04:46:07.291073 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.291042    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f"]
Jul 15 04:46:07.291435 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.291337    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d564f76b-ede2-4174-af4b-cdf6ad136c4b" containerName="revoke-keys"
Jul 15 04:46:07.291435 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.291348    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="d564f76b-ede2-4174-af4b-cdf6ad136c4b" containerName="revoke-keys"
Jul 15 04:46:07.291435 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.291396    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="d564f76b-ede2-4174-af4b-cdf6ad136c4b" containerName="revoke-keys"
Jul 15 04:46:07.294027 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.294012    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f"
Jul 15 04:46:07.296676 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.296656    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:46:07.296776 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.296693    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:46:07.302072 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.302043    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f"]
Jul 15 04:46:07.327112 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.327062    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf3e865-9c1c-445e-8c41-e4109eae87cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f\" (UID: \"eaf3e865-9c1c-445e-8c41-e4109eae87cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f"
Jul 15 04:46:07.427756 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.427731    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf3e865-9c1c-445e-8c41-e4109eae87cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f\" (UID: \"eaf3e865-9c1c-445e-8c41-e4109eae87cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f"
Jul 15 04:46:07.428330 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.428313    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf3e865-9c1c-445e-8c41-e4109eae87cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f\" (UID: \"eaf3e865-9c1c-445e-8c41-e4109eae87cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f"
Jul 15 04:46:07.605513 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.605490    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f"
Jul 15 04:46:07.734687 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:07.734666    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f"]
Jul 15 04:46:07.736454 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:46:07.736424    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf3e865_9c1c_445e_8c41_e4109eae87cd.slice/crio-114325c2ceec5903540f695780b9cbe280f38bb43992f32a5dc0c9ad7a438522 WatchSource:0}: Error finding container 114325c2ceec5903540f695780b9cbe280f38bb43992f32a5dc0c9ad7a438522: Status 404 returned error can't find the container with id 114325c2ceec5903540f695780b9cbe280f38bb43992f32a5dc0c9ad7a438522
Jul 15 04:46:08.667508 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:08.667435    2539 generic.go:356] "Generic (PLEG): container finished" podID="eaf3e865-9c1c-445e-8c41-e4109eae87cd" containerID="ac55a5c23733fb2d7f785ee325b1b2b6215601a613c737485db628f055de90eb" exitCode=0
Jul 15 04:46:08.667508 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:08.667483    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f" event={"ID":"eaf3e865-9c1c-445e-8c41-e4109eae87cd","Type":"ContainerDied","Data":"ac55a5c23733fb2d7f785ee325b1b2b6215601a613c737485db628f055de90eb"}
Jul 15 04:46:08.667864 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:08.667528    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f" event={"ID":"eaf3e865-9c1c-445e-8c41-e4109eae87cd","Type":"ContainerStarted","Data":"114325c2ceec5903540f695780b9cbe280f38bb43992f32a5dc0c9ad7a438522"}
Jul 15 04:46:09.797719 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:09.797694    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f"
Jul 15 04:46:09.844782 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:09.844759    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf3e865-9c1c-445e-8c41-e4109eae87cd-maas-api-service-ca\") pod \"eaf3e865-9c1c-445e-8c41-e4109eae87cd\" (UID: \"eaf3e865-9c1c-445e-8c41-e4109eae87cd\") "
Jul 15 04:46:09.845056 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:09.845036    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf3e865-9c1c-445e-8c41-e4109eae87cd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eaf3e865-9c1c-445e-8c41-e4109eae87cd" (UID: "eaf3e865-9c1c-445e-8c41-e4109eae87cd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:46:09.945882 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:09.945828    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf3e865-9c1c-445e-8c41-e4109eae87cd-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:46:10.677790 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:10.677759    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f" event={"ID":"eaf3e865-9c1c-445e-8c41-e4109eae87cd","Type":"ContainerDied","Data":"114325c2ceec5903540f695780b9cbe280f38bb43992f32a5dc0c9ad7a438522"}
Jul 15 04:46:10.677946 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:10.677796    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f"
Jul 15 04:46:10.677946 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:10.677805    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="114325c2ceec5903540f695780b9cbe280f38bb43992f32a5dc0c9ad7a438522"
Jul 15 04:46:12.114838 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:12.114808    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:46:12.123027 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:46:12.123007    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:47:09.985150 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:09.985118    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"]
Jul 15 04:47:09.985678 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:09.985386    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf3e865-9c1c-445e-8c41-e4109eae87cd" containerName="revoke-keys"
Jul 15 04:47:09.985678 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:09.985397    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf3e865-9c1c-445e-8c41-e4109eae87cd" containerName="revoke-keys"
Jul 15 04:47:09.985678 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:09.985454    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf3e865-9c1c-445e-8c41-e4109eae87cd" containerName="revoke-keys"
Jul 15 04:47:09.988204 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:09.988184    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:09.990725 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:09.990702    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c2a8a9\"/\"kube-root-ca.crt\""
Jul 15 04:47:09.991722 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:09.991694    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c2a8a9\"/\"openshift-service-ca.crt\""
Jul 15 04:47:09.991812 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:09.991733    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c2a8a9\"/\"default-dockercfg-lpcdg\""
Jul 15 04:47:09.991812 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:09.991732    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c2a8a9\"/\"auth-test-model-c2a8a9-kserve-self-signed-certs\""
Jul 15 04:47:09.998336 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:09.998316    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"]
Jul 15 04:47:10.160382 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.160360    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz2z4\" (UniqueName: \"kubernetes.io/projected/0e6736af-58c4-4ac0-8699-018292406223-kube-api-access-sz2z4\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.160517 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.160394    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-dshm\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.160517 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.160417    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-home\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.160517 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.160443    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-tmp-dir\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.160517 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.160494    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6736af-58c4-4ac0-8699-018292406223-tls-certs\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.160687 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.160541    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-model-cache\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.261348 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.261283    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6736af-58c4-4ac0-8699-018292406223-tls-certs\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.261348 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.261324    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-model-cache\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.261348 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.261347    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz2z4\" (UniqueName: \"kubernetes.io/projected/0e6736af-58c4-4ac0-8699-018292406223-kube-api-access-sz2z4\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.261546 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.261373    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-dshm\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.261546 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.261394    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-home\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.261546 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.261419    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-tmp-dir\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.261807 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.261781    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-home\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.261807 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.261806    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-model-cache\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.261955 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.261846    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-tmp-dir\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.263834 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.263811    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-dshm\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.264068 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.264051    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6736af-58c4-4ac0-8699-018292406223-tls-certs\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.270523 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.270504    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz2z4\" (UniqueName: \"kubernetes.io/projected/0e6736af-58c4-4ac0-8699-018292406223-kube-api-access-sz2z4\") pod \"auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") " pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.298441 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.298422    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:10.425298 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.425273    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"]
Jul 15 04:47:10.427638 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:47:10.427611    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e6736af_58c4_4ac0_8699_018292406223.slice/crio-b22baf942436ac0b4da6fc25f8cdda6c7c0fef7d4347b7287a6fde6bf4c3f956 WatchSource:0}: Error finding container b22baf942436ac0b4da6fc25f8cdda6c7c0fef7d4347b7287a6fde6bf4c3f956: Status 404 returned error can't find the container with id b22baf942436ac0b4da6fc25f8cdda6c7c0fef7d4347b7287a6fde6bf4c3f956
Jul 15 04:47:10.954106 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.954053    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7" event={"ID":"0e6736af-58c4-4ac0-8699-018292406223","Type":"ContainerStarted","Data":"19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98"}
Jul 15 04:47:10.954283 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.954121    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7" event={"ID":"0e6736af-58c4-4ac0-8699-018292406223","Type":"ContainerStarted","Data":"b22baf942436ac0b4da6fc25f8cdda6c7c0fef7d4347b7287a6fde6bf4c3f956"}
Jul 15 04:47:10.972134 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:10.972069    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7" podStartSLOduration=1.972052525 podStartE2EDuration="1.972052525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:47:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:47:10.969805232 +0000 UTC m=+2459.406732130" watchObservedRunningTime="2026-07-15 04:47:10.972052525 +0000 UTC m=+2459.408979423"
Jul 15 04:47:20.298649 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:20.298614    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:20.298649 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:20.298656    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:20.311187 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:20.311167    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:21.011416 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:21.011379    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:47:26.375319 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.375281    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"]
Jul 15 04:47:26.378591 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.378568    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.381572 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.381550    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"openshift-service-ca.crt\""
Jul 15 04:47:26.381572 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.381569    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"kube-root-ca.crt\""
Jul 15 04:47:26.382694 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.382676    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"auth-test-model-3a7aa4-kserve-self-signed-certs\""
Jul 15 04:47:26.382694 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.382691    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"default-dockercfg-nkp2v\""
Jul 15 04:47:26.388947 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.388925    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"]
Jul 15 04:47:26.478963 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.478935    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a27ca441-3baf-44af-8380-b60d60d01d54-tls-certs\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.479122 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.478977    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-model-cache\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.479122 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.478993    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-tmp-dir\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.479122 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.479072    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-dshm\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.479122 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.479120    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-home\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.479289 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.479171    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g9t7\" (UniqueName: \"kubernetes.io/projected/a27ca441-3baf-44af-8380-b60d60d01d54-kube-api-access-6g9t7\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.580276 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.580250    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a27ca441-3baf-44af-8380-b60d60d01d54-tls-certs\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.580392 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.580304    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-model-cache\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.580392 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.580328    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-tmp-dir\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.580392 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.580363    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-dshm\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.580549 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.580394    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-home\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.580549 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.580452    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g9t7\" (UniqueName: \"kubernetes.io/projected/a27ca441-3baf-44af-8380-b60d60d01d54-kube-api-access-6g9t7\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.580768 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.580744    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-tmp-dir\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.580854 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.580835    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-home\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.580914 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.580859    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-model-cache\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.582720 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.582699    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-dshm\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.582979 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.582963    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a27ca441-3baf-44af-8380-b60d60d01d54-tls-certs\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.588249 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.588233    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g9t7\" (UniqueName: \"kubernetes.io/projected/a27ca441-3baf-44af-8380-b60d60d01d54-kube-api-access-6g9t7\") pod \"auth-test-model-3a7aa4-kserve-55d4976959-4nk9j\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") " pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.687700 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.687640    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:26.821799 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:26.821774    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"]
Jul 15 04:47:26.823860 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:47:26.823834    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda27ca441_3baf_44af_8380_b60d60d01d54.slice/crio-ec018556d86582f2fef44d2939941f05ad5fccaa3eac0804a63f8452d5b264f7 WatchSource:0}: Error finding container ec018556d86582f2fef44d2939941f05ad5fccaa3eac0804a63f8452d5b264f7: Status 404 returned error can't find the container with id ec018556d86582f2fef44d2939941f05ad5fccaa3eac0804a63f8452d5b264f7
Jul 15 04:47:27.027929 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:27.027855    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j" event={"ID":"a27ca441-3baf-44af-8380-b60d60d01d54","Type":"ContainerStarted","Data":"e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268"}
Jul 15 04:47:27.027929 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:27.027895    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j" event={"ID":"a27ca441-3baf-44af-8380-b60d60d01d54","Type":"ContainerStarted","Data":"ec018556d86582f2fef44d2939941f05ad5fccaa3eac0804a63f8452d5b264f7"}
Jul 15 04:47:27.044777 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:27.044733    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j" podStartSLOduration=1.044719888 podStartE2EDuration="1.044719888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:47:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:47:27.043918068 +0000 UTC m=+2475.480844990" watchObservedRunningTime="2026-07-15 04:47:27.044719888 +0000 UTC m=+2475.481646785"
Jul 15 04:47:36.687914 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:36.687881    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:36.688376 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:36.688116    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:36.700264 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:36.700234    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:47:37.085592 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:47:37.085565    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:49:29.641335 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:29.641290    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"]
Jul 15 04:49:30.371151 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:30.371114    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"]
Jul 15 04:49:34.378846 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.378768    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"]
Jul 15 04:49:34.382534 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.382512    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.385007 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.384988    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c2a8a9\"/\"sub-test-model-c2a8a9-kserve-self-signed-certs\""
Jul 15 04:49:34.393235 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.393212    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"]
Jul 15 04:49:34.494055 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.494026    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-model-cache\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.494169 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.494066    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-home\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.494169 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.494118    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-747fq\" (UniqueName: \"kubernetes.io/projected/d8b368da-797d-47f8-a590-20f7331acf84-kube-api-access-747fq\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.494262 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.494178    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-tmp-dir\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.494262 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.494224    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-dshm\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.494262 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.494253    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8b368da-797d-47f8-a590-20f7331acf84-tls-certs\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.595122 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.595084    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-model-cache\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.595242 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.595136    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-home\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.595242 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.595160    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-747fq\" (UniqueName: \"kubernetes.io/projected/d8b368da-797d-47f8-a590-20f7331acf84-kube-api-access-747fq\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.595242 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.595183    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-tmp-dir\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.595408 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.595276    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-dshm\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.595408 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.595319    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8b368da-797d-47f8-a590-20f7331acf84-tls-certs\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.595536 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.595515    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-model-cache\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.595594 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.595575    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-tmp-dir\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.595635 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.595615    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-home\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.597892 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.597862    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-dshm\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.597986 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.597968    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8b368da-797d-47f8-a590-20f7331acf84-tls-certs\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.603804 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.603786    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-747fq\" (UniqueName: \"kubernetes.io/projected/d8b368da-797d-47f8-a590-20f7331acf84-kube-api-access-747fq\") pod \"sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") " pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.694165 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.694084    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:34.823842 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:34.823819    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"]
Jul 15 04:49:34.826162 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:49:34.826136    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8b368da_797d_47f8_a590_20f7331acf84.slice/crio-9d1302b535f001a579edd34d85bc275ac5536268aa522e1c41e02b2da63208e9 WatchSource:0}: Error finding container 9d1302b535f001a579edd34d85bc275ac5536268aa522e1c41e02b2da63208e9: Status 404 returned error can't find the container with id 9d1302b535f001a579edd34d85bc275ac5536268aa522e1c41e02b2da63208e9
Jul 15 04:49:35.618548 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:35.618514    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w" event={"ID":"d8b368da-797d-47f8-a590-20f7331acf84","Type":"ContainerStarted","Data":"cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde"}
Jul 15 04:49:35.618979 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:35.618559    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w" event={"ID":"d8b368da-797d-47f8-a590-20f7331acf84","Type":"ContainerStarted","Data":"9d1302b535f001a579edd34d85bc275ac5536268aa522e1c41e02b2da63208e9"}
Jul 15 04:49:35.643450 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:35.643400    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w" podStartSLOduration=1.6433830280000001 podStartE2EDuration="1.643383028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:49:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:49:35.641296992 +0000 UTC m=+2604.078223884" watchObservedRunningTime="2026-07-15 04:49:35.643383028 +0000 UTC m=+2604.080309924"
Jul 15 04:49:44.661405 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.661345    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7" podUID="0e6736af-58c4-4ac0-8699-018292406223" containerName="main" containerID="cri-o://19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98" gracePeriod=45
Jul 15 04:49:44.694965 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.694941    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:44.695223 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.695203    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:44.707375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.707355    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:44.898973 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.898952    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:49:44.973230 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.973169    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz2z4\" (UniqueName: \"kubernetes.io/projected/0e6736af-58c4-4ac0-8699-018292406223-kube-api-access-sz2z4\") pod \"0e6736af-58c4-4ac0-8699-018292406223\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") "
Jul 15 04:49:44.973350 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.973227    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6736af-58c4-4ac0-8699-018292406223-tls-certs\") pod \"0e6736af-58c4-4ac0-8699-018292406223\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") "
Jul 15 04:49:44.973350 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.973264    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-dshm\") pod \"0e6736af-58c4-4ac0-8699-018292406223\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") "
Jul 15 04:49:44.973350 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.973296    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-tmp-dir\") pod \"0e6736af-58c4-4ac0-8699-018292406223\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") "
Jul 15 04:49:44.973516 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.973356    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-home\") pod \"0e6736af-58c4-4ac0-8699-018292406223\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") "
Jul 15 04:49:44.973516 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.973389    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-model-cache\") pod \"0e6736af-58c4-4ac0-8699-018292406223\" (UID: \"0e6736af-58c4-4ac0-8699-018292406223\") "
Jul 15 04:49:44.973674 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.973613    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0e6736af-58c4-4ac0-8699-018292406223" (UID: "0e6736af-58c4-4ac0-8699-018292406223"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:49:44.973674 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.973627    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-home" (OuterVolumeSpecName: "home") pod "0e6736af-58c4-4ac0-8699-018292406223" (UID: "0e6736af-58c4-4ac0-8699-018292406223"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:49:44.973818 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.973702    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-model-cache" (OuterVolumeSpecName: "model-cache") pod "0e6736af-58c4-4ac0-8699-018292406223" (UID: "0e6736af-58c4-4ac0-8699-018292406223"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:49:44.975612 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.975591    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-dshm" (OuterVolumeSpecName: "dshm") pod "0e6736af-58c4-4ac0-8699-018292406223" (UID: "0e6736af-58c4-4ac0-8699-018292406223"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:49:44.975693 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.975605    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6736af-58c4-4ac0-8699-018292406223-kube-api-access-sz2z4" (OuterVolumeSpecName: "kube-api-access-sz2z4") pod "0e6736af-58c4-4ac0-8699-018292406223" (UID: "0e6736af-58c4-4ac0-8699-018292406223"). InnerVolumeSpecName "kube-api-access-sz2z4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:49:44.975693 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:44.975606    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6736af-58c4-4ac0-8699-018292406223-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0e6736af-58c4-4ac0-8699-018292406223" (UID: "0e6736af-58c4-4ac0-8699-018292406223"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 04:49:45.074870 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.074847    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz2z4\" (UniqueName: \"kubernetes.io/projected/0e6736af-58c4-4ac0-8699-018292406223-kube-api-access-sz2z4\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.074870 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.074869    2539 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e6736af-58c4-4ac0-8699-018292406223-tls-certs\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.074996 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.074878    2539 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-dshm\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.074996 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.074886    2539 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-tmp-dir\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.074996 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.074893    2539 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-home\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.074996 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.074900    2539 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e6736af-58c4-4ac0-8699-018292406223-model-cache\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.391476 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.391423    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j" podUID="a27ca441-3baf-44af-8380-b60d60d01d54" containerName="main" containerID="cri-o://e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268" gracePeriod=45
Jul 15 04:49:45.619168 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.619146    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:49:45.664557 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.664495    2539 generic.go:356] "Generic (PLEG): container finished" podID="0e6736af-58c4-4ac0-8699-018292406223" containerID="19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98" exitCode=0
Jul 15 04:49:45.664557 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.664528    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"
Jul 15 04:49:45.664953 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.664565    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7" event={"ID":"0e6736af-58c4-4ac0-8699-018292406223","Type":"ContainerDied","Data":"19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98"}
Jul 15 04:49:45.664953 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.664598    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7" event={"ID":"0e6736af-58c4-4ac0-8699-018292406223","Type":"ContainerDied","Data":"b22baf942436ac0b4da6fc25f8cdda6c7c0fef7d4347b7287a6fde6bf4c3f956"}
Jul 15 04:49:45.664953 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.664615    2539 scope.go:117] "RemoveContainer" containerID="19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98"
Jul 15 04:49:45.666212 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.666192    2539 generic.go:356] "Generic (PLEG): container finished" podID="a27ca441-3baf-44af-8380-b60d60d01d54" containerID="e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268" exitCode=0
Jul 15 04:49:45.666337 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.666235    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"
Jul 15 04:49:45.666337 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.666269    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j" event={"ID":"a27ca441-3baf-44af-8380-b60d60d01d54","Type":"ContainerDied","Data":"e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268"}
Jul 15 04:49:45.666337 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.666310    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j" event={"ID":"a27ca441-3baf-44af-8380-b60d60d01d54","Type":"ContainerDied","Data":"ec018556d86582f2fef44d2939941f05ad5fccaa3eac0804a63f8452d5b264f7"}
Jul 15 04:49:45.678167 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.678148    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:49:45.680140 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.680113    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g9t7\" (UniqueName: \"kubernetes.io/projected/a27ca441-3baf-44af-8380-b60d60d01d54-kube-api-access-6g9t7\") pod \"a27ca441-3baf-44af-8380-b60d60d01d54\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") "
Jul 15 04:49:45.680222 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.680200    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-home\") pod \"a27ca441-3baf-44af-8380-b60d60d01d54\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") "
Jul 15 04:49:45.680260 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.680238    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-dshm\") pod \"a27ca441-3baf-44af-8380-b60d60d01d54\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") "
Jul 15 04:49:45.680300 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.680278    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a27ca441-3baf-44af-8380-b60d60d01d54-tls-certs\") pod \"a27ca441-3baf-44af-8380-b60d60d01d54\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") "
Jul 15 04:49:45.680344 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.680336    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-model-cache\") pod \"a27ca441-3baf-44af-8380-b60d60d01d54\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") "
Jul 15 04:49:45.680401 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.680366    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-tmp-dir\") pod \"a27ca441-3baf-44af-8380-b60d60d01d54\" (UID: \"a27ca441-3baf-44af-8380-b60d60d01d54\") "
Jul 15 04:49:45.680663 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.680565    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-home" (OuterVolumeSpecName: "home") pod "a27ca441-3baf-44af-8380-b60d60d01d54" (UID: "a27ca441-3baf-44af-8380-b60d60d01d54"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:49:45.680663 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.680622    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-model-cache" (OuterVolumeSpecName: "model-cache") pod "a27ca441-3baf-44af-8380-b60d60d01d54" (UID: "a27ca441-3baf-44af-8380-b60d60d01d54"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:49:45.680944 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.680883    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a27ca441-3baf-44af-8380-b60d60d01d54" (UID: "a27ca441-3baf-44af-8380-b60d60d01d54"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:49:45.681715 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.681700    2539 scope.go:117] "RemoveContainer" containerID="19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98"
Jul 15 04:49:45.682036 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:49:45.682014    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98\": container with ID starting with 19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98 not found: ID does not exist" containerID="19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98"
Jul 15 04:49:45.682113 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.682047    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98"} err="failed to get container status \"19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98\": rpc error: code = NotFound desc = could not find container \"19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98\": container with ID starting with 19e748a7a61a09e6ad9726467e592391cb7b1204f7bf63a0693ba3316a38af98 not found: ID does not exist"
Jul 15 04:49:45.682113 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.682070    2539 scope.go:117] "RemoveContainer" containerID="e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268"
Jul 15 04:49:45.682464 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.682438    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a27ca441-3baf-44af-8380-b60d60d01d54-kube-api-access-6g9t7" (OuterVolumeSpecName: "kube-api-access-6g9t7") pod "a27ca441-3baf-44af-8380-b60d60d01d54" (UID: "a27ca441-3baf-44af-8380-b60d60d01d54"). InnerVolumeSpecName "kube-api-access-6g9t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:49:45.682697 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.682440    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-dshm" (OuterVolumeSpecName: "dshm") pod "a27ca441-3baf-44af-8380-b60d60d01d54" (UID: "a27ca441-3baf-44af-8380-b60d60d01d54"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:49:45.682697 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.682657    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a27ca441-3baf-44af-8380-b60d60d01d54-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a27ca441-3baf-44af-8380-b60d60d01d54" (UID: "a27ca441-3baf-44af-8380-b60d60d01d54"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 04:49:45.697817 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.697798    2539 scope.go:117] "RemoveContainer" containerID="e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268"
Jul 15 04:49:45.698069 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:49:45.698050    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268\": container with ID starting with e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268 not found: ID does not exist" containerID="e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268"
Jul 15 04:49:45.698155 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.698084    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268"} err="failed to get container status \"e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268\": rpc error: code = NotFound desc = could not find container \"e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268\": container with ID starting with e7b98d2644ab83cf5d06ba8e94bbb995a69fe0b855fedab908146ae8cabec268 not found: ID does not exist"
Jul 15 04:49:45.708947 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.708923    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"]
Jul 15 04:49:45.713827 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.713806    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/auth-test-model-c2a8a9-kserve-559b89bf95-dx4n7"]
Jul 15 04:49:45.781675 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.781647    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g9t7\" (UniqueName: \"kubernetes.io/projected/a27ca441-3baf-44af-8380-b60d60d01d54-kube-api-access-6g9t7\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.781675 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.781668    2539 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-home\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.781675 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.781679    2539 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-dshm\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.781867 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.781688    2539 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a27ca441-3baf-44af-8380-b60d60d01d54-tls-certs\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.781867 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.781696    2539 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-model-cache\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.781867 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.781705    2539 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a27ca441-3baf-44af-8380-b60d60d01d54-tmp-dir\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:49:45.987461 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.987432    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"]
Jul 15 04:49:45.993307 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:45.993282    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/auth-test-model-3a7aa4-kserve-55d4976959-4nk9j"]
Jul 15 04:49:46.079842 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:46.079819    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e6736af-58c4-4ac0-8699-018292406223" path="/var/lib/kubelet/pods/0e6736af-58c4-4ac0-8699-018292406223/volumes"
Jul 15 04:49:46.080251 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:49:46.080237    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a27ca441-3baf-44af-8380-b60d60d01d54" path="/var/lib/kubelet/pods/a27ca441-3baf-44af-8380-b60d60d01d54/volumes"
Jul 15 04:50:07.371364 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.371328    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"]
Jul 15 04:50:07.371823 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.371644    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6736af-58c4-4ac0-8699-018292406223" containerName="main"
Jul 15 04:50:07.371823 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.371656    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6736af-58c4-4ac0-8699-018292406223" containerName="main"
Jul 15 04:50:07.371823 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.371672    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a27ca441-3baf-44af-8380-b60d60d01d54" containerName="main"
Jul 15 04:50:07.371823 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.371677    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="a27ca441-3baf-44af-8380-b60d60d01d54" containerName="main"
Jul 15 04:50:07.371823 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.371721    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e6736af-58c4-4ac0-8699-018292406223" containerName="main"
Jul 15 04:50:07.371823 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.371728    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="a27ca441-3baf-44af-8380-b60d60d01d54" containerName="main"
Jul 15 04:50:07.374606 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.374590    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.378641 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.378618    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"openshift-service-ca.crt\""
Jul 15 04:50:07.378772 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.378649    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"default-dockercfg-nkp2v\""
Jul 15 04:50:07.378772 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.378656    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"kube-root-ca.crt\""
Jul 15 04:50:07.378772 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.378657    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"sub-test-model-3a7aa4-kserve-self-signed-certs\""
Jul 15 04:50:07.383777 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.383758    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"]
Jul 15 04:50:07.431231 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.431195    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-home\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.431394 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.431253    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-dshm\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.431394 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.431287    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tmp-dir\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.431394 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.431336    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4cgg\" (UniqueName: \"kubernetes.io/projected/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-kube-api-access-p4cgg\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.431394 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.431358    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-model-cache\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.431394 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.431374    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tls-certs\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.532648 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.532620    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tls-certs\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.532834 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.532661    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-home\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.532834 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.532692    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-dshm\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.532834 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.532707    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tmp-dir\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.532834 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.532750    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4cgg\" (UniqueName: \"kubernetes.io/projected/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-kube-api-access-p4cgg\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.533036 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.532848    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-model-cache\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.533170 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.533135    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-home\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.533312 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.533193    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tmp-dir\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.533312 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.533262    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-model-cache\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.535175 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.535154    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-dshm\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.535331 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.535316    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tls-certs\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.543334 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.543315    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4cgg\" (UniqueName: \"kubernetes.io/projected/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-kube-api-access-p4cgg\") pod \"sub-test-model-3a7aa4-kserve-d94984549-hk2mk\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") " pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.684129 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.684041    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:07.814411 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:07.814386    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"]
Jul 15 04:50:07.816653 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:50:07.816626    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea651910_c0f5_4bf3_9470_9e6ada27d3d7.slice/crio-5215a6dfd54888434bbfa2302cfbd724b9070f09fe0030098b6502872e83e104 WatchSource:0}: Error finding container 5215a6dfd54888434bbfa2302cfbd724b9070f09fe0030098b6502872e83e104: Status 404 returned error can't find the container with id 5215a6dfd54888434bbfa2302cfbd724b9070f09fe0030098b6502872e83e104
Jul 15 04:50:08.776781 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:08.776732    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk" event={"ID":"ea651910-c0f5-4bf3-9470-9e6ada27d3d7","Type":"ContainerStarted","Data":"9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e"}
Jul 15 04:50:08.777206 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:08.776794    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk" event={"ID":"ea651910-c0f5-4bf3-9470-9e6ada27d3d7","Type":"ContainerStarted","Data":"5215a6dfd54888434bbfa2302cfbd724b9070f09fe0030098b6502872e83e104"}
Jul 15 04:50:08.795792 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:08.795735    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk" podStartSLOduration=1.795722327 podStartE2EDuration="1.795722327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:50:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:50:08.794296945 +0000 UTC m=+2637.231223842" watchObservedRunningTime="2026-07-15 04:50:08.795722327 +0000 UTC m=+2637.232649224"
Jul 15 04:50:17.684790 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:17.684753    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:17.685357 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:17.684813    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:17.697337 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:17.697301    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:17.834024 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:17.833998    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:50:48.586442 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:48.586411    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"]
Jul 15 04:50:49.662967 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:49.662925    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"]
Jul 15 04:50:58.785265 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.785234    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"]
Jul 15 04:50:58.788299 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.788283    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.791002 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.790980    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c2a8a9\"/\"rate-test-model-c2a8a9-kserve-self-signed-certs\""
Jul 15 04:50:58.797665 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.797643    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"]
Jul 15 04:50:58.803414 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.803394    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-model-cache\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.803515 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.803422    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-tmp-dir\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.803515 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.803448    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-dshm\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.803515 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.803493    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-home\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.803679 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.803542    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmdqb\" (UniqueName: \"kubernetes.io/projected/e7d7ca64-3455-40eb-af61-c60cfea72521-kube-api-access-jmdqb\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.803679 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.803596    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7d7ca64-3455-40eb-af61-c60cfea72521-tls-certs\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.904465 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.904438    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7d7ca64-3455-40eb-af61-c60cfea72521-tls-certs\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.904568 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.904499    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-model-cache\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.904568 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.904525    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-tmp-dir\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.904684 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.904569    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-dshm\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.904684 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.904595    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-home\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.904684 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.904633    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmdqb\" (UniqueName: \"kubernetes.io/projected/e7d7ca64-3455-40eb-af61-c60cfea72521-kube-api-access-jmdqb\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.904960 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.904931    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-model-cache\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.905042 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.904977    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-tmp-dir\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.905042 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.905006    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-home\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.906864 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.906844    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-dshm\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.907004 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.906988    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7d7ca64-3455-40eb-af61-c60cfea72521-tls-certs\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:58.913491 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:58.913470    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmdqb\" (UniqueName: \"kubernetes.io/projected/e7d7ca64-3455-40eb-af61-c60cfea72521-kube-api-access-jmdqb\") pod \"rate-test-model-c2a8a9-kserve-db56496b7-vcxfr\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") " pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:59.097703 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:59.097677    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:50:59.226872 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:50:59.226843    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"]
Jul 15 04:50:59.229138 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:50:59.229107    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7d7ca64_3455_40eb_af61_c60cfea72521.slice/crio-7135ad9c85fe420b7fceb44c1ee1c089f97a3eb896c63f301f237e016c97dab4 WatchSource:0}: Error finding container 7135ad9c85fe420b7fceb44c1ee1c089f97a3eb896c63f301f237e016c97dab4: Status 404 returned error can't find the container with id 7135ad9c85fe420b7fceb44c1ee1c089f97a3eb896c63f301f237e016c97dab4
Jul 15 04:51:00.018423 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:00.018385    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr" event={"ID":"e7d7ca64-3455-40eb-af61-c60cfea72521","Type":"ContainerStarted","Data":"7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff"}
Jul 15 04:51:00.018423 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:00.018428    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr" event={"ID":"e7d7ca64-3455-40eb-af61-c60cfea72521","Type":"ContainerStarted","Data":"7135ad9c85fe420b7fceb44c1ee1c089f97a3eb896c63f301f237e016c97dab4"}
Jul 15 04:51:00.036072 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:00.036027    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr" podStartSLOduration=2.036014761 podStartE2EDuration="2.036014761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:50:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:51:00.035147995 +0000 UTC m=+2688.472074891" watchObservedRunningTime="2026-07-15 04:51:00.036014761 +0000 UTC m=+2688.472941658"
Jul 15 04:51:03.606397 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.606311    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w" podUID="d8b368da-797d-47f8-a590-20f7331acf84" containerName="main" containerID="cri-o://cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde" gracePeriod=45
Jul 15 04:51:03.861047 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.860988    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:51:03.934349 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.934318    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-home\") pod \"d8b368da-797d-47f8-a590-20f7331acf84\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") "
Jul 15 04:51:03.934479 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.934387    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-tmp-dir\") pod \"d8b368da-797d-47f8-a590-20f7331acf84\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") "
Jul 15 04:51:03.934479 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.934414    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8b368da-797d-47f8-a590-20f7331acf84-tls-certs\") pod \"d8b368da-797d-47f8-a590-20f7331acf84\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") "
Jul 15 04:51:03.934479 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.934433    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-747fq\" (UniqueName: \"kubernetes.io/projected/d8b368da-797d-47f8-a590-20f7331acf84-kube-api-access-747fq\") pod \"d8b368da-797d-47f8-a590-20f7331acf84\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") "
Jul 15 04:51:03.934479 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.934463    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-model-cache\") pod \"d8b368da-797d-47f8-a590-20f7331acf84\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") "
Jul 15 04:51:03.934479 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.934480    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-dshm\") pod \"d8b368da-797d-47f8-a590-20f7331acf84\" (UID: \"d8b368da-797d-47f8-a590-20f7331acf84\") "
Jul 15 04:51:03.934704 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.934539    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-home" (OuterVolumeSpecName: "home") pod "d8b368da-797d-47f8-a590-20f7331acf84" (UID: "d8b368da-797d-47f8-a590-20f7331acf84"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:51:03.934704 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.934689    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8b368da-797d-47f8-a590-20f7331acf84" (UID: "d8b368da-797d-47f8-a590-20f7331acf84"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:51:03.934778 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.934726    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8b368da-797d-47f8-a590-20f7331acf84" (UID: "d8b368da-797d-47f8-a590-20f7331acf84"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:51:03.934778 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.934755    2539 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-home\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:03.936693 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.936665    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-dshm" (OuterVolumeSpecName: "dshm") pod "d8b368da-797d-47f8-a590-20f7331acf84" (UID: "d8b368da-797d-47f8-a590-20f7331acf84"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:51:03.936771 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.936757    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b368da-797d-47f8-a590-20f7331acf84-kube-api-access-747fq" (OuterVolumeSpecName: "kube-api-access-747fq") pod "d8b368da-797d-47f8-a590-20f7331acf84" (UID: "d8b368da-797d-47f8-a590-20f7331acf84"). InnerVolumeSpecName "kube-api-access-747fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:51:03.936827 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:03.936793    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b368da-797d-47f8-a590-20f7331acf84-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8b368da-797d-47f8-a590-20f7331acf84" (UID: "d8b368da-797d-47f8-a590-20f7331acf84"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 04:51:04.035078 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.035054    2539 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-tmp-dir\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:04.035078 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.035075    2539 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8b368da-797d-47f8-a590-20f7331acf84-tls-certs\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:04.035233 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.035099    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-747fq\" (UniqueName: \"kubernetes.io/projected/d8b368da-797d-47f8-a590-20f7331acf84-kube-api-access-747fq\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:04.035233 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.035109    2539 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-model-cache\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:04.035233 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.035117    2539 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8b368da-797d-47f8-a590-20f7331acf84-dshm\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:04.038734 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.038712    2539 generic.go:356] "Generic (PLEG): container finished" podID="d8b368da-797d-47f8-a590-20f7331acf84" containerID="cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde" exitCode=0
Jul 15 04:51:04.038865 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.038742    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w" event={"ID":"d8b368da-797d-47f8-a590-20f7331acf84","Type":"ContainerDied","Data":"cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde"}
Jul 15 04:51:04.038865 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.038757    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"
Jul 15 04:51:04.038865 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.038785    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w" event={"ID":"d8b368da-797d-47f8-a590-20f7331acf84","Type":"ContainerDied","Data":"9d1302b535f001a579edd34d85bc275ac5536268aa522e1c41e02b2da63208e9"}
Jul 15 04:51:04.038865 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.038810    2539 scope.go:117] "RemoveContainer" containerID="cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde"
Jul 15 04:51:04.047995 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.047976    2539 scope.go:117] "RemoveContainer" containerID="cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde"
Jul 15 04:51:04.048378 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:51:04.048355    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde\": container with ID starting with cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde not found: ID does not exist" containerID="cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde"
Jul 15 04:51:04.048455 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.048390    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde"} err="failed to get container status \"cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde\": rpc error: code = NotFound desc = could not find container \"cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde\": container with ID starting with cfa440e8c9e711f316a528d3885cd8fe1a0ed730bf433fdf069c7f9e8c83cdde not found: ID does not exist"
Jul 15 04:51:04.063484 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.063456    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"]
Jul 15 04:51:04.067137 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.067118    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/sub-test-model-c2a8a9-kserve-65c7dfb59-l7x9w"]
Jul 15 04:51:04.079524 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.079501    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8b368da-797d-47f8-a590-20f7331acf84" path="/var/lib/kubelet/pods/d8b368da-797d-47f8-a590-20f7331acf84/volumes"
Jul 15 04:51:04.682844 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.682803    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk" podUID="ea651910-c0f5-4bf3-9470-9e6ada27d3d7" containerName="main" containerID="cri-o://9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e" gracePeriod=45
Jul 15 04:51:04.943330 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:04.943272    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:51:05.041789 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.041728    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-model-cache\") pod \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") "
Jul 15 04:51:05.041971 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.041809    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-dshm\") pod \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") "
Jul 15 04:51:05.041971 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.041842    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tmp-dir\") pod \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") "
Jul 15 04:51:05.041971 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.041885    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tls-certs\") pod \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") "
Jul 15 04:51:05.041971 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.041960    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-home\") pod \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") "
Jul 15 04:51:05.042326 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.041967    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-model-cache" (OuterVolumeSpecName: "model-cache") pod "ea651910-c0f5-4bf3-9470-9e6ada27d3d7" (UID: "ea651910-c0f5-4bf3-9470-9e6ada27d3d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:51:05.042326 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.041992    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4cgg\" (UniqueName: \"kubernetes.io/projected/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-kube-api-access-p4cgg\") pod \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\" (UID: \"ea651910-c0f5-4bf3-9470-9e6ada27d3d7\") "
Jul 15 04:51:05.042326 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.042198    2539 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-model-cache\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:05.042600 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.042346    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-home" (OuterVolumeSpecName: "home") pod "ea651910-c0f5-4bf3-9470-9e6ada27d3d7" (UID: "ea651910-c0f5-4bf3-9470-9e6ada27d3d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:51:05.042600 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.042520    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ea651910-c0f5-4bf3-9470-9e6ada27d3d7" (UID: "ea651910-c0f5-4bf3-9470-9e6ada27d3d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:51:05.044902 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.044876    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-dshm" (OuterVolumeSpecName: "dshm") pod "ea651910-c0f5-4bf3-9470-9e6ada27d3d7" (UID: "ea651910-c0f5-4bf3-9470-9e6ada27d3d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:51:05.045011 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.044904    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-kube-api-access-p4cgg" (OuterVolumeSpecName: "kube-api-access-p4cgg") pod "ea651910-c0f5-4bf3-9470-9e6ada27d3d7" (UID: "ea651910-c0f5-4bf3-9470-9e6ada27d3d7"). InnerVolumeSpecName "kube-api-access-p4cgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:51:05.045011 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.044937    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ea651910-c0f5-4bf3-9470-9e6ada27d3d7" (UID: "ea651910-c0f5-4bf3-9470-9e6ada27d3d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 04:51:05.047740 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.047715    2539 generic.go:356] "Generic (PLEG): container finished" podID="ea651910-c0f5-4bf3-9470-9e6ada27d3d7" containerID="9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e" exitCode=0
Jul 15 04:51:05.047876 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.047756    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"
Jul 15 04:51:05.047876 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.047759    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk" event={"ID":"ea651910-c0f5-4bf3-9470-9e6ada27d3d7","Type":"ContainerDied","Data":"9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e"}
Jul 15 04:51:05.047876 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.047795    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk" event={"ID":"ea651910-c0f5-4bf3-9470-9e6ada27d3d7","Type":"ContainerDied","Data":"5215a6dfd54888434bbfa2302cfbd724b9070f09fe0030098b6502872e83e104"}
Jul 15 04:51:05.047876 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.047817    2539 scope.go:117] "RemoveContainer" containerID="9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e"
Jul 15 04:51:05.061605 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.061588    2539 scope.go:117] "RemoveContainer" containerID="9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e"
Jul 15 04:51:05.061879 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:51:05.061861    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e\": container with ID starting with 9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e not found: ID does not exist" containerID="9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e"
Jul 15 04:51:05.061937 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.061886    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e"} err="failed to get container status \"9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e\": rpc error: code = NotFound desc = could not find container \"9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e\": container with ID starting with 9b3736e789529842bdb79b70d7ba61f7c079fd1726064804077223b43cdb2f5e not found: ID does not exist"
Jul 15 04:51:05.076481 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.074032    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"]
Jul 15 04:51:05.079501 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.079480    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/sub-test-model-3a7aa4-kserve-d94984549-hk2mk"]
Jul 15 04:51:05.142589 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.142564    2539 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-dshm\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:05.142691 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.142606    2539 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tmp-dir\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:05.142691 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.142615    2539 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-tls-certs\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:05.142691 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.142623    2539 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-home\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:05.142691 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:05.142633    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4cgg\" (UniqueName: \"kubernetes.io/projected/ea651910-c0f5-4bf3-9470-9e6ada27d3d7-kube-api-access-p4cgg\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:51:06.078805 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:06.078768    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea651910-c0f5-4bf3-9470-9e6ada27d3d7" path="/var/lib/kubelet/pods/ea651910-c0f5-4bf3-9470-9e6ada27d3d7/volumes"
Jul 15 04:51:09.098328 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:09.098290    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:51:09.098746 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:09.098346    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:51:09.110556 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:09.110529    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:51:10.082727 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:10.082682    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:51:12.144758 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:12.144731    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:51:12.150430 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:12.150409    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dqkl6_fa7930d2-6d25-4302-8798-2f0e3bcac369/ovn-acl-logging/0.log"
Jul 15 04:51:19.486679 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.486646    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"]
Jul 15 04:51:19.487120 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.486922    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea651910-c0f5-4bf3-9470-9e6ada27d3d7" containerName="main"
Jul 15 04:51:19.487120 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.486932    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea651910-c0f5-4bf3-9470-9e6ada27d3d7" containerName="main"
Jul 15 04:51:19.487120 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.486947    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b368da-797d-47f8-a590-20f7331acf84" containerName="main"
Jul 15 04:51:19.487120 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.486953    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b368da-797d-47f8-a590-20f7331acf84" containerName="main"
Jul 15 04:51:19.487120 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.486998    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea651910-c0f5-4bf3-9470-9e6ada27d3d7" containerName="main"
Jul 15 04:51:19.487120 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.487006    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b368da-797d-47f8-a590-20f7331acf84" containerName="main"
Jul 15 04:51:19.489828 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.489806    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.492735 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.492712    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"openshift-service-ca.crt\""
Jul 15 04:51:19.494424 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.494404    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"rate-test-model-3a7aa4-kserve-self-signed-certs\""
Jul 15 04:51:19.494532 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.494479    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"default-dockercfg-nkp2v\""
Jul 15 04:51:19.494532 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.494517    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3a7aa4\"/\"kube-root-ca.crt\""
Jul 15 04:51:19.499895 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.499872    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"]
Jul 15 04:51:19.547762 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.547739    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tls-certs\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.547859 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.547779    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-home\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.547859 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.547812    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-model-cache\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.547933 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.547895    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpcqc\" (UniqueName: \"kubernetes.io/projected/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-kube-api-access-wpcqc\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.547933 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.547924    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-dshm\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.547996 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.547941    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tmp-dir\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.648701 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.648667    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-home\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.648701 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.648704    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-model-cache\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.648883 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.648742    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpcqc\" (UniqueName: \"kubernetes.io/projected/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-kube-api-access-wpcqc\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.648883 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.648766    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-dshm\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.648883 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.648786    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tmp-dir\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.648883 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.648845    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tls-certs\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.649237 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.649212    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-home\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.649350 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.649266    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-model-cache\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.649350 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.649308    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tmp-dir\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.651534 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.651507    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-dshm\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.651639 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.651510    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tls-certs\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.657283 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.657265    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpcqc\" (UniqueName: \"kubernetes.io/projected/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-kube-api-access-wpcqc\") pod \"rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") " pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.799447 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.799424    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:19.933311 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:19.933284    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"]
Jul 15 04:51:19.935451 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:51:19.935424    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod045fdae2_14ff_4a0f_a905_8dc3b60fbb23.slice/crio-b87b5e2a79ef8c24bcf7fd6916b872f357b6900dc8af2bca30fd2ec7c4b01720 WatchSource:0}: Error finding container b87b5e2a79ef8c24bcf7fd6916b872f357b6900dc8af2bca30fd2ec7c4b01720: Status 404 returned error can't find the container with id b87b5e2a79ef8c24bcf7fd6916b872f357b6900dc8af2bca30fd2ec7c4b01720
Jul 15 04:51:20.118994 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:20.118902    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb" event={"ID":"045fdae2-14ff-4a0f-a905-8dc3b60fbb23","Type":"ContainerStarted","Data":"c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f"}
Jul 15 04:51:20.118994 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:20.118948    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb" event={"ID":"045fdae2-14ff-4a0f-a905-8dc3b60fbb23","Type":"ContainerStarted","Data":"b87b5e2a79ef8c24bcf7fd6916b872f357b6900dc8af2bca30fd2ec7c4b01720"}
Jul 15 04:51:20.137351 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:20.137304    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb" podStartSLOduration=1.137289401 podStartE2EDuration="1.137289401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:51:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:51:20.136648843 +0000 UTC m=+2708.573575742" watchObservedRunningTime="2026-07-15 04:51:20.137289401 +0000 UTC m=+2708.574216357"
Jul 15 04:51:29.799622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:29.799579    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:29.799622 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:29.799629    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:29.812032 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:29.812005    2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:51:30.176492 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:51:30.176414    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:52:11.551811 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:11.551777    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"]
Jul 15 04:52:12.497209 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:12.497179    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"]
Jul 15 04:52:26.571333 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.571294    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr" podUID="e7d7ca64-3455-40eb-af61-c60cfea72521" containerName="main" containerID="cri-o://7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff" gracePeriod=45
Jul 15 04:52:26.811448 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.811422    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:52:26.931701 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.931631    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-model-cache\") pod \"e7d7ca64-3455-40eb-af61-c60cfea72521\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") "
Jul 15 04:52:26.931701 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.931698    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7d7ca64-3455-40eb-af61-c60cfea72521-tls-certs\") pod \"e7d7ca64-3455-40eb-af61-c60cfea72521\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") "
Jul 15 04:52:26.931864 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.931730    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-home\") pod \"e7d7ca64-3455-40eb-af61-c60cfea72521\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") "
Jul 15 04:52:26.931864 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.931755    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-dshm\") pod \"e7d7ca64-3455-40eb-af61-c60cfea72521\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") "
Jul 15 04:52:26.931864 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.931777    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-tmp-dir\") pod \"e7d7ca64-3455-40eb-af61-c60cfea72521\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") "
Jul 15 04:52:26.931864 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.931801    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmdqb\" (UniqueName: \"kubernetes.io/projected/e7d7ca64-3455-40eb-af61-c60cfea72521-kube-api-access-jmdqb\") pod \"e7d7ca64-3455-40eb-af61-c60cfea72521\" (UID: \"e7d7ca64-3455-40eb-af61-c60cfea72521\") "
Jul 15 04:52:26.932074 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.931861    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-model-cache" (OuterVolumeSpecName: "model-cache") pod "e7d7ca64-3455-40eb-af61-c60cfea72521" (UID: "e7d7ca64-3455-40eb-af61-c60cfea72521"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:52:26.932074 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.931961    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-home" (OuterVolumeSpecName: "home") pod "e7d7ca64-3455-40eb-af61-c60cfea72521" (UID: "e7d7ca64-3455-40eb-af61-c60cfea72521"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:52:26.932074 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.932058    2539 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-model-cache\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:26.932227 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.932075    2539 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-home\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:26.932227 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.932071    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e7d7ca64-3455-40eb-af61-c60cfea72521" (UID: "e7d7ca64-3455-40eb-af61-c60cfea72521"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:52:26.933948 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.933920    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7d7ca64-3455-40eb-af61-c60cfea72521-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e7d7ca64-3455-40eb-af61-c60cfea72521" (UID: "e7d7ca64-3455-40eb-af61-c60cfea72521"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 04:52:26.934043 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.933930    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-dshm" (OuterVolumeSpecName: "dshm") pod "e7d7ca64-3455-40eb-af61-c60cfea72521" (UID: "e7d7ca64-3455-40eb-af61-c60cfea72521"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:52:26.934043 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:26.933975    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d7ca64-3455-40eb-af61-c60cfea72521-kube-api-access-jmdqb" (OuterVolumeSpecName: "kube-api-access-jmdqb") pod "e7d7ca64-3455-40eb-af61-c60cfea72521" (UID: "e7d7ca64-3455-40eb-af61-c60cfea72521"). InnerVolumeSpecName "kube-api-access-jmdqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:52:27.032560 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.032541    2539 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-dshm\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:27.032560 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.032561    2539 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7d7ca64-3455-40eb-af61-c60cfea72521-tmp-dir\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:27.032701 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.032571    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmdqb\" (UniqueName: \"kubernetes.io/projected/e7d7ca64-3455-40eb-af61-c60cfea72521-kube-api-access-jmdqb\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:27.032701 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.032581    2539 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7d7ca64-3455-40eb-af61-c60cfea72521-tls-certs\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:27.417288 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.417254    2539 generic.go:356] "Generic (PLEG): container finished" podID="e7d7ca64-3455-40eb-af61-c60cfea72521" containerID="7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff" exitCode=0
Jul 15 04:52:27.417447 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.417294    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"
Jul 15 04:52:27.417447 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.417337    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr" event={"ID":"e7d7ca64-3455-40eb-af61-c60cfea72521","Type":"ContainerDied","Data":"7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff"}
Jul 15 04:52:27.417447 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.417384    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr" event={"ID":"e7d7ca64-3455-40eb-af61-c60cfea72521","Type":"ContainerDied","Data":"7135ad9c85fe420b7fceb44c1ee1c089f97a3eb896c63f301f237e016c97dab4"}
Jul 15 04:52:27.417447 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.417401    2539 scope.go:117] "RemoveContainer" containerID="7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff"
Jul 15 04:52:27.428957 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.428942    2539 scope.go:117] "RemoveContainer" containerID="7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff"
Jul 15 04:52:27.429239 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:52:27.429219    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff\": container with ID starting with 7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff not found: ID does not exist" containerID="7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff"
Jul 15 04:52:27.429338 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.429243    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff"} err="failed to get container status \"7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff\": rpc error: code = NotFound desc = could not find container \"7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff\": container with ID starting with 7de8c41fc798587675da8ecbae3f8d8df7e1b80454772d516d881c93fa0380ff not found: ID does not exist"
Jul 15 04:52:27.449927 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.449901    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"]
Jul 15 04:52:27.457586 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.457562    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c2a8a9/rate-test-model-c2a8a9-kserve-db56496b7-vcxfr"]
Jul 15 04:52:27.516916 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.516870    2539 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb" podUID="045fdae2-14ff-4a0f-a905-8dc3b60fbb23" containerName="main" containerID="cri-o://c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f" gracePeriod=45
Jul 15 04:52:27.759675 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.759650    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:52:27.838184 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.838161    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-dshm\") pod \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") "
Jul 15 04:52:27.838329 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.838193    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tls-certs\") pod \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") "
Jul 15 04:52:27.838329 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.838218    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-model-cache\") pod \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") "
Jul 15 04:52:27.838329 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.838243    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpcqc\" (UniqueName: \"kubernetes.io/projected/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-kube-api-access-wpcqc\") pod \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") "
Jul 15 04:52:27.838329 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.838292    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-home\") pod \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") "
Jul 15 04:52:27.838329 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.838306    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tmp-dir\") pod \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\" (UID: \"045fdae2-14ff-4a0f-a905-8dc3b60fbb23\") "
Jul 15 04:52:27.838599 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.838470    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-model-cache" (OuterVolumeSpecName: "model-cache") pod "045fdae2-14ff-4a0f-a905-8dc3b60fbb23" (UID: "045fdae2-14ff-4a0f-a905-8dc3b60fbb23"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:52:27.838599 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.838589    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "045fdae2-14ff-4a0f-a905-8dc3b60fbb23" (UID: "045fdae2-14ff-4a0f-a905-8dc3b60fbb23"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:52:27.838663 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.838606    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-home" (OuterVolumeSpecName: "home") pod "045fdae2-14ff-4a0f-a905-8dc3b60fbb23" (UID: "045fdae2-14ff-4a0f-a905-8dc3b60fbb23"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:52:27.840384 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.840356    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "045fdae2-14ff-4a0f-a905-8dc3b60fbb23" (UID: "045fdae2-14ff-4a0f-a905-8dc3b60fbb23"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 04:52:27.840474 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.840400    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-dshm" (OuterVolumeSpecName: "dshm") pod "045fdae2-14ff-4a0f-a905-8dc3b60fbb23" (UID: "045fdae2-14ff-4a0f-a905-8dc3b60fbb23"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 04:52:27.840474 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.840403    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-kube-api-access-wpcqc" (OuterVolumeSpecName: "kube-api-access-wpcqc") pod "045fdae2-14ff-4a0f-a905-8dc3b60fbb23" (UID: "045fdae2-14ff-4a0f-a905-8dc3b60fbb23"). InnerVolumeSpecName "kube-api-access-wpcqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 04:52:27.939594 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.939536    2539 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-home\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:27.939594 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.939558    2539 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tmp-dir\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:27.939594 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.939568    2539 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-dshm\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:27.939594 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.939575    2539 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-tls-certs\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:27.939594 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.939584    2539 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-model-cache\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:27.939594 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:27.939593    2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpcqc\" (UniqueName: \"kubernetes.io/projected/045fdae2-14ff-4a0f-a905-8dc3b60fbb23-kube-api-access-wpcqc\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:28.080249 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:28.080224    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7d7ca64-3455-40eb-af61-c60cfea72521" path="/var/lib/kubelet/pods/e7d7ca64-3455-40eb-af61-c60cfea72521/volumes"
Jul 15 04:52:28.424451 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:28.424418    2539 generic.go:356] "Generic (PLEG): container finished" podID="045fdae2-14ff-4a0f-a905-8dc3b60fbb23" containerID="c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f" exitCode=0
Jul 15 04:52:28.424586 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:28.424467    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"
Jul 15 04:52:28.424586 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:28.424474    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb" event={"ID":"045fdae2-14ff-4a0f-a905-8dc3b60fbb23","Type":"ContainerDied","Data":"c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f"}
Jul 15 04:52:28.424586 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:28.424516    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb" event={"ID":"045fdae2-14ff-4a0f-a905-8dc3b60fbb23","Type":"ContainerDied","Data":"b87b5e2a79ef8c24bcf7fd6916b872f357b6900dc8af2bca30fd2ec7c4b01720"}
Jul 15 04:52:28.424586 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:28.424536    2539 scope.go:117] "RemoveContainer" containerID="c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f"
Jul 15 04:52:28.433638 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:28.433620    2539 scope.go:117] "RemoveContainer" containerID="c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f"
Jul 15 04:52:28.433942 ip-10-0-136-55 kubenswrapper[2539]: E0715 04:52:28.433907    2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f\": container with ID starting with c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f not found: ID does not exist" containerID="c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f"
Jul 15 04:52:28.433942 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:28.433936    2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f"} err="failed to get container status \"c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f\": rpc error: code = NotFound desc = could not find container \"c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f\": container with ID starting with c7570e85b38ba4922f8b5883219704a77d183ded735e06ac7062b6c36187997f not found: ID does not exist"
Jul 15 04:52:28.449325 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:28.449292    2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"]
Jul 15 04:52:28.453199 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:28.453171    2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3a7aa4/rate-test-model-3a7aa4-kserve-6c57cc9759-mdmjb"]
Jul 15 04:52:30.078946 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:30.078910    2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="045fdae2-14ff-4a0f-a905-8dc3b60fbb23" path="/var/lib/kubelet/pods/045fdae2-14ff-4a0f-a905-8dc3b60fbb23/volumes"
Jul 15 04:52:31.939833 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:31.939798    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv"]
Jul 15 04:52:31.940208 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:31.940069    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="045fdae2-14ff-4a0f-a905-8dc3b60fbb23" containerName="main"
Jul 15 04:52:31.940208 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:31.940079    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="045fdae2-14ff-4a0f-a905-8dc3b60fbb23" containerName="main"
Jul 15 04:52:31.940208 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:31.940110    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d7ca64-3455-40eb-af61-c60cfea72521" containerName="main"
Jul 15 04:52:31.940208 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:31.940119    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d7ca64-3455-40eb-af61-c60cfea72521" containerName="main"
Jul 15 04:52:31.940208 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:31.940177    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7d7ca64-3455-40eb-af61-c60cfea72521" containerName="main"
Jul 15 04:52:31.940208 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:31.940184    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="045fdae2-14ff-4a0f-a905-8dc3b60fbb23" containerName="main"
Jul 15 04:52:31.944240 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:31.944222    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv"
Jul 15 04:52:31.947057 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:31.947034    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:52:31.947182 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:31.947034    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:52:31.952717 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:31.952698    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv"]
Jul 15 04:52:32.066386 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:32.066358    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a600b92a-2e91-4f4e-af4e-31b407b34d38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv\" (UID: \"a600b92a-2e91-4f4e-af4e-31b407b34d38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv"
Jul 15 04:52:32.167381 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:32.167354    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a600b92a-2e91-4f4e-af4e-31b407b34d38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv\" (UID: \"a600b92a-2e91-4f4e-af4e-31b407b34d38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv"
Jul 15 04:52:32.167882 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:32.167866    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a600b92a-2e91-4f4e-af4e-31b407b34d38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv\" (UID: \"a600b92a-2e91-4f4e-af4e-31b407b34d38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv"
Jul 15 04:52:32.254555 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:32.254500    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv"
Jul 15 04:52:32.383673 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:32.383650    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv"]
Jul 15 04:52:32.385626 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:52:32.385589    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda600b92a_2e91_4f4e_af4e_31b407b34d38.slice/crio-ff668c0d0b4b8797d31f9fb44cb074337dc5b2a80def7753042df7177f304c9d WatchSource:0}: Error finding container ff668c0d0b4b8797d31f9fb44cb074337dc5b2a80def7753042df7177f304c9d: Status 404 returned error can't find the container with id ff668c0d0b4b8797d31f9fb44cb074337dc5b2a80def7753042df7177f304c9d
Jul 15 04:52:32.445370 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:32.445340    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv" event={"ID":"a600b92a-2e91-4f4e-af4e-31b407b34d38","Type":"ContainerStarted","Data":"ff668c0d0b4b8797d31f9fb44cb074337dc5b2a80def7753042df7177f304c9d"}
Jul 15 04:52:33.450954 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:33.450922    2539 generic.go:356] "Generic (PLEG): container finished" podID="a600b92a-2e91-4f4e-af4e-31b407b34d38" containerID="a81988e377d6feafda9c4936a7fe6f44740e821cd0a0e47e8d172fe5161f268c" exitCode=0
Jul 15 04:52:33.451385 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:33.451006    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv" event={"ID":"a600b92a-2e91-4f4e-af4e-31b407b34d38","Type":"ContainerDied","Data":"a81988e377d6feafda9c4936a7fe6f44740e821cd0a0e47e8d172fe5161f268c"}
Jul 15 04:52:34.580857 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:34.580833    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv"
Jul 15 04:52:34.688137 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:34.688108    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a600b92a-2e91-4f4e-af4e-31b407b34d38-maas-api-service-ca\") pod \"a600b92a-2e91-4f4e-af4e-31b407b34d38\" (UID: \"a600b92a-2e91-4f4e-af4e-31b407b34d38\") "
Jul 15 04:52:34.688430 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:34.688408    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a600b92a-2e91-4f4e-af4e-31b407b34d38-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a600b92a-2e91-4f4e-af4e-31b407b34d38" (UID: "a600b92a-2e91-4f4e-af4e-31b407b34d38"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:52:34.788934 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:34.788857    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a600b92a-2e91-4f4e-af4e-31b407b34d38-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:52:35.461454 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:35.461420    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv"
Jul 15 04:52:35.461675 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:35.461413    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv" event={"ID":"a600b92a-2e91-4f4e-af4e-31b407b34d38","Type":"ContainerDied","Data":"ff668c0d0b4b8797d31f9fb44cb074337dc5b2a80def7753042df7177f304c9d"}
Jul 15 04:52:35.461675 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:35.461555    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff668c0d0b4b8797d31f9fb44cb074337dc5b2a80def7753042df7177f304c9d"
Jul 15 04:52:58.149729 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.149691    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t"]
Jul 15 04:52:58.150252 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.149938    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a600b92a-2e91-4f4e-af4e-31b407b34d38" containerName="revoke-keys"
Jul 15 04:52:58.150252 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.149948    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="a600b92a-2e91-4f4e-af4e-31b407b34d38" containerName="revoke-keys"
Jul 15 04:52:58.150252 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.150005    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="a600b92a-2e91-4f4e-af4e-31b407b34d38" containerName="revoke-keys"
Jul 15 04:52:58.152731 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.152714    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t"
Jul 15 04:52:58.155201 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.155184    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 04:52:58.155315 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.155205    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jc2nz\""
Jul 15 04:52:58.160553 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.160528    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t"]
Jul 15 04:52:58.251071 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.251040    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82699ee0-2397-4440-a440-6d2e8a25387e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t\" (UID: \"82699ee0-2397-4440-a440-6d2e8a25387e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t"
Jul 15 04:52:58.352278 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.352252    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82699ee0-2397-4440-a440-6d2e8a25387e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t\" (UID: \"82699ee0-2397-4440-a440-6d2e8a25387e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t"
Jul 15 04:52:58.352833 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.352812    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82699ee0-2397-4440-a440-6d2e8a25387e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t\" (UID: \"82699ee0-2397-4440-a440-6d2e8a25387e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t"
Jul 15 04:52:58.463465 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.463399    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t"
Jul 15 04:52:58.595724 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:58.595703    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t"]
Jul 15 04:52:58.598128 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:52:58.598101    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82699ee0_2397_4440_a440_6d2e8a25387e.slice/crio-b121669db0b1e4d962d7e7edef850badc19aaba56d0958dcebcf40cae9444aec WatchSource:0}: Error finding container b121669db0b1e4d962d7e7edef850badc19aaba56d0958dcebcf40cae9444aec: Status 404 returned error can't find the container with id b121669db0b1e4d962d7e7edef850badc19aaba56d0958dcebcf40cae9444aec
Jul 15 04:52:59.571390 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:59.571305    2539 generic.go:356] "Generic (PLEG): container finished" podID="82699ee0-2397-4440-a440-6d2e8a25387e" containerID="d2b2288a7f6010c640b8fbfd5babc6fefcf939f00cd63c1d5950dafb00493a0d" exitCode=0
Jul 15 04:52:59.571390 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:59.571364    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t" event={"ID":"82699ee0-2397-4440-a440-6d2e8a25387e","Type":"ContainerDied","Data":"d2b2288a7f6010c640b8fbfd5babc6fefcf939f00cd63c1d5950dafb00493a0d"}
Jul 15 04:52:59.571761 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:52:59.571413    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t" event={"ID":"82699ee0-2397-4440-a440-6d2e8a25387e","Type":"ContainerStarted","Data":"b121669db0b1e4d962d7e7edef850badc19aaba56d0958dcebcf40cae9444aec"}
Jul 15 04:53:00.701667 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:00.701646    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t"
Jul 15 04:53:00.766584 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:00.766560    2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82699ee0-2397-4440-a440-6d2e8a25387e-maas-api-service-ca\") pod \"82699ee0-2397-4440-a440-6d2e8a25387e\" (UID: \"82699ee0-2397-4440-a440-6d2e8a25387e\") "
Jul 15 04:53:00.766901 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:00.766880    2539 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82699ee0-2397-4440-a440-6d2e8a25387e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "82699ee0-2397-4440-a440-6d2e8a25387e" (UID: "82699ee0-2397-4440-a440-6d2e8a25387e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 04:53:00.867033 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:00.866970    2539 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82699ee0-2397-4440-a440-6d2e8a25387e-maas-api-service-ca\") on node \"ip-10-0-136-55.ec2.internal\" DevicePath \"\""
Jul 15 04:53:01.583188 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:01.583149    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t" event={"ID":"82699ee0-2397-4440-a440-6d2e8a25387e","Type":"ContainerDied","Data":"b121669db0b1e4d962d7e7edef850badc19aaba56d0958dcebcf40cae9444aec"}
Jul 15 04:53:01.583395 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:01.583209    2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b121669db0b1e4d962d7e7edef850badc19aaba56d0958dcebcf40cae9444aec"
Jul 15 04:53:01.583395 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:01.583162    2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t"
Jul 15 04:53:24.640496 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:24.640462    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-cf8c54c94-9cqdh_18fdfb41-9570-4410-ad37-01e0a13e3bf7/authorino/0.log"
Jul 15 04:53:34.072822 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:34.072783    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nc6fk_f37696e7-622f-4ab8-b9b5-013522581af4/server/0.log"
Jul 15 04:53:34.327995 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:34.327908    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dddd85b7f-2llpz_31f2d3a4-c275-44b3-8d5c-57974489c23c/copy-manifests/0.log"
Jul 15 04:53:34.341159 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:34.341133    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dddd85b7f-2llpz_31f2d3a4-c275-44b3-8d5c-57974489c23c/manager/0.log"
Jul 15 04:53:35.325552 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:35.325519    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-a3677d66-vl8j7_bef326e3-7878-46c4-8f2a-6c1a08a57253/revoke-keys/1.log"
Jul 15 04:53:35.438545 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:35.438517    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-c27a526e-645w7_43349651-aacb-4fb1-a4be-797e11138d29/revoke-keys/0.log"
Jul 15 04:53:35.552312 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:35.552286    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-4aabeb-52xrd_d564f76b-ede2-4174-af4b-cdf6ad136c4b/revoke-keys/0.log"
Jul 15 04:53:35.663664 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:35.663600    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-0135c8-kvc7f_eaf3e865-9c1c-445e-8c41-e4109eae87cd/revoke-keys/0.log"
Jul 15 04:53:35.776266 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:35.776239    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-f6197270-4r2gg_23311a69-6a96-4332-84d2-94dc477b1230/revoke-keys/0.log"
Jul 15 04:53:35.891299 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:35.891277    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-005cfa-j6224_afba0960-6027-4bdc-b4fb-b15ef4ef4af2/revoke-keys/0.log"
Jul 15 04:53:36.012540 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:36.012476    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-194ff1-hkmxj_51b04c18-8aef-4ae6-9af5-233bd4cfbc59/revoke-keys/0.log"
Jul 15 04:53:36.121759 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:36.121733    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-0f70507c-6lgjn_4d5a21d5-c67f-493e-a291-a7783ea684a6/revoke-keys/0.log"
Jul 15 04:53:36.239581 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:36.239555    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-699a3596-tttbl_d6a56f6e-f262-4959-8923-62a043247641/revoke-keys/0.log"
Jul 15 04:53:36.353164 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:36.353144    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-d959dbe7-ggh4w_85e16c6b-cf06-4a08-8626-05d8b04dfe62/revoke-keys/0.log"
Jul 15 04:53:36.463050 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:36.463028    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-c2a8a9-xxnzv_a600b92a-2e91-4f4e-af4e-31b407b34d38/revoke-keys/0.log"
Jul 15 04:53:36.573333 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:36.573309    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-3a7aa4-dnv2t_82699ee0-2397-4440-a440-6d2e8a25387e/revoke-keys/0.log"
Jul 15 04:53:38.024626 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:38.024598    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-cf8c54c94-9cqdh_18fdfb41-9570-4410-ad37-01e0a13e3bf7/authorino/0.log"
Jul 15 04:53:38.382563 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:38.382536    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-p6qhq_2ae64373-f614-4473-9fe3-f1a2180d573b/kuadrant-console-plugin/0.log"
Jul 15 04:53:39.631191 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:39.631164    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b8bc8694c-vq8lv_a40edc1e-8a07-4941-b46c-86d0e7e42626/kube-auth-proxy/0.log"
Jul 15 04:53:40.478105 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:40.478061    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-cltgk_8bd8c1ee-9690-490d-8d36-0913f34755b2/main/0.log"
Jul 15 04:53:40.598880 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:40.598853    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bzsdd_68ec28cd-555b-4405-860c-98ace8f1f09f/main/0.log"
Jul 15 04:53:41.083858 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:41.083828    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-966qw_384ce8f5-f2f3-432a-89c2-a36aab24f587/main/0.log"
Jul 15 04:53:45.514375 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.514340    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lg2gg/must-gather-m5zjn"]
Jul 15 04:53:45.514729 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.514631    2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82699ee0-2397-4440-a440-6d2e8a25387e" containerName="revoke-keys"
Jul 15 04:53:45.514729 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.514641    2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="82699ee0-2397-4440-a440-6d2e8a25387e" containerName="revoke-keys"
Jul 15 04:53:45.514729 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.514692    2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="82699ee0-2397-4440-a440-6d2e8a25387e" containerName="revoke-keys"
Jul 15 04:53:45.517879 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.517859    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lg2gg/must-gather-m5zjn"
Jul 15 04:53:45.520377 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.520348    2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lg2gg\"/\"default-dockercfg-j6wft\""
Jul 15 04:53:45.520550 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.520431    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lg2gg\"/\"kube-root-ca.crt\""
Jul 15 04:53:45.520636 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.520623    2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lg2gg\"/\"openshift-service-ca.crt\""
Jul 15 04:53:45.525725 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.525704    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lg2gg/must-gather-m5zjn"]
Jul 15 04:53:45.569741 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.569714    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e4d319b-8b9e-43eb-a347-977384eb40b3-must-gather-output\") pod \"must-gather-m5zjn\" (UID: \"8e4d319b-8b9e-43eb-a347-977384eb40b3\") " pod="openshift-must-gather-lg2gg/must-gather-m5zjn"
Jul 15 04:53:45.569843 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.569749    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qw4w\" (UniqueName: \"kubernetes.io/projected/8e4d319b-8b9e-43eb-a347-977384eb40b3-kube-api-access-9qw4w\") pod \"must-gather-m5zjn\" (UID: \"8e4d319b-8b9e-43eb-a347-977384eb40b3\") " pod="openshift-must-gather-lg2gg/must-gather-m5zjn"
Jul 15 04:53:45.670081 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.670054    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qw4w\" (UniqueName: \"kubernetes.io/projected/8e4d319b-8b9e-43eb-a347-977384eb40b3-kube-api-access-9qw4w\") pod \"must-gather-m5zjn\" (UID: \"8e4d319b-8b9e-43eb-a347-977384eb40b3\") " pod="openshift-must-gather-lg2gg/must-gather-m5zjn"
Jul 15 04:53:45.670187 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.670147    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e4d319b-8b9e-43eb-a347-977384eb40b3-must-gather-output\") pod \"must-gather-m5zjn\" (UID: \"8e4d319b-8b9e-43eb-a347-977384eb40b3\") " pod="openshift-must-gather-lg2gg/must-gather-m5zjn"
Jul 15 04:53:45.670402 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.670385    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e4d319b-8b9e-43eb-a347-977384eb40b3-must-gather-output\") pod \"must-gather-m5zjn\" (UID: \"8e4d319b-8b9e-43eb-a347-977384eb40b3\") " pod="openshift-must-gather-lg2gg/must-gather-m5zjn"
Jul 15 04:53:45.678407 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.678384    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qw4w\" (UniqueName: \"kubernetes.io/projected/8e4d319b-8b9e-43eb-a347-977384eb40b3-kube-api-access-9qw4w\") pod \"must-gather-m5zjn\" (UID: \"8e4d319b-8b9e-43eb-a347-977384eb40b3\") " pod="openshift-must-gather-lg2gg/must-gather-m5zjn"
Jul 15 04:53:45.827862 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.827840    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lg2gg/must-gather-m5zjn"
Jul 15 04:53:45.954185 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.954158    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lg2gg/must-gather-m5zjn"]
Jul 15 04:53:45.957283 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:53:45.957249    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e4d319b_8b9e_43eb_a347_977384eb40b3.slice/crio-b3d52054953961aca1bea8eaa6e0f9dc6c4ef2108ffa829b5e05985ffafee21f WatchSource:0}: Error finding container b3d52054953961aca1bea8eaa6e0f9dc6c4ef2108ffa829b5e05985ffafee21f: Status 404 returned error can't find the container with id b3d52054953961aca1bea8eaa6e0f9dc6c4ef2108ffa829b5e05985ffafee21f
Jul 15 04:53:45.959398 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:45.959383    2539 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 04:53:46.787543 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:46.787508    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lg2gg/must-gather-m5zjn" event={"ID":"8e4d319b-8b9e-43eb-a347-977384eb40b3","Type":"ContainerStarted","Data":"b3d52054953961aca1bea8eaa6e0f9dc6c4ef2108ffa829b5e05985ffafee21f"}
Jul 15 04:53:47.797052 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:47.797006    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lg2gg/must-gather-m5zjn" event={"ID":"8e4d319b-8b9e-43eb-a347-977384eb40b3","Type":"ContainerStarted","Data":"0dbb844a8e6a333e9515fabc3f74adcc89dfd38ce40d13b96d448281cac0094a"}
Jul 15 04:53:47.797549 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:47.797064    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lg2gg/must-gather-m5zjn" event={"ID":"8e4d319b-8b9e-43eb-a347-977384eb40b3","Type":"ContainerStarted","Data":"f40c305e976da9ea4091187e287bf974fe8853777ab295c7f12750292b592309"}
Jul 15 04:53:47.812251 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:47.812205    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lg2gg/must-gather-m5zjn" podStartSLOduration=1.915674735 podStartE2EDuration="2.812189213s" totalImagesPullingTime="896.514478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:53:47.811622122 +0000 UTC m=+2856.248549019" watchObservedRunningTime="2026-07-15 04:53:47.812189213 +0000 UTC m=+2856.249116110"
Jul 15 04:53:48.363495 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:48.363465    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bkw6z_a8455199-dc31-493a-9fbd-fe6382eb83ee/global-pull-secret-syncer/0.log"
Jul 15 04:53:48.561939 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:48.561904    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lnvjn_56e14cd3-f903-4978-83c9-1622c1544499/konnectivity-agent/0.log"
Jul 15 04:53:48.681442 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:48.681354    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-55.ec2.internal_eb4fc7b7b597fd5dd2a5941924dbc289/haproxy/0.log"
Jul 15 04:53:54.351282 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:54.351243    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-cf8c54c94-9cqdh_18fdfb41-9570-4410-ad37-01e0a13e3bf7/authorino/0.log"
Jul 15 04:53:54.431657 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:54.431546    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-p6qhq_2ae64373-f614-4473-9fe3-f1a2180d573b/kuadrant-console-plugin/0.log"
Jul 15 04:53:56.712501 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:56.712459    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jsttq_9bd27d8a-9357-45f5-afa4-e271727f5bba/node-exporter/0.log"
Jul 15 04:53:56.731866 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:56.731823    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jsttq_9bd27d8a-9357-45f5-afa4-e271727f5bba/kube-rbac-proxy/0.log"
Jul 15 04:53:56.753908 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:56.753873    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jsttq_9bd27d8a-9357-45f5-afa4-e271727f5bba/init-textfile/0.log"
Jul 15 04:53:57.968119 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:57.968068    2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"]
Jul 15 04:53:57.972549 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:57.972529    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:57.982071 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:57.982038    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"]
Jul 15 04:53:58.090201 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.090156    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hg4f\" (UniqueName: \"kubernetes.io/projected/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-kube-api-access-4hg4f\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.090389 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.090218    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-podres\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.090389 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.090256    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-lib-modules\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.090389 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.090283    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-sys\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.090389 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.090356    2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-proc\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.192801 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.191564    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-proc\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.192801 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.191638    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hg4f\" (UniqueName: \"kubernetes.io/projected/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-kube-api-access-4hg4f\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.192801 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.191722    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-podres\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.192801 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.191775    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-lib-modules\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.192801 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.191820    2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-sys\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.192801 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.192385    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-proc\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.192801 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.192548    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-podres\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.192801 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.192602    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-lib-modules\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.192801 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.192671    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-sys\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.201430 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.201403    2539 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hg4f\" (UniqueName: \"kubernetes.io/projected/ddd5448f-9c00-4f2e-9690-31bb73cc21d1-kube-api-access-4hg4f\") pod \"perf-node-gather-daemonset-6wvsw\" (UID: \"ddd5448f-9c00-4f2e-9690-31bb73cc21d1\") " pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.290522 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.290439    2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.462979 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.462773    2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"]
Jul 15 04:53:58.472757 ip-10-0-136-55 kubenswrapper[2539]: W0715 04:53:58.472587    2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podddd5448f_9c00_4f2e_9690_31bb73cc21d1.slice/crio-8e1965f936d4070d5db6b4b613bf9fed85070c75aa964f1644e1ef09088e3e36 WatchSource:0}: Error finding container 8e1965f936d4070d5db6b4b613bf9fed85070c75aa964f1644e1ef09088e3e36: Status 404 returned error can't find the container with id 8e1965f936d4070d5db6b4b613bf9fed85070c75aa964f1644e1ef09088e3e36
Jul 15 04:53:58.887849 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.887429    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw" event={"ID":"ddd5448f-9c00-4f2e-9690-31bb73cc21d1","Type":"ContainerStarted","Data":"99c032b687a7cdfb6f7569c73be6b4b413fb4dcfd72e43006280b72970ff9518"}
Jul 15 04:53:58.888056 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.887894    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:53:58.888056 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.887937    2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw" event={"ID":"ddd5448f-9c00-4f2e-9690-31bb73cc21d1","Type":"ContainerStarted","Data":"8e1965f936d4070d5db6b4b613bf9fed85070c75aa964f1644e1ef09088e3e36"}
Jul 15 04:53:58.904018 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:53:58.903959    2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw" podStartSLOduration=1.90394217 podStartE2EDuration="1.90394217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:53:58.903001829 +0000 UTC m=+2867.339928725" watchObservedRunningTime="2026-07-15 04:53:58.90394217 +0000 UTC m=+2867.340869068"
Jul 15 04:54:01.042081 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:01.042050    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2f46c_602469bc-8388-42c3-9fbc-0dd67634d59d/dns/0.log"
Jul 15 04:54:01.066494 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:01.066467    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2f46c_602469bc-8388-42c3-9fbc-0dd67634d59d/kube-rbac-proxy/0.log"
Jul 15 04:54:01.237628 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:01.237604    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q7n7b_13ac8a6b-5743-4bec-b544-2da140a035d0/dns-node-resolver/0.log"
Jul 15 04:54:01.837438 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:01.837410    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dx75w_624ff61e-8c93-4956-b0a4-4b3782abaded/node-ca/0.log"
Jul 15 04:54:02.914847 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:02.914763    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b8bc8694c-vq8lv_a40edc1e-8a07-4941-b46c-86d0e7e42626/kube-auth-proxy/0.log"
Jul 15 04:54:03.841296 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:03.841238    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vj5mn_bb89e80c-762c-462e-a309-ea754b8cbf88/serve-healthcheck-canary/0.log"
Jul 15 04:54:04.326172 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:04.326140    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-glc9h_9a165c47-5593-4a83-a357-c1443b1116cb/kube-rbac-proxy/0.log"
Jul 15 04:54:04.349060 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:04.349035    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-glc9h_9a165c47-5593-4a83-a357-c1443b1116cb/exporter/0.log"
Jul 15 04:54:04.370831 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:04.370808    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-glc9h_9a165c47-5593-4a83-a357-c1443b1116cb/extractor/0.log"
Jul 15 04:54:04.904381 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:04.903537    2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lg2gg/perf-node-gather-daemonset-6wvsw"
Jul 15 04:54:06.995758 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:06.995727    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nc6fk_f37696e7-622f-4ab8-b9b5-013522581af4/server/0.log"
Jul 15 04:54:07.196898 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:07.196812    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dddd85b7f-2llpz_31f2d3a4-c275-44b3-8d5c-57974489c23c/manager/0.log"
Jul 15 04:54:07.212894 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:07.212866    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dddd85b7f-2llpz_31f2d3a4-c275-44b3-8d5c-57974489c23c/copy-manifests/0.log"
Jul 15 04:54:08.431465 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:08.431434    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b8bc8694c-vq8lv_a40edc1e-8a07-4941-b46c-86d0e7e42626/kube-auth-proxy/0.log"
Jul 15 04:54:08.536121 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:08.536078    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c845c8db6-4q4wm_5e4203d8-125e-48a7-9238-b0d6a36eb099/manager/0.log"
Jul 15 04:54:09.980986 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:09.980917    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b8bc8694c-vq8lv_a40edc1e-8a07-4941-b46c-86d0e7e42626/kube-auth-proxy/0.log"
Jul 15 04:54:13.484756 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:13.484728    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-nzbxz_64226c49-d311-4853-833e-ba1930439125/migrator/0.log"
Jul 15 04:54:13.504322 ip-10-0-136-55 kubenswrapper[2539]: I0715 04:54:13.504294    2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-nzbxz_64226c49-d311-4853-833e-ba1930439125/graceful-termination/0.log"