Jul 23 21:49:48.300116 ip-10-0-134-91 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 21:49:48.300126 ip-10-0-134-91 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 21:49:48.300133 ip-10-0-134-91 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 21:49:48.300373 ip-10-0-134-91 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 21:49:59.681322 ip-10-0-134-91 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 21:49:59.681344 ip-10-0-134-91 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a73a927edde1446a932b17dc46dea79b --
Jul 23 21:51:35.848538 ip-10-0-134-91 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.248829    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253281    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253294    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253298    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253301    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253303    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253310    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253313    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 21:51:36.312644 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253316    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253318    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253322    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253325    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253328    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253330    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253333    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253336    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253339    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253342    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253344    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253347    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253349    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253352    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253355    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253358    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253361    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253363    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253366    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253369    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 21:51:36.314872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253371    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253374    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253377    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253380    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253382    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253385    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253387    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253390    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253392    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253395    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253397    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253400    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253403    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253405    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253408    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253411    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253414    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253416    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253419    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253422    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 21:51:36.317183 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253425    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253428    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253430    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253434    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253438    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253441    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253443    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253446    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253449    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253452    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253454    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253457    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253459    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253462    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253465    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253468    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253472    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253475    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253477    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253480    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 21:51:36.319051 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253482    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253485    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253488    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253490    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253493    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253495    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253498    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253500    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253504    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253508    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253511    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253513    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253516    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253519    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253522    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253525    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253527    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253530    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253532    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 21:51:36.321633 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253537    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253539    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253542    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253544    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253547    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253549    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253552    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253556    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253559    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253562    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253565    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253569    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.253572    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254320    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254328    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254332    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254337    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254340    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254343    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 21:51:36.323730 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254345    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 21:51:36.322936 ip-10-0-134-91 systemd[1]: Started Kubernetes Kubelet.
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254348    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254351    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254354    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254356    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254359    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254361    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254364    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254367    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254369    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254373    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254376    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254378    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254381    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254384    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254387    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254390    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254393    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254396    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254399    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 21:51:36.326480 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254402    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254406    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254410    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254414    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254417    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254420    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254423    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254425    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254428    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254431    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254434    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254437    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254440    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254443    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254445    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254448    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254450    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254453    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254455    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 21:51:36.343184 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254458    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254461    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254464    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254466    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254468    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254471    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254473    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254476    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254478    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254481    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254484    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254487    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254490    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254492    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254495    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254497    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254500    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254507    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254509    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 21:51:36.345804 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254512    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254514    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254516    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254519    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254521    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254525    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254528    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254530    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254532    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254537    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254540    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254543    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254546    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254549    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254551    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254554    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254557    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254559    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254562    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254564    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 21:51:36.347844 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254567    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254570    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254573    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254575    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254578    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254580    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254583    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254585    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254588    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254591    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254595    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254598    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254601    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254603    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.254606    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255035    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255041    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255044    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255047    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255051    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 21:51:36.351177 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255054    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255056    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255060    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255062    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255065    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255068    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255070    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255073    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255076    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255078    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255081    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255083    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255086    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255088    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255091    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255094    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255097    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255099    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255102    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255104    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 21:51:36.354721 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255107    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255110    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255114    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255118    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255120    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255123    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255125    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255128    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255130    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255133    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255135    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255138    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255141    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255143    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255146    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255148    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255151    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255154    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255156    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255159    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 21:51:36.368207 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255161    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255164    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255168    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255171    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255174    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255176    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255179    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255182    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255185    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255187    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255190    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255192    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255195    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255199    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255202    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255205    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255208    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255227    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255231    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 21:51:36.370924 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255233    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255236    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255238    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255241    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255244    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255247    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255250    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255253    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255255    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255258    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255260    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255265    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255267    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255270    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255274    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255277    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255280    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255285    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255288    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 21:51:36.529822 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255291    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255295    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255297    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255300    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255302    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255305    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255307    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255310    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255313    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255316    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255318    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255321    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255324    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255326    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255329    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.255332    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255404    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255416    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255423    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255429    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255435    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 21:51:36.543143 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255440    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255446    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255453    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255458    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255461    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255464    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255467    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255471    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255474    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255476    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255479    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255482    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255486    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255490    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255493    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255496    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255499    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255502    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255506    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255511    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255514    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255517    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255520    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255524    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 21:51:36.548021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255527    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255530    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255533    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255537    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255541    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255543    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255546    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255549    2565 flags.go:64] FLAG: --enable-server="true"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255552    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255556    2565 flags.go:64] FLAG: --event-burst="100"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255559    2565 flags.go:64] FLAG: --event-qps="50"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255564    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255567    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255570    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255574    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255577    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255580    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255583    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255586    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255589    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255592    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255595    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255598    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255600    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255604    2565 flags.go:64] FLAG: --feature-gates=""
Jul 23 21:51:36.551458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255607    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255610    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255614    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255618    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255621    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255624    2565 flags.go:64] FLAG: --help="false"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255627    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255630    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255633    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255636    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255640    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255643    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255646    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255648    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255651    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255654    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255657    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255660    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255664    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255667    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255670    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255673    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255675    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255678    2565 flags.go:64] FLAG: --lock-file=""
Jul 23 21:51:36.552980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255681    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255684    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255687    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255692    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255695    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255698    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255701    2565 flags.go:64] FLAG: --logging-format="text"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255703    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255706    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255709    2565 flags.go:64] FLAG: --manifest-url=""
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255714    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255718    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255721    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255725    2565 flags.go:64] FLAG: --max-pods="110"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255728    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255731    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255734    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255737    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255740    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255743    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255746    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255753    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255756    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255759    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 21:51:36.558653 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255762    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255765    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255772    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255775    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255778    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255781    2565 flags.go:64] FLAG: --port="10250"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255784    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255787    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b359e6b2d1fa7bbe"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255790    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255793    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255796    2565 flags.go:64] FLAG: --register-node="true"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255799    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255802    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255805    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255808    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255811    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255815    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255818    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255821    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255825    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255827    2565 flags.go:64] FLAG: --runonce="false"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255830    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255833    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255836    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255839    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 21:51:36.559775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255843    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255846    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255849    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255853    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255855    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255858    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255861    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255864    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255867    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255871    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255874    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255880    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255884    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255888    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255896    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255899    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255903    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255906    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255909    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255912    2565 flags.go:64] FLAG: --v="2"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255916    2565 flags.go:64] FLAG: --version="false"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255920    2565 flags.go:64] FLAG: --vmodule=""
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255929    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.255933    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256052    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 21:51:36.567234 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256055    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256059    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256063    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256065    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256068    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256071    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256073    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256076    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256079    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256082    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256084    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256087    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256090    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256092    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256095    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256097    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256102    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256105    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256107    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256110    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 21:51:36.568512 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256113    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256117    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256120    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256123    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256126    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256129    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256132    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256134    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256136    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256139    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256142    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256146    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256149    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256153    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256157    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256160    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256163    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256167    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 21:51:36.569393 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256169    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256172    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256174    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256178    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256181    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256183    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256186    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256188    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256191    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256194    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256198    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256201    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256203    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256206    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256208    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256226    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256229    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256231    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256234    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256236    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 21:51:36.570490 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256239    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256242    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256244    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256247    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256250    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256252    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256255    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256259    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256261    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256264    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256267    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256269    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256272    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256275    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256278    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256280    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256283    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256286    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256289    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256291    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 21:51:36.571373 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256294    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256296    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256300    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256303    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256306    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256308    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256311    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256314    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256316    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256319    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256321    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256324    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256327    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256329    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256332    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256335    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256337    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256340    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256342    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 21:51:36.572485 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.256346    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.256956    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.265825    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.265843    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.265864    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.265871    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265931    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265936    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265939    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265943    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265945    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265948    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265951    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265953    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 21:51:36.573365 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265956    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265959    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265961    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265964    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265966    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265969    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265971    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265974    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265977    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265979    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265982    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265985    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265988    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265990    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265994    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265996    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.265998    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266001    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266003    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266006    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 21:51:36.574031 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266009    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266012    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266014    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266017    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266020    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266023    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266025    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266028    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266030    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266033    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266035    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266039    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266043    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266046    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266049    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266052    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266054    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266058    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266063    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266066    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 21:51:36.574942 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266068    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266071    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266074    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266076    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266079    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266082    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266084    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266087    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266090    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266092    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266095    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266098    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266100    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266102    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266105    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266107    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266110    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266112    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266115    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266117    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 21:51:36.576069 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266120    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266123    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266125    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266128    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266130    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266133    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266135    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266137    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266140    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266143    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266147    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266151    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266154    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266157    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266159    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266162    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266165    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266167    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266170    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 21:51:36.576961 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266173    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266175    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266178    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266181    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266183    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266186    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266189    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266191    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266194    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266197    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266201    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266204    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.266209    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266344    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 21:51:36.578048 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266349    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266352    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266355    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266358    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266361    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266363    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266366    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266368    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266371    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266376    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266379    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266382    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266386    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266390    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266393    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266396    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266398    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266403    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266406    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266408    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 21:51:36.578720 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266411    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266414    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266417    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266420    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266423    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266425    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266428    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266431    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266433    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266436    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266440    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266443    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266446    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266449    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266451    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266454    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266457    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266459    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266461    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 21:51:36.579599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266464    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266467    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266471    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266474    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266476    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266479    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266482    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266485    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266488    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266490    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266494    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266496    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266499    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266501    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266504    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266506    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266509    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266511    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266514    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266516    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 21:51:36.580474 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266519    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266521    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266524    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266527    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266529    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266532    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266534    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266537    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266539    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266542    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266544    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266547    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266550    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266552    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266556    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266558    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266561    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266564    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266567    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266569    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 21:51:36.581463 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266572    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266574    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266578    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266581    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266583    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266586    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266588    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266591    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266593    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266596    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266598    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266600    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266604    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266607    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266610    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266613    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266615    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266618    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 21:51:36.582446 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:36.266621    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.266625    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.266745    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.269994    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.271243    2565 server.go:1019] "Starting client certificate rotation"
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.271339    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.271373    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.273483    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.276236    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.287962    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.290259    2565 log.go:25] "Validated CRI v1 image API"
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.291003    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 21:51:36.583511 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.293316    2565 fs.go:135] Filesystem UUIDs: map[68012625-e45a-48fc-afd7-34ed53515e23:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e305d0d4-52b0-4ffa-a1da-643e82542c26:/dev/nvme0n1p4]
Jul 23 21:51:36.584137 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.293335    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 21:51:36.584700 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.298821    2565 manager.go:216] Machine: {Timestamp:2026-07-23 21:51:36.298333574 +0000 UTC m=+0.333041105 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3119597 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b3a4483a953e92cb3f0b665768984 SystemUUID:ec2b3a44-83a9-53e9-2cb3-f0b665768984 BootID:a73a927e-dde1-446a-932b-17dc46dea79b Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e7:ae:05:4d:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e7:ae:05:4d:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:7a:30:5e:e3:a5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 21:51:36.584700 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.298932    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 21:51:36.584700 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.299015    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 21:51:36.584700 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.300272    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 21:51:36.584700 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.301430    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 21:51:36.584700 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.301455    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 21:51:36.584700 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.302154    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.302164    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.302172    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.302726    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.303848    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.306381    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.306496    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.306524    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.306533    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.306548    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.306557    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.306566    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.306948    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.306963    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.311135    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.315982    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.316012    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317080    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317100    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317108    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317116    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317127    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317135    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317146    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317153    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317163    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317171    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317184    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.317192    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.318238    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.318250    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.319034    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.319186    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.321113    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.321977    2565 server.go:1268] "Started kubelet"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.322121    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.322200    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.322965    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.326048    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6hjd4"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.326515    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 21:51:36.701246 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.326972    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.329752    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.329669    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-91.ec2.internal.18c509b411ef7853  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-91.ec2.internal,UID:ip-10-0-134-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-91.ec2.internal,},FirstTimestamp:2026-07-23 21:51:36.321939539 +0000 UTC m=+0.356647071,LastTimestamp:2026-07-23 21:51:36.321939539 +0000 UTC m=+0.356647071,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-91.ec2.internal,}"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.331850    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6hjd4"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.332076    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.332120    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.332150    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-91.ec2.internal\" not found"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.332731    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.332745    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.332758    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.332847    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.332856    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.332892    2565 factory.go:55] Registering systemd factory
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.332908    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.333131    2565 factory.go:153] Registering CRI-O factory
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.333146    2565 factory.go:223] Registration of the crio container factory successfully
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.333199    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.333273    2565 factory.go:103] Registering Raw factory
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.333289    2565 manager.go:1196] Started watching for new ooms in manager
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.333621    2565 manager.go:349] Starting recovery of all containers
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.335775    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.347040    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-91.ec2.internal\" not found" node="ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.348456    2565 manager.go:354] Recovery completed
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.353951    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.355790    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.355819    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.355829    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientPID"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.356415    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.356424    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.356440    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.356477    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.357113    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.357137    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.357150    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientPID"
Jul 23 21:51:36.703833 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.357587    2565 policy_none.go:49] "None policy: Start"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.357604    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.357619    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.358641    2565 policy_none.go:47] "Start"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.401850    2565 manager.go:337] "Starting Device Plugin manager"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.401884    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.401896    2565 server.go:87] "Starting device plugin registration server"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.402198    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.402235    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.402318    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.402404    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.402426    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.402906    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.402957    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-91.ec2.internal\" not found"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.474196    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.475589    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.475624    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.475646    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.475680    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.478151    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.503176    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.504266    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.504299    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.504315    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientPID"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.504352    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.513706    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.513731    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-91.ec2.internal\": node \"ip-10-0-134-91.ec2.internal\" not found"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.527654    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-91.ec2.internal\" not found"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.576100    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-91.ec2.internal"]
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.576175    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.599594    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.599626    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.599641    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientPID"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.600973    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.601154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.601187    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.601874    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.601882    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 21:51:36.711251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.601902    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.601903    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.601914    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientPID"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.601926    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientPID"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.603085    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.603113    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.604044    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.604078    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.604092    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeHasSufficientPID"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.627997    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-91.ec2.internal\" not found"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.634333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4b58c88408815fc3e1d4ba8882fc500-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal\" (UID: \"e4b58c88408815fc3e1d4ba8882fc500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.634367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4b58c88408815fc3e1d4ba8882fc500-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal\" (UID: \"e4b58c88408815fc3e1d4ba8882fc500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.634393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23b00daf35cdc991e4ab2a8e97ad8f2c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-91.ec2.internal\" (UID: \"23b00daf35cdc991e4ab2a8e97ad8f2c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.648136    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-91.ec2.internal\" not found" node="ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.712955 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.652738    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-91.ec2.internal\" not found" node="ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.787858 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.728076    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-91.ec2.internal\" not found"
Jul 23 21:51:36.787858 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.735446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4b58c88408815fc3e1d4ba8882fc500-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal\" (UID: \"e4b58c88408815fc3e1d4ba8882fc500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.787858 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.735515    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4b58c88408815fc3e1d4ba8882fc500-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal\" (UID: \"e4b58c88408815fc3e1d4ba8882fc500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.787858 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.735548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4b58c88408815fc3e1d4ba8882fc500-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal\" (UID: \"e4b58c88408815fc3e1d4ba8882fc500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.787858 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.735584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4b58c88408815fc3e1d4ba8882fc500-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal\" (UID: \"e4b58c88408815fc3e1d4ba8882fc500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.787858 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.735589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23b00daf35cdc991e4ab2a8e97ad8f2c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-91.ec2.internal\" (UID: \"23b00daf35cdc991e4ab2a8e97ad8f2c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.787858 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.735608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23b00daf35cdc991e4ab2a8e97ad8f2c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-91.ec2.internal\" (UID: \"23b00daf35cdc991e4ab2a8e97ad8f2c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.873620 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.828423    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-91.ec2.internal\" not found"
Jul 23 21:51:36.983848 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:36.928877    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-91.ec2.internal\" not found"
Jul 23 21:51:36.983848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.951311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:36.983848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:36.956008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:37.165496 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.029580    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-91.ec2.internal\" not found"
Jul 23 21:51:37.165496 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.130636    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-91.ec2.internal\" not found"
Jul 23 21:51:37.283495 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.231015    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-91.ec2.internal\" not found"
Jul 23 21:51:37.283495 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.240742    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 21:51:37.283495 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.272791    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 21:51:37.283495 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.272925    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 21:51:37.283495 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.272965    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.304691    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.306779    2565 apiserver.go:52] "Watching apiserver"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.321931    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.323629    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-rjtvh","openshift-cluster-node-tuning-operator/tuned-ddx2c","openshift-image-registry/node-ca-5g6bl","openshift-multus/multus-additional-cni-plugins-fl7vn","openshift-multus/multus-zcjqr","openshift-multus/network-metrics-daemon-hphl7","openshift-network-diagnostics/network-check-target-w5jk7","openshift-network-operator/iptables-alerter-g9j5p","kube-system/global-pull-secret-syncer-c56hs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j","openshift-dns/node-resolver-hfjw8","openshift-ovn-kubernetes/ovnkube-node-kdxmw"]
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.325381    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.326885    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.327865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5g6bl"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.328077    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.328193    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9n7p2\""
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.328248    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.328911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.329170    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c7796\""
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.329215    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.329269    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.330011    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.331390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.331462    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.332417    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.332484    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.333183    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.333248    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.333678    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g9j5p"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.334771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.334884    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:37.361955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.335767    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 21:46:36 +0000 UTC" deadline="2028-02-03 09:28:26.263009369 +0000 UTC"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.335807    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13427h36m48.927204275s"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.335899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.337059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hfjw8"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f46f96e-e91d-40ba-aba5-6e2531cabc56-agent-certs\") pod \"konnectivity-agent-rjtvh\" (UID: \"7f46f96e-e91d-40ba-aba5-6e2531cabc56\") " pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d130ce3e-244a-4d88-94eb-6aca75770475-etc-tuned\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svrc\" (UniqueName: \"kubernetes.io/projected/d130ce3e-244a-4d88-94eb-6aca75770475-kube-api-access-2svrc\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-system-cni-dir\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ded7f54-9992-4868-a3bf-2c64856f347b-cni-binary-copy\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-var-lib-cni-multus\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae6cee96-e6ab-4525-bbe9-572ef18332b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nsjz\" (UniqueName: \"kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz\") pod \"network-check-target-w5jk7\" (UID: \"f621510a-a35d-492a-a989-9024c85c2964\") " pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-var-lib-kubelet\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-run-netns\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5swh\" (UniqueName: \"kubernetes.io/projected/a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4-kube-api-access-b5swh\") pod \"node-ca-5g6bl\" (UID: \"a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4\") " pod="openshift-image-registry/node-ca-5g6bl"
Jul 23 21:51:37.363615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-sys\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-lib-modules\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-sysconfig\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-daemon-config\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-etc-kubernetes\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4-host\") pod \"node-ca-5g6bl\" (UID: \"a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4\") " pod="openshift-image-registry/node-ca-5g6bl"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4-serviceca\") pod \"node-ca-5g6bl\" (UID: \"a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4\") " pod="openshift-image-registry/node-ca-5g6bl"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-system-cni-dir\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-modprobe-d\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-cni-dir\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4j8q\" (UniqueName: \"kubernetes.io/projected/e7af186d-aaae-47e9-8196-fb393bbc3bc7-kube-api-access-g4j8q\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f46f96e-e91d-40ba-aba5-6e2531cabc56-konnectivity-ca\") pod \"konnectivity-agent-rjtvh\" (UID: \"7f46f96e-e91d-40ba-aba5-6e2531cabc56\") " pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-os-release\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.364591 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhks2\" (UniqueName: \"kubernetes.io/projected/0ded7f54-9992-4868-a3bf-2c64856f347b-kube-api-access-dhks2\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae6cee96-e6ab-4525-bbe9-572ef18332b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfrz4\" (UniqueName: \"kubernetes.io/projected/ae6cee96-e6ab-4525-bbe9-572ef18332b4-kube-api-access-qfrz4\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-host\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d130ce3e-244a-4d88-94eb-6aca75770475-tmp\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-cnibin\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-socket-dir-parent\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.338982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-var-lib-cni-bin\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-hostroot\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae6cee96-e6ab-4525-bbe9-572ef18332b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-kubernetes\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-sysctl-conf\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-systemd\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.365341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-run\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.368211 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-run-k8s-cni-cncf-io\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.368211 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-var-lib-kubelet\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.368211 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-conf-dir\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.368211 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ea80c06-4511-4577-851c-854825bd7eba-iptables-alerter-script\") pod \"iptables-alerter-g9j5p\" (UID: \"6ea80c06-4511-4577-851c-854825bd7eba\") " pod="openshift-network-operator/iptables-alerter-g9j5p"
Jul 23 21:51:37.368211 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-sysctl-d\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.368211 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-run-multus-certs\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.368211 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ea80c06-4511-4577-851c-854825bd7eba-host-slash\") pod \"iptables-alerter-g9j5p\" (UID: \"6ea80c06-4511-4577-851c-854825bd7eba\") " pod="openshift-network-operator/iptables-alerter-g9j5p"
Jul 23 21:51:37.368211 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rszj\" (UniqueName: \"kubernetes.io/projected/6ea80c06-4511-4577-851c-854825bd7eba-kube-api-access-4rszj\") pod \"iptables-alerter-g9j5p\" (UID: \"6ea80c06-4511-4577-851c-854825bd7eba\") " pod="openshift-network-operator/iptables-alerter-g9j5p"
Jul 23 21:51:37.368211 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-cnibin\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.368211 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.339436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-os-release\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394137    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394252    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394301    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394366    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5twfc\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394308    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cxbjf\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394441    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394481    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394522    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394563    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394589    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394613    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394773    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394804    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394812    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394827    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.394965    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l7dh9\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395041    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395083    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395334    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-krv2k\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395379    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395430    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395510    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395571    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395633    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395673    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395694    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6c8jk\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395743    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.395678    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-91.ec2.internal"]
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.396189    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.396196    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 21:51:37.449053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.396369    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ffn2s\""
Jul 23 21:51:37.450711 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.396384    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal"
Jul 23 21:51:37.450711 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.397062    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r4v5r\""
Jul 23 21:51:37.450711 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.402790    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 21:51:37.450711 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.402888    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mg6l2"
Jul 23 21:51:37.450711 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.434451    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 21:51:37.450711 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.440042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-dbus\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.456874    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-device-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.456891    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.456937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-sys\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.456980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-lib-modules\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-sys\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-daemon-config\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-system-cni-dir\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-lib-modules\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-systemd-units\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457254    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-system-cni-dir\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-modprobe-d\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457415    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal"]
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-cni-dir\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.457825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-modprobe-d\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.457637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-cni-dir\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4j8q\" (UniqueName: \"kubernetes.io/projected/e7af186d-aaae-47e9-8196-fb393bbc3bc7-kube-api-access-g4j8q\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f95ebfd9-d9ab-4600-8242-a9afb437e348-env-overrides\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.458094    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f95ebfd9-d9ab-4600-8242-a9afb437e348-ovn-node-metrics-cert\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-os-release\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfrz4\" (UniqueName: \"kubernetes.io/projected/ae6cee96-e6ab-4525-bbe9-572ef18332b4-kube-api-access-qfrz4\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.458190    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs podName:e7af186d-aaae-47e9-8196-fb393bbc3bc7 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:37.95816701 +0000 UTC m=+1.992874544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs") pod "network-metrics-daemon-hphl7" (UID: "e7af186d-aaae-47e9-8196-fb393bbc3bc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-log-socket\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-os-release\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-socket-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-socket-dir-parent\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.458662 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae6cee96-e6ab-4525-bbe9-572ef18332b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nsjz\" (UniqueName: \"kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz\") pod \"network-check-target-w5jk7\" (UID: \"f621510a-a35d-492a-a989-9024c85c2964\") " pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-socket-dir-parent\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-cni-bin\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-sysctl-conf\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-conf-dir\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rszj\" (UniqueName: \"kubernetes.io/projected/6ea80c06-4511-4577-851c-854825bd7eba-kube-api-access-4rszj\") pod \"iptables-alerter-g9j5p\" (UID: \"6ea80c06-4511-4577-851c-854825bd7eba\") " pod="openshift-network-operator/iptables-alerter-g9j5p"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-node-log\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-conf-dir\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-kubelet-config\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-sysctl-conf\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-sysctl-d\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-run-multus-certs\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ea80c06-4511-4577-851c-854825bd7eba-host-slash\") pod \"iptables-alerter-g9j5p\" (UID: \"6ea80c06-4511-4577-851c-854825bd7eba\") " pod="openshift-network-operator/iptables-alerter-g9j5p"
Jul 23 21:51:37.459318 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-slash\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-run-multus-certs\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-run-openvswitch\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ea80c06-4511-4577-851c-854825bd7eba-host-slash\") pod \"iptables-alerter-g9j5p\" (UID: \"6ea80c06-4511-4577-851c-854825bd7eba\") " pod="openshift-network-operator/iptables-alerter-g9j5p"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-sysctl-d\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-etc-selinux\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f46f96e-e91d-40ba-aba5-6e2531cabc56-agent-certs\") pod \"konnectivity-agent-rjtvh\" (UID: \"7f46f96e-e91d-40ba-aba5-6e2531cabc56\") " pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d130ce3e-244a-4d88-94eb-6aca75770475-etc-tuned\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ded7f54-9992-4868-a3bf-2c64856f347b-cni-binary-copy\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-var-lib-cni-multus\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-cni-netd\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-sys-fs\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-var-lib-kubelet\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-run-netns\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.460931 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.458970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-var-lib-cni-multus\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-var-lib-kubelet\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-run-netns\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5swh\" (UniqueName: \"kubernetes.io/projected/a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4-kube-api-access-b5swh\") pod \"node-ca-5g6bl\" (UID: \"a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4\") " pod="openshift-image-registry/node-ca-5g6bl"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-sysconfig\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-etc-kubernetes\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4-host\") pod \"node-ca-5g6bl\" (UID: \"a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4\") " pod="openshift-image-registry/node-ca-5g6bl"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-sysconfig\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4-serviceca\") pod \"node-ca-5g6bl\" (UID: \"a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4\") " pod="openshift-image-registry/node-ca-5g6bl"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-etc-kubernetes\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3f1eeec-867b-4366-bfd9-0676e9f55877-hosts-file\") pod \"node-resolver-hfjw8\" (UID: \"e3f1eeec-867b-4366-bfd9-0676e9f55877\") " pod="openshift-dns/node-resolver-hfjw8"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4-host\") pod \"node-ca-5g6bl\" (UID: \"a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4\") " pod="openshift-image-registry/node-ca-5g6bl"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3f1eeec-867b-4366-bfd9-0676e9f55877-tmp-dir\") pod \"node-resolver-hfjw8\" (UID: \"e3f1eeec-867b-4366-bfd9-0676e9f55877\") " pod="openshift-dns/node-resolver-hfjw8"
Jul 23 21:51:37.461878 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxk5f\" (UniqueName: \"kubernetes.io/projected/e3f1eeec-867b-4366-bfd9-0676e9f55877-kube-api-access-lxk5f\") pod \"node-resolver-hfjw8\" (UID: \"e3f1eeec-867b-4366-bfd9-0676e9f55877\") " pod="openshift-dns/node-resolver-hfjw8"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-run-netns\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-etc-openvswitch\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-run-ovn\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq6qb\" (UniqueName: \"kubernetes.io/projected/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-kube-api-access-gq6qb\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f46f96e-e91d-40ba-aba5-6e2531cabc56-konnectivity-ca\") pod \"konnectivity-agent-rjtvh\" (UID: \"7f46f96e-e91d-40ba-aba5-6e2531cabc56\") " pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhks2\" (UniqueName: \"kubernetes.io/projected/0ded7f54-9992-4868-a3bf-2c64856f347b-kube-api-access-dhks2\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae6cee96-e6ab-4525-bbe9-572ef18332b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.459572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-host\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460011    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d130ce3e-244a-4d88-94eb-6aca75770475-tmp\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-cnibin\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-var-lib-cni-bin\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-hostroot\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.463737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460353    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f46f96e-e91d-40ba-aba5-6e2531cabc56-konnectivity-ca\") pod \"konnectivity-agent-rjtvh\" (UID: \"7f46f96e-e91d-40ba-aba5-6e2531cabc56\") " pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae6cee96-e6ab-4525-bbe9-572ef18332b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f95ebfd9-d9ab-4600-8242-a9afb437e348-ovnkube-script-lib\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460458    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-kubernetes\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-systemd\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-run\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-run-k8s-cni-cncf-io\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-var-lib-kubelet\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ea80c06-4511-4577-851c-854825bd7eba-iptables-alerter-script\") pod \"iptables-alerter-g9j5p\" (UID: \"6ea80c06-4511-4577-851c-854825bd7eba\") " pod="openshift-network-operator/iptables-alerter-g9j5p"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460683    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-os-release\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-run-systemd\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-cnibin\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-var-lib-openvswitch\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.464849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4-serviceca\") pod \"node-ca-5g6bl\" (UID: \"a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4\") " pod="openshift-image-registry/node-ca-5g6bl"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f95ebfd9-d9ab-4600-8242-a9afb437e348-ovnkube-config\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460966    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae6cee96-e6ab-4525-bbe9-572ef18332b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.460977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hb6x\" (UniqueName: \"kubernetes.io/projected/f95ebfd9-d9ab-4600-8242-a9afb437e348-kube-api-access-2hb6x\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.461012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svrc\" (UniqueName: \"kubernetes.io/projected/d130ce3e-244a-4d88-94eb-6aca75770475-kube-api-access-2svrc\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.461028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-systemd\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.461042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-system-cni-dir\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.461073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-registration-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.461127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-kubelet\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.461229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-run\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.461309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-run-k8s-cni-cncf-io\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.461361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-var-lib-kubelet\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.461571    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.462458    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ded7f54-9992-4868-a3bf-2c64856f347b-multus-daemon-config\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.462531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-os-release\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.467066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.462541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-host-var-lib-cni-bin\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.462585    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-system-cni-dir\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.462590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-cnibin\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.462728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae6cee96-e6ab-4525-bbe9-572ef18332b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.462776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-cnibin\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.462817    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ded7f54-9992-4868-a3bf-2c64856f347b-hostroot\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.462872    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-host\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.461075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d130ce3e-244a-4d88-94eb-6aca75770475-etc-kubernetes\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.463166    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae6cee96-e6ab-4525-bbe9-572ef18332b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.463462    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae6cee96-e6ab-4525-bbe9-572ef18332b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.463536    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ded7f54-9992-4868-a3bf-2c64856f347b-cni-binary-copy\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.463556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ea80c06-4511-4577-851c-854825bd7eba-iptables-alerter-script\") pod \"iptables-alerter-g9j5p\" (UID: \"6ea80c06-4511-4577-851c-854825bd7eba\") " pod="openshift-network-operator/iptables-alerter-g9j5p"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.463932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d130ce3e-244a-4d88-94eb-6aca75770475-etc-tuned\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.463998    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d130ce3e-244a-4d88-94eb-6aca75770475-tmp\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.464250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f46f96e-e91d-40ba-aba5-6e2531cabc56-agent-certs\") pod \"konnectivity-agent-rjtvh\" (UID: \"7f46f96e-e91d-40ba-aba5-6e2531cabc56\") " pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.466029    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 21:51:37.467973 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.466045    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.466054    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2nsjz for pod openshift-network-diagnostics/network-check-target-w5jk7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.466114    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz podName:f621510a-a35d-492a-a989-9024c85c2964 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:37.966098666 +0000 UTC m=+2.000806209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2nsjz" (UniqueName: "kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz") pod "network-check-target-w5jk7" (UID: "f621510a-a35d-492a-a989-9024c85c2964") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.468543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rszj\" (UniqueName: \"kubernetes.io/projected/6ea80c06-4511-4577-851c-854825bd7eba-kube-api-access-4rszj\") pod \"iptables-alerter-g9j5p\" (UID: \"6ea80c06-4511-4577-851c-854825bd7eba\") " pod="openshift-network-operator/iptables-alerter-g9j5p"
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.468755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfrz4\" (UniqueName: \"kubernetes.io/projected/ae6cee96-e6ab-4525-bbe9-572ef18332b4-kube-api-access-qfrz4\") pod \"multus-additional-cni-plugins-fl7vn\" (UID: \"ae6cee96-e6ab-4525-bbe9-572ef18332b4\") " pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.468893    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4j8q\" (UniqueName: \"kubernetes.io/projected/e7af186d-aaae-47e9-8196-fb393bbc3bc7-kube-api-access-g4j8q\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.469074    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhks2\" (UniqueName: \"kubernetes.io/projected/0ded7f54-9992-4868-a3bf-2c64856f347b-kube-api-access-dhks2\") pod \"multus-zcjqr\" (UID: \"0ded7f54-9992-4868-a3bf-2c64856f347b\") " pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.469718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5swh\" (UniqueName: \"kubernetes.io/projected/a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4-kube-api-access-b5swh\") pod \"node-ca-5g6bl\" (UID: \"a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4\") " pod="openshift-image-registry/node-ca-5g6bl"
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.470880    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svrc\" (UniqueName: \"kubernetes.io/projected/d130ce3e-244a-4d88-94eb-6aca75770475-kube-api-access-2svrc\") pod \"tuned-ddx2c\" (UID: \"d130ce3e-244a-4d88-94eb-6aca75770475\") " pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.490588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ddx2c"
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.531159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5g6bl"
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-registration-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-kubelet\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-dbus\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:37.571009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-device-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-kubelet\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-registration-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-systemd-units\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-dbus\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-systemd-units\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f95ebfd9-d9ab-4600-8242-a9afb437e348-env-overrides\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561739    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-device-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f95ebfd9-d9ab-4600-8242-a9afb437e348-ovn-node-metrics-cert\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-log-socket\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.561849    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-socket-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.561894    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret podName:494f1e0c-becb-4576-87d6-c79ae2f4c8e0 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:38.061878598 +0000 UTC m=+2.096586117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret") pod "global-pull-secret-syncer-c56hs" (UID: "494f1e0c-becb-4576-87d6-c79ae2f4c8e0") : object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:37.572874 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-cni-bin\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-node-log\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-kubelet-config\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.561986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-slash\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562007    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fl7vn"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-run-openvswitch\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-etc-selinux\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-cni-netd\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-sys-fs\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562177    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-cni-bin\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562209    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-node-log\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-kubelet-config\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-slash\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-log-socket\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.575967 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-sys-fs\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3f1eeec-867b-4366-bfd9-0676e9f55877-hosts-file\") pod \"node-resolver-hfjw8\" (UID: \"e3f1eeec-867b-4366-bfd9-0676e9f55877\") " pod="openshift-dns/node-resolver-hfjw8"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-cni-netd\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3f1eeec-867b-4366-bfd9-0676e9f55877-tmp-dir\") pod \"node-resolver-hfjw8\" (UID: \"e3f1eeec-867b-4366-bfd9-0676e9f55877\") " pod="openshift-dns/node-resolver-hfjw8"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxk5f\" (UniqueName: \"kubernetes.io/projected/e3f1eeec-867b-4366-bfd9-0676e9f55877-kube-api-access-lxk5f\") pod \"node-resolver-hfjw8\" (UID: \"e3f1eeec-867b-4366-bfd9-0676e9f55877\") " pod="openshift-dns/node-resolver-hfjw8"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562426    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-etc-selinux\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-run-openvswitch\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-run-netns\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f95ebfd9-d9ab-4600-8242-a9afb437e348-env-overrides\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-run-netns\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-etc-openvswitch\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-run-ovn\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.576908 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-socket-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq6qb\" (UniqueName: \"kubernetes.io/projected/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-kube-api-access-gq6qb\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562817    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f95ebfd9-d9ab-4600-8242-a9afb437e348-ovnkube-script-lib\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562819    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-etc-openvswitch\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562824    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3f1eeec-867b-4366-bfd9-0676e9f55877-hosts-file\") pod \"node-resolver-hfjw8\" (UID: \"e3f1eeec-867b-4366-bfd9-0676e9f55877\") " pod="openshift-dns/node-resolver-hfjw8"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-run-systemd\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562858    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3f1eeec-867b-4366-bfd9-0676e9f55877-tmp-dir\") pod \"node-resolver-hfjw8\" (UID: \"e3f1eeec-867b-4366-bfd9-0676e9f55877\") " pod="openshift-dns/node-resolver-hfjw8"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-var-lib-openvswitch\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f95ebfd9-d9ab-4600-8242-a9afb437e348-ovnkube-config\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-run-systemd\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-run-ovn\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.580848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.562949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hb6x\" (UniqueName: \"kubernetes.io/projected/f95ebfd9-d9ab-4600-8242-a9afb437e348-kube-api-access-2hb6x\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.581999 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.563340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f95ebfd9-d9ab-4600-8242-a9afb437e348-var-lib-openvswitch\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.581999 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.563429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f95ebfd9-d9ab-4600-8242-a9afb437e348-ovnkube-script-lib\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.581999 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.563618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f95ebfd9-d9ab-4600-8242-a9afb437e348-ovnkube-config\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.581999 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.572874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zcjqr"
Jul 23 21:51:37.581999 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.573884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxk5f\" (UniqueName: \"kubernetes.io/projected/e3f1eeec-867b-4366-bfd9-0676e9f55877-kube-api-access-lxk5f\") pod \"node-resolver-hfjw8\" (UID: \"e3f1eeec-867b-4366-bfd9-0676e9f55877\") " pod="openshift-dns/node-resolver-hfjw8"
Jul 23 21:51:37.581999 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.575577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq6qb\" (UniqueName: \"kubernetes.io/projected/be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69-kube-api-access-gq6qb\") pod \"aws-ebs-csi-driver-node-wbv7j\" (UID: \"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.581999 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.575778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hb6x\" (UniqueName: \"kubernetes.io/projected/f95ebfd9-d9ab-4600-8242-a9afb437e348-kube-api-access-2hb6x\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.674274 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.625350    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f95ebfd9-d9ab-4600-8242-a9afb437e348-ovn-node-metrics-cert\") pod \"ovnkube-node-kdxmw\" (UID: \"f95ebfd9-d9ab-4600-8242-a9afb437e348\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.674274 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.643905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g9j5p"
Jul 23 21:51:37.674274 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:37.662979    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b58c88408815fc3e1d4ba8882fc500.slice/crio-a61b6f3eb1078d3339a806fc4157848411a8333682ea4e0a89fb42ef9084ebed WatchSource:0}: Error finding container a61b6f3eb1078d3339a806fc4157848411a8333682ea4e0a89fb42ef9084ebed: Status 404 returned error can't find the container with id a61b6f3eb1078d3339a806fc4157848411a8333682ea4e0a89fb42ef9084ebed
Jul 23 21:51:37.674274 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:37.664122    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea80c06_4511_4577_851c_854825bd7eba.slice/crio-449655dd1f236b051087b12a53dfd42d1ee78d1243788a5112a297ffd6be440e WatchSource:0}: Error finding container 449655dd1f236b051087b12a53dfd42d1ee78d1243788a5112a297ffd6be440e: Status 404 returned error can't find the container with id 449655dd1f236b051087b12a53dfd42d1ee78d1243788a5112a297ffd6be440e
Jul 23 21:51:37.674274 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.664556    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j"
Jul 23 21:51:37.674274 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.671254    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 21:51:37.678867 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:37.678684    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3f2d7d_ec2f_4fa5_aed5_3089c6b0eb69.slice/crio-1d0d6842f3b6e7a65e60080068c6a7132413624db453f3327cfae5f53a7e9720 WatchSource:0}: Error finding container 1d0d6842f3b6e7a65e60080068c6a7132413624db453f3327cfae5f53a7e9720: Status 404 returned error can't find the container with id 1d0d6842f3b6e7a65e60080068c6a7132413624db453f3327cfae5f53a7e9720
Jul 23 21:51:37.682722 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:37.679710    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b00daf35cdc991e4ab2a8e97ad8f2c.slice/crio-a5844e5cdfccb3f9b4f8a09c8322fb1907499a7ce59f36edbdd15e0179f83430 WatchSource:0}: Error finding container a5844e5cdfccb3f9b4f8a09c8322fb1907499a7ce59f36edbdd15e0179f83430: Status 404 returned error can't find the container with id a5844e5cdfccb3f9b4f8a09c8322fb1907499a7ce59f36edbdd15e0179f83430
Jul 23 21:51:37.757762 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.697337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hfjw8"
Jul 23 21:51:37.757762 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:37.707733    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f1eeec_867b_4366_bfd9_0676e9f55877.slice/crio-ecfe2cc4ec881e4f672dd3690e5ee9b60ec768c5a6a9d68390d9381256d2f9b7 WatchSource:0}: Error finding container ecfe2cc4ec881e4f672dd3690e5ee9b60ec768c5a6a9d68390d9381256d2f9b7: Status 404 returned error can't find the container with id ecfe2cc4ec881e4f672dd3690e5ee9b60ec768c5a6a9d68390d9381256d2f9b7
Jul 23 21:51:37.757762 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.718820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:51:37.757762 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.719024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:51:37.757762 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:37.744708    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f46f96e_e91d_40ba_aba5_6e2531cabc56.slice/crio-c2012d1322c526d5b6a9f274a2b333d5714e9976484e09036a5e6eaa3e352000 WatchSource:0}: Error finding container c2012d1322c526d5b6a9f274a2b333d5714e9976484e09036a5e6eaa3e352000: Status 404 returned error can't find the container with id c2012d1322c526d5b6a9f274a2b333d5714e9976484e09036a5e6eaa3e352000
Jul 23 21:51:37.757762 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:37.747747    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95ebfd9_d9ab_4600_8242_a9afb437e348.slice/crio-b8fe5dc6299cba42bfc88048840b8d579e0da9ed1494e8806d49fa166fee0e9f WatchSource:0}: Error finding container b8fe5dc6299cba42bfc88048840b8d579e0da9ed1494e8806d49fa166fee0e9f: Status 404 returned error can't find the container with id b8fe5dc6299cba42bfc88048840b8d579e0da9ed1494e8806d49fa166fee0e9f
Jul 23 21:51:37.860524 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:37.849534    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd130ce3e_244a_4d88_94eb_6aca75770475.slice/crio-1fcf1b6745c02f8707051815eb401034ba6ef5fa2d5df205bcb28b5d468a6cf3 WatchSource:0}: Error finding container 1fcf1b6745c02f8707051815eb401034ba6ef5fa2d5df205bcb28b5d468a6cf3: Status 404 returned error can't find the container with id 1fcf1b6745c02f8707051815eb401034ba6ef5fa2d5df205bcb28b5d468a6cf3
Jul 23 21:51:37.971893 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.971857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:37.971893 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:37.971900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nsjz\" (UniqueName: \"kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz\") pod \"network-check-target-w5jk7\" (UID: \"f621510a-a35d-492a-a989-9024c85c2964\") " pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:37.972148 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.972028    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 21:51:37.972148 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.972029    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:37.972148 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.972118    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs podName:e7af186d-aaae-47e9-8196-fb393bbc3bc7 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:38.972093924 +0000 UTC m=+3.006801465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs") pod "network-metrics-daemon-hphl7" (UID: "e7af186d-aaae-47e9-8196-fb393bbc3bc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:37.972148 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.972042    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 21:51:37.972148 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.972148    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2nsjz for pod openshift-network-diagnostics/network-check-target-w5jk7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:37.972516 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:37.972213    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz podName:f621510a-a35d-492a-a989-9024c85c2964 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:38.972197205 +0000 UTC m=+3.006904741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nsjz" (UniqueName: "kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz") pod "network-check-target-w5jk7" (UID: "f621510a-a35d-492a-a989-9024c85c2964") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:37.974459 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:37.974437    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda385c2fd_eb31_4b7b_bb8d_d8d0c42816b4.slice/crio-fef6e0ca106896fd4e71df6c5e1b098085f5c1b949ac27a7b4e51766f883ed0e WatchSource:0}: Error finding container fef6e0ca106896fd4e71df6c5e1b098085f5c1b949ac27a7b4e51766f883ed0e: Status 404 returned error can't find the container with id fef6e0ca106896fd4e71df6c5e1b098085f5c1b949ac27a7b4e51766f883ed0e
Jul 23 21:51:37.997664 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:37.997637    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ded7f54_9992_4868_a3bf_2c64856f347b.slice/crio-fb1ec39f90c4ac3b0911ccfe5cc47581f790ac0bfe0480926f7625bb48324a96 WatchSource:0}: Error finding container fb1ec39f90c4ac3b0911ccfe5cc47581f790ac0bfe0480926f7625bb48324a96: Status 404 returned error can't find the container with id fb1ec39f90c4ac3b0911ccfe5cc47581f790ac0bfe0480926f7625bb48324a96
Jul 23 21:51:38.057872 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:51:38.057834    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6cee96_e6ab_4525_bbe9_572ef18332b4.slice/crio-6e70be44ba8c2aee5fc6ccee6aa7162e140fc91405a862b04788c9b81ddb75d2 WatchSource:0}: Error finding container 6e70be44ba8c2aee5fc6ccee6aa7162e140fc91405a862b04788c9b81ddb75d2: Status 404 returned error can't find the container with id 6e70be44ba8c2aee5fc6ccee6aa7162e140fc91405a862b04788c9b81ddb75d2
Jul 23 21:51:38.073283 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.073235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:38.073423 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:38.073399    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:38.073489 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:38.073465    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret podName:494f1e0c-becb-4576-87d6-c79ae2f4c8e0 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:39.073445893 +0000 UTC m=+3.108153417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret") pod "global-pull-secret-syncer-c56hs" (UID: "494f1e0c-becb-4576-87d6-c79ae2f4c8e0") : object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:38.342348 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.342069    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 21:51:38.409642 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.409537    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 21:46:37 +0000 UTC" deadline="2028-03-13 18:22:29.524164348 +0000 UTC"
Jul 23 21:51:38.409642 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.409581    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14372h30m51.114587864s"
Jul 23 21:51:38.480116 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.479537    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:38.480116 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:38.479677    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:38.519062 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.518983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ddx2c" event={"ID":"d130ce3e-244a-4d88-94eb-6aca75770475","Type":"ContainerStarted","Data":"1fcf1b6745c02f8707051815eb401034ba6ef5fa2d5df205bcb28b5d468a6cf3"}
Jul 23 21:51:38.542849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.542804    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw" event={"ID":"f95ebfd9-d9ab-4600-8242-a9afb437e348","Type":"ContainerStarted","Data":"b8fe5dc6299cba42bfc88048840b8d579e0da9ed1494e8806d49fa166fee0e9f"}
Jul 23 21:51:38.554988 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.554875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j" event={"ID":"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69","Type":"ContainerStarted","Data":"1d0d6842f3b6e7a65e60080068c6a7132413624db453f3327cfae5f53a7e9720"}
Jul 23 21:51:38.560070 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.559985    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g9j5p" event={"ID":"6ea80c06-4511-4577-851c-854825bd7eba","Type":"ContainerStarted","Data":"449655dd1f236b051087b12a53dfd42d1ee78d1243788a5112a297ffd6be440e"}
Jul 23 21:51:38.564072 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.563871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zcjqr" event={"ID":"0ded7f54-9992-4868-a3bf-2c64856f347b","Type":"ContainerStarted","Data":"fb1ec39f90c4ac3b0911ccfe5cc47581f790ac0bfe0480926f7625bb48324a96"}
Jul 23 21:51:38.573105 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.573007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5g6bl" event={"ID":"a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4","Type":"ContainerStarted","Data":"fef6e0ca106896fd4e71df6c5e1b098085f5c1b949ac27a7b4e51766f883ed0e"}
Jul 23 21:51:38.594583 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.594416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rjtvh" event={"ID":"7f46f96e-e91d-40ba-aba5-6e2531cabc56","Type":"ContainerStarted","Data":"c2012d1322c526d5b6a9f274a2b333d5714e9976484e09036a5e6eaa3e352000"}
Jul 23 21:51:38.604177 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.604078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hfjw8" event={"ID":"e3f1eeec-867b-4366-bfd9-0676e9f55877","Type":"ContainerStarted","Data":"ecfe2cc4ec881e4f672dd3690e5ee9b60ec768c5a6a9d68390d9381256d2f9b7"}
Jul 23 21:51:38.609178 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.609142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-91.ec2.internal" event={"ID":"23b00daf35cdc991e4ab2a8e97ad8f2c","Type":"ContainerStarted","Data":"a5844e5cdfccb3f9b4f8a09c8322fb1907499a7ce59f36edbdd15e0179f83430"}
Jul 23 21:51:38.630421 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.630367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal" event={"ID":"e4b58c88408815fc3e1d4ba8882fc500","Type":"ContainerStarted","Data":"a61b6f3eb1078d3339a806fc4157848411a8333682ea4e0a89fb42ef9084ebed"}
Jul 23 21:51:38.655754 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.655702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl7vn" event={"ID":"ae6cee96-e6ab-4525-bbe9-572ef18332b4","Type":"ContainerStarted","Data":"6e70be44ba8c2aee5fc6ccee6aa7162e140fc91405a862b04788c9b81ddb75d2"}
Jul 23 21:51:38.982474 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.981442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nsjz\" (UniqueName: \"kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz\") pod \"network-check-target-w5jk7\" (UID: \"f621510a-a35d-492a-a989-9024c85c2964\") " pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:38.982474 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:38.981568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:38.982474 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:38.981697    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:38.982474 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:38.981762    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs podName:e7af186d-aaae-47e9-8196-fb393bbc3bc7 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:40.98174282 +0000 UTC m=+5.016450343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs") pod "network-metrics-daemon-hphl7" (UID: "e7af186d-aaae-47e9-8196-fb393bbc3bc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:38.982474 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:38.982198    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 21:51:38.982474 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:38.982218    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 21:51:38.982474 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:38.982233    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2nsjz for pod openshift-network-diagnostics/network-check-target-w5jk7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:38.982474 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:38.982279    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz podName:f621510a-a35d-492a-a989-9024c85c2964 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:40.982264113 +0000 UTC m=+5.016971640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nsjz" (UniqueName: "kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz") pod "network-check-target-w5jk7" (UID: "f621510a-a35d-492a-a989-9024c85c2964") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:39.083692 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:39.083651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:39.083904 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:39.083842    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:39.083981 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:39.083930    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret podName:494f1e0c-becb-4576-87d6-c79ae2f4c8e0 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:41.083908789 +0000 UTC m=+5.118616323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret") pod "global-pull-secret-syncer-c56hs" (UID: "494f1e0c-becb-4576-87d6-c79ae2f4c8e0") : object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:39.184102 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:39.184070    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 21:51:39.410558 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:39.410506    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 21:46:37 +0000 UTC" deadline="2028-04-08 13:39:06.56732659 +0000 UTC"
Jul 23 21:51:39.410558 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:39.410561    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14991h47m27.156772118s"
Jul 23 21:51:39.476611 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:39.476578    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:39.476784 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:39.476719    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:39.477640 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:39.477454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:39.477640 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:39.477580    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:40.479284 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:40.479246    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:40.479806 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:40.479416    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:41.000634 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:41.000587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:41.000820 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:41.000660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nsjz\" (UniqueName: \"kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz\") pod \"network-check-target-w5jk7\" (UID: \"f621510a-a35d-492a-a989-9024c85c2964\") " pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:41.000901 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:41.000832    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 21:51:41.000901 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:41.000850    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 21:51:41.000901 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:41.000861    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2nsjz for pod openshift-network-diagnostics/network-check-target-w5jk7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:41.001072 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:41.000911    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz podName:f621510a-a35d-492a-a989-9024c85c2964 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:45.000896195 +0000 UTC m=+9.035603727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nsjz" (UniqueName: "kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz") pod "network-check-target-w5jk7" (UID: "f621510a-a35d-492a-a989-9024c85c2964") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:41.001267 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:41.001246    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:41.001364 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:41.001317    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs podName:e7af186d-aaae-47e9-8196-fb393bbc3bc7 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:45.001284304 +0000 UTC m=+9.035991836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs") pod "network-metrics-daemon-hphl7" (UID: "e7af186d-aaae-47e9-8196-fb393bbc3bc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:41.101669 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:41.101630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:41.101869 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:41.101849    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:41.101934 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:41.101916    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret podName:494f1e0c-becb-4576-87d6-c79ae2f4c8e0 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:45.101894601 +0000 UTC m=+9.136602126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret") pod "global-pull-secret-syncer-c56hs" (UID: "494f1e0c-becb-4576-87d6-c79ae2f4c8e0") : object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:41.476740 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:41.476707    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:41.476888 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:41.476845    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:41.477264 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:41.477244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:41.477386 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:41.477365    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:42.477350 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:42.477312    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:42.477936 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:42.477450    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:43.476838 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:43.476804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:43.477019 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:43.476958    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:43.477443 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:43.477417    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:43.477854 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:43.477526    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:44.477770 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:44.477306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:44.477770 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:44.477426    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:45.038205 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:45.037577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:45.038205 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:45.037634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nsjz\" (UniqueName: \"kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz\") pod \"network-check-target-w5jk7\" (UID: \"f621510a-a35d-492a-a989-9024c85c2964\") " pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:45.038205 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:45.037794    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 21:51:45.038205 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:45.037811    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 21:51:45.038205 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:45.037825    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2nsjz for pod openshift-network-diagnostics/network-check-target-w5jk7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:45.038205 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:45.037881    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz podName:f621510a-a35d-492a-a989-9024c85c2964 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:53.037861684 +0000 UTC m=+17.072569209 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nsjz" (UniqueName: "kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz") pod "network-check-target-w5jk7" (UID: "f621510a-a35d-492a-a989-9024c85c2964") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:45.038666 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:45.038280    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:45.038666 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:45.038343    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs podName:e7af186d-aaae-47e9-8196-fb393bbc3bc7 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:53.038326251 +0000 UTC m=+17.073033785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs") pod "network-metrics-daemon-hphl7" (UID: "e7af186d-aaae-47e9-8196-fb393bbc3bc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:45.138958 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:45.138916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:45.139131 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:45.139089    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:45.139204 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:45.139151    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret podName:494f1e0c-becb-4576-87d6-c79ae2f4c8e0 nodeName:}" failed. No retries permitted until 2026-07-23 21:51:53.139132132 +0000 UTC m=+17.173839664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret") pod "global-pull-secret-syncer-c56hs" (UID: "494f1e0c-becb-4576-87d6-c79ae2f4c8e0") : object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:45.476777 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:45.476696    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:45.476936 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:45.476833    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:45.477011 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:45.476953    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:45.477102 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:45.477079    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:46.477322 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:46.477277    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:46.477808 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:46.477398    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:47.475993 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:47.475957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:47.476182 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:47.476072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:47.476280 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:47.476172    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:47.476280 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:47.476230    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:48.476924 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:48.476893    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:48.477394 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:48.477008    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:49.476615 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:49.476578    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:49.476804 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:49.476616    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:49.476804 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:49.476709    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:49.476923 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:49.476808    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:50.476716 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:50.476678    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:50.477184 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:50.476806    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:51.476408 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:51.476367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:51.476574 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:51.476509    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:51.476574 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:51.476541    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:51.476687 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:51.476605    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:52.476696 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:52.476657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:52.477153 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:52.476802    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:53.098060 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:53.098018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:53.098281 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:53.098070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nsjz\" (UniqueName: \"kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz\") pod \"network-check-target-w5jk7\" (UID: \"f621510a-a35d-492a-a989-9024c85c2964\") " pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:53.098281 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:53.098192    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 21:51:53.098281 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:53.098193    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:53.098460 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:53.098287    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs podName:e7af186d-aaae-47e9-8196-fb393bbc3bc7 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:09.098265804 +0000 UTC m=+33.132973334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs") pod "network-metrics-daemon-hphl7" (UID: "e7af186d-aaae-47e9-8196-fb393bbc3bc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:51:53.098460 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:53.098209    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 21:51:53.098460 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:53.098331    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2nsjz for pod openshift-network-diagnostics/network-check-target-w5jk7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:53.098460 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:53.098386    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz podName:f621510a-a35d-492a-a989-9024c85c2964 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:09.098370975 +0000 UTC m=+33.133078515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nsjz" (UniqueName: "kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz") pod "network-check-target-w5jk7" (UID: "f621510a-a35d-492a-a989-9024c85c2964") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:51:53.199061 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:53.199012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:53.199296 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:53.199146    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:53.199296 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:53.199208    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret podName:494f1e0c-becb-4576-87d6-c79ae2f4c8e0 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:09.19919061 +0000 UTC m=+33.233898129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret") pod "global-pull-secret-syncer-c56hs" (UID: "494f1e0c-becb-4576-87d6-c79ae2f4c8e0") : object "kube-system"/"original-pull-secret" not registered
Jul 23 21:51:53.476709 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:53.476627    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:53.476709 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:53.476657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:53.477189 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:53.476757    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:53.477189 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:53.476853    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:54.476426 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:54.476393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:54.476675 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:54.476523    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:55.476613 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:55.476578    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:55.477085 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:55.476594    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:55.477085 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:55.476712    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:55.477085 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:55.476791    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:56.476945 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:56.476908    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:56.477386 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:56.477011    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:57.476012 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:57.475920    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:57.476012 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:57.475922    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:57.476286 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:57.476039    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:57.476286 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:57.476129    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:58.476828 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:58.476797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:51:58.477258 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:58.476932    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:51:58.719895 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:58.719860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ddx2c" event={"ID":"d130ce3e-244a-4d88-94eb-6aca75770475","Type":"ContainerStarted","Data":"f12472093a15b3570fb9be0975457ad5644193b8de5136bfac75fab34d604c61"}
Jul 23 21:51:58.721884 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:58.721860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw" event={"ID":"f95ebfd9-d9ab-4600-8242-a9afb437e348","Type":"ContainerStarted","Data":"b09ae9afe38307c06b98530e98b804d60962a0e840bd90d613bf04369408d83c"}
Jul 23 21:51:58.723570 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:58.723547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zcjqr" event={"ID":"0ded7f54-9992-4868-a3bf-2c64856f347b","Type":"ContainerStarted","Data":"32434dbdc23ead0059a6be07d6230ecf57b6774b707e7ccb7a7b67aa41455eff"}
Jul 23 21:51:58.725079 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:58.725057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-91.ec2.internal" event={"ID":"23b00daf35cdc991e4ab2a8e97ad8f2c","Type":"ContainerStarted","Data":"a834434095b18460b51fcc2ebd2888c9f0ada50b3e4555630a65a5dc2cbd9db2"}
Jul 23 21:51:58.740464 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:58.740402    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ddx2c" podStartSLOduration=2.460998467 podStartE2EDuration="22.740382681s" totalImagesPullingTime="20.279384214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:51:58.737059612 +0000 UTC m=+22.771767163" watchObservedRunningTime="2026-07-23 21:51:58.740382681 +0000 UTC m=+22.775090220"
Jul 23 21:51:58.753279 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:58.753238    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-91.ec2.internal" podStartSLOduration=21.753209392 podStartE2EDuration="21.753209392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:51:58.752876954 +0000 UTC m=+22.787584494" watchObservedRunningTime="2026-07-23 21:51:58.753209392 +0000 UTC m=+22.787916931"
Jul 23 21:51:59.476806 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.476570    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:51:59.476987 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.476601    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:51:59.476987 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:59.476876    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:51:59.476987 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:51:59.476964    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:51:59.728554 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.728468    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5g6bl" event={"ID":"a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4","Type":"ContainerStarted","Data":"3830ef99dd5e8251e496c7675505c0ba56731f4a1fd647516fb49cf2a6507b20"}
Jul 23 21:51:59.730075 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.730018    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rjtvh" event={"ID":"7f46f96e-e91d-40ba-aba5-6e2531cabc56","Type":"ContainerStarted","Data":"1bd6a8996c047321ec21bd320bc955de6ff449287477ee51bbca000cd33eb650"}
Jul 23 21:51:59.731737 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.731606    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hfjw8" event={"ID":"e3f1eeec-867b-4366-bfd9-0676e9f55877","Type":"ContainerStarted","Data":"63b9ea56044d716be0e3c22a9bf9b0f622d2ab70a62f6ce5492f924c8186385b"}
Jul 23 21:51:59.733231 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.733181    2565 generic.go:356] "Generic (PLEG): container finished" podID="e4b58c88408815fc3e1d4ba8882fc500" containerID="a9e7c369d9e9c188eba3a1886c93a353497f1ffe26e65b9675be2eb8d9d5369d" exitCode=0
Jul 23 21:51:59.733362 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.733288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal" event={"ID":"e4b58c88408815fc3e1d4ba8882fc500","Type":"ContainerDied","Data":"a9e7c369d9e9c188eba3a1886c93a353497f1ffe26e65b9675be2eb8d9d5369d"}
Jul 23 21:51:59.734945 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.734925    2565 generic.go:356] "Generic (PLEG): container finished" podID="ae6cee96-e6ab-4525-bbe9-572ef18332b4" containerID="d88fe3dc5c2defe97e2e7a058081b60ab0b0809dac130a8dba0579ffd318dd59" exitCode=0
Jul 23 21:51:59.735035 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.734983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl7vn" event={"ID":"ae6cee96-e6ab-4525-bbe9-572ef18332b4","Type":"ContainerDied","Data":"d88fe3dc5c2defe97e2e7a058081b60ab0b0809dac130a8dba0579ffd318dd59"}
Jul 23 21:51:59.738619 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.738599    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 21:51:59.739053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.739033    2565 generic.go:356] "Generic (PLEG): container finished" podID="f95ebfd9-d9ab-4600-8242-a9afb437e348" containerID="9037a73f1bf5ff52b1ec34a9c92293736edc1a1b3aa420d969e3f910eb992f97" exitCode=1
Jul 23 21:51:59.739134 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.739102    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw" event={"ID":"f95ebfd9-d9ab-4600-8242-a9afb437e348","Type":"ContainerStarted","Data":"6c0080d492b721f3944120218d1bbeab0cedd898c43bad6892298c9efc1ea09a"}
Jul 23 21:51:59.739196 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.739161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw" event={"ID":"f95ebfd9-d9ab-4600-8242-a9afb437e348","Type":"ContainerStarted","Data":"80bf1681ba650eec7bf2e833f48a8dbc34b35023a18048c16634dde52740c287"}
Jul 23 21:51:59.739275 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.739224    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw" event={"ID":"f95ebfd9-d9ab-4600-8242-a9afb437e348","Type":"ContainerStarted","Data":"8ed9928ba6ffaa2f0c4c13b7f78e968253c68c390df7b287b1d05202b1504d09"}
Jul 23 21:51:59.739331 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.739277    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw" event={"ID":"f95ebfd9-d9ab-4600-8242-a9afb437e348","Type":"ContainerStarted","Data":"d113c7b6bbc2deecfad123167d5172e68b84d0a32f305032b7363beb3e4c8235"}
Jul 23 21:51:59.739331 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.739322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw" event={"ID":"f95ebfd9-d9ab-4600-8242-a9afb437e348","Type":"ContainerDied","Data":"9037a73f1bf5ff52b1ec34a9c92293736edc1a1b3aa420d969e3f910eb992f97"}
Jul 23 21:51:59.740764 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.740744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j" event={"ID":"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69","Type":"ContainerStarted","Data":"edb923cc1f3c6fb2ed75a85193da62db253865735acfd130122d5affaa9e499c"}
Jul 23 21:51:59.742467 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.742445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g9j5p" event={"ID":"6ea80c06-4511-4577-851c-854825bd7eba","Type":"ContainerStarted","Data":"559aae04f3603fcf78ed92d6a2f19603480264f6d13aee2a504d5a4a5f151a81"}
Jul 23 21:51:59.744480 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.744424    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5g6bl" podStartSLOduration=3.506330055 podStartE2EDuration="23.744408494s" totalImagesPullingTime="20.238078439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:51:59.743970166 +0000 UTC m=+23.778677707" watchObservedRunningTime="2026-07-23 21:51:59.744408494 +0000 UTC m=+23.779116035"
Jul 23 21:51:59.744706 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.744671    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zcjqr" podStartSLOduration=3.5196516620000002 podStartE2EDuration="23.744660636s" totalImagesPullingTime="20.225008974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:51:58.770376559 +0000 UTC m=+22.805084124" watchObservedRunningTime="2026-07-23 21:51:59.744660636 +0000 UTC m=+23.779368179"
Jul 23 21:51:59.762770 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.762716    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hfjw8" podStartSLOduration=3.341234531 podStartE2EDuration="23.762702605s" totalImagesPullingTime="20.421468074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:51:59.76243366 +0000 UTC m=+23.797141198" watchObservedRunningTime="2026-07-23 21:51:59.762702605 +0000 UTC m=+23.797410143"
Jul 23 21:51:59.814852 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.814806    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g9j5p" podStartSLOduration=3.267523507 podStartE2EDuration="23.814791753s" totalImagesPullingTime="20.547268246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:51:59.814708817 +0000 UTC m=+23.849416356" watchObservedRunningTime="2026-07-23 21:51:59.814791753 +0000 UTC m=+23.849499293"
Jul 23 21:51:59.828063 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.828021    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rjtvh" podStartSLOduration=3.362515321 podStartE2EDuration="23.828007522s" totalImagesPullingTime="20.465492201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:51:59.827814808 +0000 UTC m=+23.862522348" watchObservedRunningTime="2026-07-23 21:51:59.828007522 +0000 UTC m=+23.862715061"
Jul 23 21:51:59.988944 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.988881    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:51:59.989577 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:51:59.989555    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:52:00.212764 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:00.212739    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 21:52:00.419111 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:00.419006    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T21:52:00.212756492Z","UUID":"ef45e969-f530-48f2-b737-63af88e521d8","Handler":null,"Name":"","Endpoint":""}
Jul 23 21:52:00.420731 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:00.420709    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 21:52:00.420858 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:00.420746    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 21:52:00.476544 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:00.476498    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:00.476722 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:00.476636    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:52:00.747848 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:00.747404    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal" event={"ID":"e4b58c88408815fc3e1d4ba8882fc500","Type":"ContainerStarted","Data":"7cbf28c2140ceff0b9f5899ff4fb6c2431ee0980be29930ab323e13e8a2625dd"}
Jul 23 21:52:00.749712 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:00.749683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j" event={"ID":"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69","Type":"ContainerStarted","Data":"990836f0b6878bd2df2081da6b280c1665a814b7eb7235196fc5de7fc5b6631c"}
Jul 23 21:52:00.750078 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:00.750048    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:52:00.750665 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:00.750644    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rjtvh"
Jul 23 21:52:00.779524 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:00.779466    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-91.ec2.internal" podStartSLOduration=23.779446128 podStartE2EDuration="23.779446128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:00.763455286 +0000 UTC m=+24.798162823" watchObservedRunningTime="2026-07-23 21:52:00.779446128 +0000 UTC m=+24.814153667"
Jul 23 21:52:01.476065 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:01.476036    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:52:01.476194 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:01.476170    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:52:01.476301 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:01.476281    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:52:01.476418 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:01.476397    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:52:01.756021 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:01.755872    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 21:52:01.756452 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:01.756305    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw" event={"ID":"f95ebfd9-d9ab-4600-8242-a9afb437e348","Type":"ContainerStarted","Data":"795f2b0f5405c93ea2279e71d387173f99bdb7b1c085416b06e5c6152a6015a8"}
Jul 23 21:52:01.758562 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:01.758530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j" event={"ID":"be3f2d7d-ec2f-4fa5-aed5-3089c6b0eb69","Type":"ContainerStarted","Data":"d75cd4236b725f41ed7515ba1c32156ba8937e4486313d1d5ef45153cac77d76"}
Jul 23 21:52:02.476082 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:02.476038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:02.476308 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:02.476179    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:52:03.475866 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:03.475836    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:52:03.476331 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:03.475951    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:52:03.476331 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:03.476003    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:52:03.476331 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:03.476117    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:52:04.476708 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:04.476457    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:04.477153 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:04.476811    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:52:04.766863 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:04.766780    2565 generic.go:356] "Generic (PLEG): container finished" podID="ae6cee96-e6ab-4525-bbe9-572ef18332b4" containerID="d53b5680e994825d82ae0427fcbde33ebf09c5633f7d59f23608f86edb1ac090" exitCode=0
Jul 23 21:52:04.767017 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:04.766874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl7vn" event={"ID":"ae6cee96-e6ab-4525-bbe9-572ef18332b4","Type":"ContainerDied","Data":"d53b5680e994825d82ae0427fcbde33ebf09c5633f7d59f23608f86edb1ac090"}
Jul 23 21:52:04.770530 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:04.770505    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 21:52:04.770856 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:04.770829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw" event={"ID":"f95ebfd9-d9ab-4600-8242-a9afb437e348","Type":"ContainerStarted","Data":"b012500c14466688c9b49b4fd0652c7c2f98b7ae8ef73a9d5c533a796f8962fa"}
Jul 23 21:52:04.771123 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:04.771104    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:52:04.771231 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:04.771153    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:52:04.771307 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:04.771289    2565 scope.go:117] "RemoveContainer" containerID="9037a73f1bf5ff52b1ec34a9c92293736edc1a1b3aa420d969e3f910eb992f97"
Jul 23 21:52:04.787106 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:04.787088    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:52:04.792894 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:04.792845    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbv7j" podStartSLOduration=6.112092999 podStartE2EDuration="28.792827896s" totalImagesPullingTime="22.680734897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:01.780382952 +0000 UTC m=+25.815090504" watchObservedRunningTime="2026-07-23 21:52:04.792827896 +0000 UTC m=+28.827535439"
Jul 23 21:52:05.476481 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.476449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:52:05.476708 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:05.476590    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:52:05.477051 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.477032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:52:05.477583 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:05.477152    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:52:05.748468 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.748188    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c56hs"]
Jul 23 21:52:05.751792 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.751764    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w5jk7"]
Jul 23 21:52:05.751951 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.751861    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:05.752023 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:05.751945    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:52:05.752363 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.752338    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hphl7"]
Jul 23 21:52:05.780629 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.780609    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 21:52:05.781066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.780971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw" event={"ID":"f95ebfd9-d9ab-4600-8242-a9afb437e348","Type":"ContainerStarted","Data":"ca7e0594ce9f6d076479b94737269e73128cee540ba4c102000c077d2e4a7afe"}
Jul 23 21:52:05.781066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.781006    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:52:05.781066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.781018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:52:05.781370 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:05.781122    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:52:05.781370 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.781210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:52:05.781573 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:05.781541    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:52:05.800709 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.800681    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:52:05.809775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:05.809716    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw" podStartSLOduration=9.009753293 podStartE2EDuration="29.809697635s" totalImagesPullingTime="20.799944342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:05.808441577 +0000 UTC m=+29.843149118" watchObservedRunningTime="2026-07-23 21:52:05.809697635 +0000 UTC m=+29.844405177"
Jul 23 21:52:06.784817 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:06.784785    2565 generic.go:356] "Generic (PLEG): container finished" podID="ae6cee96-e6ab-4525-bbe9-572ef18332b4" containerID="27edadaa8e0f04d5b2bd45bb17c7bc08be57d1ce529d8f0c4a73d1a20d78e990" exitCode=0
Jul 23 21:52:06.785304 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:06.784873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl7vn" event={"ID":"ae6cee96-e6ab-4525-bbe9-572ef18332b4","Type":"ContainerDied","Data":"27edadaa8e0f04d5b2bd45bb17c7bc08be57d1ce529d8f0c4a73d1a20d78e990"}
Jul 23 21:52:07.476187 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:07.476152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:07.476361 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:07.476190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:52:07.476361 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:07.476262    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:52:07.476361 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:07.476189    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:52:07.476361 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:07.476311    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:52:07.476514 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:07.476366    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:52:08.776001 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:08.775972    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hfjw8_e3f1eeec-867b-4366-bfd9-0676e9f55877/dns-node-resolver/0.log"
Jul 23 21:52:08.790906 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:08.790880    2565 generic.go:356] "Generic (PLEG): container finished" podID="ae6cee96-e6ab-4525-bbe9-572ef18332b4" containerID="dac187316d1ddab020fd17858b3c47be9b91cc0d86ad20767dd8345778ba62b5" exitCode=0
Jul 23 21:52:08.791038 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:08.790938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl7vn" event={"ID":"ae6cee96-e6ab-4525-bbe9-572ef18332b4","Type":"ContainerDied","Data":"dac187316d1ddab020fd17858b3c47be9b91cc0d86ad20767dd8345778ba62b5"}
Jul 23 21:52:09.107035 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:09.106953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:52:09.107035 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:09.106989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nsjz\" (UniqueName: \"kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz\") pod \"network-check-target-w5jk7\" (UID: \"f621510a-a35d-492a-a989-9024c85c2964\") " pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:09.107269 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:09.107113    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 21:52:09.107269 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:09.107118    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:52:09.107269 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:09.107135    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 21:52:09.107269 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:09.107150    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2nsjz for pod openshift-network-diagnostics/network-check-target-w5jk7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:52:09.107269 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:09.107196    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs podName:e7af186d-aaae-47e9-8196-fb393bbc3bc7 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:41.107174482 +0000 UTC m=+65.141882021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs") pod "network-metrics-daemon-hphl7" (UID: "e7af186d-aaae-47e9-8196-fb393bbc3bc7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 21:52:09.107269 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:09.107234    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz podName:f621510a-a35d-492a-a989-9024c85c2964 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:41.107208337 +0000 UTC m=+65.141915858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2nsjz" (UniqueName: "kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz") pod "network-check-target-w5jk7" (UID: "f621510a-a35d-492a-a989-9024c85c2964") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 21:52:09.207862 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:09.207827    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:52:09.208017 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:09.207967    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 21:52:09.208073 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:09.208023    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret podName:494f1e0c-becb-4576-87d6-c79ae2f4c8e0 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:41.20800947 +0000 UTC m=+65.242716987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret") pod "global-pull-secret-syncer-c56hs" (UID: "494f1e0c-becb-4576-87d6-c79ae2f4c8e0") : object "kube-system"/"original-pull-secret" not registered
Jul 23 21:52:09.475911 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:09.475835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:52:09.476078 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:09.475838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:09.476078 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:09.475966    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c56hs" podUID="494f1e0c-becb-4576-87d6-c79ae2f4c8e0"
Jul 23 21:52:09.476165 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:09.476069    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w5jk7" podUID="f621510a-a35d-492a-a989-9024c85c2964"
Jul 23 21:52:09.476165 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:09.475838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:52:09.476287 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:09.476185    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hphl7" podUID="e7af186d-aaae-47e9-8196-fb393bbc3bc7"
Jul 23 21:52:09.548435 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:09.548406    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5g6bl_a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4/node-ca/0.log"
Jul 23 21:52:11.301772 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.301738    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-91.ec2.internal" event="NodeReady"
Jul 23 21:52:11.302187 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.301885    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 21:52:11.345157 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.345123    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b7d875c7f-nrsnb"]
Jul 23 21:52:11.375510 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.375478    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ldwf6"]
Jul 23 21:52:11.376514 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.376135    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.378464 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.378446    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mc9c7"]
Jul 23 21:52:11.378594 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.378550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.379559 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.379541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 21:52:11.379747 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.379717    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rdwr9\""
Jul 23 21:52:11.380083 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.380061    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b7d875c7f-nrsnb"]
Jul 23 21:52:11.380159 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.380100    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ldwf6"]
Jul 23 21:52:11.380159 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.380116    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 21:52:11.380159 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.380127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mc9c7"]
Jul 23 21:52:11.380329 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.380202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mc9c7"
Jul 23 21:52:11.380416 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.380399    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 21:52:11.381819 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.381796    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b7bnz\""
Jul 23 21:52:11.381913 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.381894    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 21:52:11.381977 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.381916    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 21:52:11.385805 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.385609    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 21:52:11.385805 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.385683    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 21:52:11.385920 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.385879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 21:52:11.386229 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.386192    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qfzdd\""
Jul 23 21:52:11.386553 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.386536    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x9hdj"]
Jul 23 21:52:11.390292 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.388883    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.391263 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.391240    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 21:52:11.393108 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.393086    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 21:52:11.393286 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.393268    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 21:52:11.393361 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.393340    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jpf7h\""
Jul 23 21:52:11.393608 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.393586    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 21:52:11.393753 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.393682    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 21:52:11.405429 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.405405    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x9hdj"]
Jul 23 21:52:11.476028 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.475990    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:52:11.476028 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.476022    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:52:11.476283 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.476025    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:11.478958 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.478932    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 21:52:11.479100 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.478941    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 21:52:11.479100 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.479083    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jd2p5\""
Jul 23 21:52:11.479463 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.479442    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sc2x2\""
Jul 23 21:52:11.479584 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.479506    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 21:52:11.479584 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.479573    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 21:52:11.525700 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.525665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w725x\" (UniqueName: \"kubernetes.io/projected/743f6aa9-b1d3-42de-8019-2905221ebbf5-kube-api-access-w725x\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.525881 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.525710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rjlw\" (UniqueName: \"kubernetes.io/projected/7a40c75d-40c3-4247-a2a1-ee4ee39b84bc-kube-api-access-5rjlw\") pod \"ingress-canary-mc9c7\" (UID: \"7a40c75d-40c3-4247-a2a1-ee4ee39b84bc\") " pod="openshift-ingress-canary/ingress-canary-mc9c7"
Jul 23 21:52:11.525881 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.525735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-certificates\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.525881 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.525756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26a3edf1-777d-4953-a47c-88670d366937-config-volume\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.525881 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.525832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv6v7\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-kube-api-access-vv6v7\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.525881 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.525872    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/743f6aa9-b1d3-42de-8019-2905221ebbf5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.526109 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.525906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a3edf1-777d-4953-a47c-88670d366937-tmp-dir\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.526109 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.525950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/743f6aa9-b1d3-42de-8019-2905221ebbf5-data-volume\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.526109 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.526004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.526109 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.526053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.526109 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.526094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-installation-pull-secrets\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.526360 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.526145    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.526360 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.526187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzcjn\" (UniqueName: \"kubernetes.io/projected/26a3edf1-777d-4953-a47c-88670d366937-kube-api-access-tzcjn\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.526360 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.526227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-trusted-ca\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.526360 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.526250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a40c75d-40c3-4247-a2a1-ee4ee39b84bc-cert\") pod \"ingress-canary-mc9c7\" (UID: \"7a40c75d-40c3-4247-a2a1-ee4ee39b84bc\") " pod="openshift-ingress-canary/ingress-canary-mc9c7"
Jul 23 21:52:11.526360 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.526293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/578f4b1c-488c-4785-aec7-7d78ede6e712-ca-trust-extracted\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.526360 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.526328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-image-registry-private-configuration\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.526360 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.526352    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-bound-sa-token\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.526693 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.526381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/743f6aa9-b1d3-42de-8019-2905221ebbf5-crio-socket\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.627755 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.627676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.627755 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.627716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.627755 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.627735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-installation-pull-secrets\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.627755 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.627754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.628093 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.627775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzcjn\" (UniqueName: \"kubernetes.io/projected/26a3edf1-777d-4953-a47c-88670d366937-kube-api-access-tzcjn\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.628093 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.627792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-trusted-ca\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.628093 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.627805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a40c75d-40c3-4247-a2a1-ee4ee39b84bc-cert\") pod \"ingress-canary-mc9c7\" (UID: \"7a40c75d-40c3-4247-a2a1-ee4ee39b84bc\") " pod="openshift-ingress-canary/ingress-canary-mc9c7"
Jul 23 21:52:11.628093 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.627845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/578f4b1c-488c-4785-aec7-7d78ede6e712-ca-trust-extracted\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.628093 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:11.627847    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 21:52:11.628093 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:11.627923    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls podName:26a3edf1-777d-4953-a47c-88670d366937 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:12.127902865 +0000 UTC m=+36.162610394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls") pod "dns-default-ldwf6" (UID: "26a3edf1-777d-4953-a47c-88670d366937") : secret "dns-default-metrics-tls" not found
Jul 23 21:52:11.628093 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:11.627855    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 21:52:11.628093 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:11.627993    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7d875c7f-nrsnb: secret "image-registry-tls" not found
Jul 23 21:52:11.628093 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:11.628070    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls podName:578f4b1c-488c-4785-aec7-7d78ede6e712 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:12.1280496 +0000 UTC m=+36.162757137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls") pod "image-registry-5b7d875c7f-nrsnb" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712") : secret "image-registry-tls" not found
Jul 23 21:52:11.628512 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:11.628168    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 21:52:11.628512 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:11.628209    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls podName:743f6aa9-b1d3-42de-8019-2905221ebbf5 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:12.128195654 +0000 UTC m=+36.162903197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9hdj" (UID: "743f6aa9-b1d3-42de-8019-2905221ebbf5") : secret "insights-runtime-extractor-tls" not found
Jul 23 21:52:11.628512 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/578f4b1c-488c-4785-aec7-7d78ede6e712-ca-trust-extracted\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.628512 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-image-registry-private-configuration\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.628512 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-bound-sa-token\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.628512 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/743f6aa9-b1d3-42de-8019-2905221ebbf5-crio-socket\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.628788 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628525    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/743f6aa9-b1d3-42de-8019-2905221ebbf5-crio-socket\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.628788 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w725x\" (UniqueName: \"kubernetes.io/projected/743f6aa9-b1d3-42de-8019-2905221ebbf5-kube-api-access-w725x\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.628788 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rjlw\" (UniqueName: \"kubernetes.io/projected/7a40c75d-40c3-4247-a2a1-ee4ee39b84bc-kube-api-access-5rjlw\") pod \"ingress-canary-mc9c7\" (UID: \"7a40c75d-40c3-4247-a2a1-ee4ee39b84bc\") " pod="openshift-ingress-canary/ingress-canary-mc9c7"
Jul 23 21:52:11.628788 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-certificates\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.628788 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26a3edf1-777d-4953-a47c-88670d366937-config-volume\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.628788 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv6v7\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-kube-api-access-vv6v7\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.628788 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/743f6aa9-b1d3-42de-8019-2905221ebbf5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.628788 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a3edf1-777d-4953-a47c-88670d366937-tmp-dir\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.628788 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.628749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/743f6aa9-b1d3-42de-8019-2905221ebbf5-data-volume\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.629238 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.629075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/743f6aa9-b1d3-42de-8019-2905221ebbf5-data-volume\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.629238 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.629079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-trusted-ca\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.629469 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.629444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a3edf1-777d-4953-a47c-88670d366937-tmp-dir\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.629693 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.629650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-certificates\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.629778 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.629700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/743f6aa9-b1d3-42de-8019-2905221ebbf5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.629778 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.629746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26a3edf1-777d-4953-a47c-88670d366937-config-volume\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.632768 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.632641    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-installation-pull-secrets\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.632860 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.632750    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-image-registry-private-configuration\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.632860 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.632781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a40c75d-40c3-4247-a2a1-ee4ee39b84bc-cert\") pod \"ingress-canary-mc9c7\" (UID: \"7a40c75d-40c3-4247-a2a1-ee4ee39b84bc\") " pod="openshift-ingress-canary/ingress-canary-mc9c7"
Jul 23 21:52:11.638148 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.638128    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzcjn\" (UniqueName: \"kubernetes.io/projected/26a3edf1-777d-4953-a47c-88670d366937-kube-api-access-tzcjn\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:11.638936 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.638891    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv6v7\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-kube-api-access-vv6v7\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.639667 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.639392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-bound-sa-token\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:11.639930 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.639904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rjlw\" (UniqueName: \"kubernetes.io/projected/7a40c75d-40c3-4247-a2a1-ee4ee39b84bc-kube-api-access-5rjlw\") pod \"ingress-canary-mc9c7\" (UID: \"7a40c75d-40c3-4247-a2a1-ee4ee39b84bc\") " pod="openshift-ingress-canary/ingress-canary-mc9c7"
Jul 23 21:52:11.640115 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.640095    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w725x\" (UniqueName: \"kubernetes.io/projected/743f6aa9-b1d3-42de-8019-2905221ebbf5-kube-api-access-w725x\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:11.708602 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:11.708566    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mc9c7"
Jul 23 21:52:12.132555 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:12.132517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:12.132555 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:12.132562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:12.132816 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:12.132581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:12.132816 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:12.132673    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 21:52:12.132816 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:12.132678    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 21:52:12.132816 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:12.132701    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7d875c7f-nrsnb: secret "image-registry-tls" not found
Jul 23 21:52:12.132816 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:12.132735    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls podName:26a3edf1-777d-4953-a47c-88670d366937 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:13.132720651 +0000 UTC m=+37.167428184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls") pod "dns-default-ldwf6" (UID: "26a3edf1-777d-4953-a47c-88670d366937") : secret "dns-default-metrics-tls" not found
Jul 23 21:52:12.132816 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:12.132674    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 21:52:12.132816 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:12.132751    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls podName:578f4b1c-488c-4785-aec7-7d78ede6e712 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:13.13274265 +0000 UTC m=+37.167450167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls") pod "image-registry-5b7d875c7f-nrsnb" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712") : secret "image-registry-tls" not found
Jul 23 21:52:12.132816 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:12.132777    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls podName:743f6aa9-b1d3-42de-8019-2905221ebbf5 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:13.132762711 +0000 UTC m=+37.167470242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9hdj" (UID: "743f6aa9-b1d3-42de-8019-2905221ebbf5") : secret "insights-runtime-extractor-tls" not found
Jul 23 21:52:12.870282 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:12.870253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mc9c7"]
Jul 23 21:52:12.874258 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:12.874196    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a40c75d_40c3_4247_a2a1_ee4ee39b84bc.slice/crio-aaf40d66d2a23750310558c0ebf6dfaa4241d8c66de3a735b1f482f6a079fe4b WatchSource:0}: Error finding container aaf40d66d2a23750310558c0ebf6dfaa4241d8c66de3a735b1f482f6a079fe4b: Status 404 returned error can't find the container with id aaf40d66d2a23750310558c0ebf6dfaa4241d8c66de3a735b1f482f6a079fe4b
Jul 23 21:52:13.140972 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.140939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:13.141163 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.140982    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:13.141163 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.141006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:13.141163 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:13.141109    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 21:52:13.141316 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:13.141175    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls podName:743f6aa9-b1d3-42de-8019-2905221ebbf5 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:15.141159295 +0000 UTC m=+39.175866831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9hdj" (UID: "743f6aa9-b1d3-42de-8019-2905221ebbf5") : secret "insights-runtime-extractor-tls" not found
Jul 23 21:52:13.141316 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:13.141109    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 21:52:13.141316 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:13.141263    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls podName:26a3edf1-777d-4953-a47c-88670d366937 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:15.141249222 +0000 UTC m=+39.175956752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls") pod "dns-default-ldwf6" (UID: "26a3edf1-777d-4953-a47c-88670d366937") : secret "dns-default-metrics-tls" not found
Jul 23 21:52:13.141316 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:13.141112    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 21:52:13.141316 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:13.141282    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7d875c7f-nrsnb: secret "image-registry-tls" not found
Jul 23 21:52:13.141316 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:13.141303    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls podName:578f4b1c-488c-4785-aec7-7d78ede6e712 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:15.141297008 +0000 UTC m=+39.176004565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls") pod "image-registry-5b7d875c7f-nrsnb" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712") : secret "image-registry-tls" not found
Jul 23 21:52:13.647368 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.647334    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-k2rfr"]
Jul 23 21:52:13.649367 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.649341    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-k2rfr"
Jul 23 21:52:13.651795 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.651769    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 23 21:52:13.652936 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.652906    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 23 21:52:13.653066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.652972    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wqg98\""
Jul 23 21:52:13.653066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.652992    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 23 21:52:13.653547 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.653413    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 23 21:52:13.664649 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.664563    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-k2rfr"]
Jul 23 21:52:13.746009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.745961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/08339dfa-2d3b-46ba-9800-0c053382a086-signing-key\") pod \"service-ca-58598695f7-k2rfr\" (UID: \"08339dfa-2d3b-46ba-9800-0c053382a086\") " pod="openshift-service-ca/service-ca-58598695f7-k2rfr"
Jul 23 21:52:13.746172 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.746019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/08339dfa-2d3b-46ba-9800-0c053382a086-signing-cabundle\") pod \"service-ca-58598695f7-k2rfr\" (UID: \"08339dfa-2d3b-46ba-9800-0c053382a086\") " pod="openshift-service-ca/service-ca-58598695f7-k2rfr"
Jul 23 21:52:13.746172 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.746067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbrqz\" (UniqueName: \"kubernetes.io/projected/08339dfa-2d3b-46ba-9800-0c053382a086-kube-api-access-wbrqz\") pod \"service-ca-58598695f7-k2rfr\" (UID: \"08339dfa-2d3b-46ba-9800-0c053382a086\") " pod="openshift-service-ca/service-ca-58598695f7-k2rfr"
Jul 23 21:52:13.806695 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.806663    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mc9c7" event={"ID":"7a40c75d-40c3-4247-a2a1-ee4ee39b84bc","Type":"ContainerStarted","Data":"aaf40d66d2a23750310558c0ebf6dfaa4241d8c66de3a735b1f482f6a079fe4b"}
Jul 23 21:52:13.809679 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.809650    2565 generic.go:356] "Generic (PLEG): container finished" podID="ae6cee96-e6ab-4525-bbe9-572ef18332b4" containerID="f7533d26bd062a3a6e72e8d1aab77f439000802e9b4cad70aebde5a0ad003d92" exitCode=0
Jul 23 21:52:13.809784 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.809714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl7vn" event={"ID":"ae6cee96-e6ab-4525-bbe9-572ef18332b4","Type":"ContainerDied","Data":"f7533d26bd062a3a6e72e8d1aab77f439000802e9b4cad70aebde5a0ad003d92"}
Jul 23 21:52:13.846607 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.846564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbrqz\" (UniqueName: \"kubernetes.io/projected/08339dfa-2d3b-46ba-9800-0c053382a086-kube-api-access-wbrqz\") pod \"service-ca-58598695f7-k2rfr\" (UID: \"08339dfa-2d3b-46ba-9800-0c053382a086\") " pod="openshift-service-ca/service-ca-58598695f7-k2rfr"
Jul 23 21:52:13.846795 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.846693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/08339dfa-2d3b-46ba-9800-0c053382a086-signing-key\") pod \"service-ca-58598695f7-k2rfr\" (UID: \"08339dfa-2d3b-46ba-9800-0c053382a086\") " pod="openshift-service-ca/service-ca-58598695f7-k2rfr"
Jul 23 21:52:13.846795 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.846744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/08339dfa-2d3b-46ba-9800-0c053382a086-signing-cabundle\") pod \"service-ca-58598695f7-k2rfr\" (UID: \"08339dfa-2d3b-46ba-9800-0c053382a086\") " pod="openshift-service-ca/service-ca-58598695f7-k2rfr"
Jul 23 21:52:13.847612 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.847586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/08339dfa-2d3b-46ba-9800-0c053382a086-signing-cabundle\") pod \"service-ca-58598695f7-k2rfr\" (UID: \"08339dfa-2d3b-46ba-9800-0c053382a086\") " pod="openshift-service-ca/service-ca-58598695f7-k2rfr"
Jul 23 21:52:13.850748 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.850717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/08339dfa-2d3b-46ba-9800-0c053382a086-signing-key\") pod \"service-ca-58598695f7-k2rfr\" (UID: \"08339dfa-2d3b-46ba-9800-0c053382a086\") " pod="openshift-service-ca/service-ca-58598695f7-k2rfr"
Jul 23 21:52:13.856679 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.856649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbrqz\" (UniqueName: \"kubernetes.io/projected/08339dfa-2d3b-46ba-9800-0c053382a086-kube-api-access-wbrqz\") pod \"service-ca-58598695f7-k2rfr\" (UID: \"08339dfa-2d3b-46ba-9800-0c053382a086\") " pod="openshift-service-ca/service-ca-58598695f7-k2rfr"
Jul 23 21:52:13.963492 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:13.963463    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-k2rfr"
Jul 23 21:52:14.101979 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:14.101721    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-k2rfr"]
Jul 23 21:52:14.105443 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:14.105406    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08339dfa_2d3b_46ba_9800_0c053382a086.slice/crio-3d3f6c114138940ad3fb1000519570f5c8462b03f0f3fda928339ad507956027 WatchSource:0}: Error finding container 3d3f6c114138940ad3fb1000519570f5c8462b03f0f3fda928339ad507956027: Status 404 returned error can't find the container with id 3d3f6c114138940ad3fb1000519570f5c8462b03f0f3fda928339ad507956027
Jul 23 21:52:14.813649 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:14.813610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-k2rfr" event={"ID":"08339dfa-2d3b-46ba-9800-0c053382a086","Type":"ContainerStarted","Data":"3d3f6c114138940ad3fb1000519570f5c8462b03f0f3fda928339ad507956027"}
Jul 23 21:52:14.816938 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:14.816911    2565 generic.go:356] "Generic (PLEG): container finished" podID="ae6cee96-e6ab-4525-bbe9-572ef18332b4" containerID="749c8fa678a6c8a07d85115deaf488aadace5115afe3848ea46dcf74a51a6d71" exitCode=0
Jul 23 21:52:14.817059 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:14.816987    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl7vn" event={"ID":"ae6cee96-e6ab-4525-bbe9-572ef18332b4","Type":"ContainerDied","Data":"749c8fa678a6c8a07d85115deaf488aadace5115afe3848ea46dcf74a51a6d71"}
Jul 23 21:52:15.158891 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:15.158864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:15.159192 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:15.158898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:15.159192 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:15.158916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:15.159192 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:15.159010    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 21:52:15.159192 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:15.159014    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 21:52:15.159192 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:15.159031    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7d875c7f-nrsnb: secret "image-registry-tls" not found
Jul 23 21:52:15.159192 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:15.159011    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 21:52:15.159192 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:15.159064    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls podName:26a3edf1-777d-4953-a47c-88670d366937 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:19.159046435 +0000 UTC m=+43.193753968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls") pod "dns-default-ldwf6" (UID: "26a3edf1-777d-4953-a47c-88670d366937") : secret "dns-default-metrics-tls" not found
Jul 23 21:52:15.159192 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:15.159078    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls podName:578f4b1c-488c-4785-aec7-7d78ede6e712 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:19.159072256 +0000 UTC m=+43.193779772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls") pod "image-registry-5b7d875c7f-nrsnb" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712") : secret "image-registry-tls" not found
Jul 23 21:52:15.159192 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:15.159098    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls podName:743f6aa9-b1d3-42de-8019-2905221ebbf5 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:19.159082625 +0000 UTC m=+43.193790156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9hdj" (UID: "743f6aa9-b1d3-42de-8019-2905221ebbf5") : secret "insights-runtime-extractor-tls" not found
Jul 23 21:52:15.821715 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:15.821492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mc9c7" event={"ID":"7a40c75d-40c3-4247-a2a1-ee4ee39b84bc","Type":"ContainerStarted","Data":"fc5aa7ff0fb01bb435fd438e9efb63cddf4703ac938682b75496bbb71019df9e"}
Jul 23 21:52:15.825918 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:15.825891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fl7vn" event={"ID":"ae6cee96-e6ab-4525-bbe9-572ef18332b4","Type":"ContainerStarted","Data":"5a68e742921fa55f15ab241544c3b82876c4713562e5f8e207b2584e60437d4e"}
Jul 23 21:52:15.840178 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:15.840131    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mc9c7" podStartSLOduration=2.635820125 podStartE2EDuration="4.840117118s" totalImagesPullingTime="2.204296993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:15.838661616 +0000 UTC m=+39.873369155" watchObservedRunningTime="2026-07-23 21:52:15.840117118 +0000 UTC m=+39.874824656"
Jul 23 21:52:15.863320 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:15.863275    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fl7vn" podStartSLOduration=9.724517282 podStartE2EDuration="39.863258763s" totalImagesPullingTime="30.138741481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:15.862465234 +0000 UTC m=+39.897172770" watchObservedRunningTime="2026-07-23 21:52:15.863258763 +0000 UTC m=+39.897966303"
Jul 23 21:52:17.832009 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:17.831969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-k2rfr" event={"ID":"08339dfa-2d3b-46ba-9800-0c053382a086","Type":"ContainerStarted","Data":"d613936b226bbed5ddc0ba50e074a748a0f84520a4a101a5673fca0f22da2779"}
Jul 23 21:52:17.849280 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:17.849200    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-k2rfr" podStartSLOduration=2.161459246 podStartE2EDuration="4.84918052s" totalImagesPullingTime="2.687721274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:17.848787145 +0000 UTC m=+41.883494684" watchObservedRunningTime="2026-07-23 21:52:17.84918052 +0000 UTC m=+41.883888061"
Jul 23 21:52:19.193637 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:19.193591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:19.194079 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:19.193648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:19.194079 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:19.193677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:19.194079 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:19.193797    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 21:52:19.194079 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:19.193854    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls podName:26a3edf1-777d-4953-a47c-88670d366937 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:27.193836637 +0000 UTC m=+51.228544169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls") pod "dns-default-ldwf6" (UID: "26a3edf1-777d-4953-a47c-88670d366937") : secret "dns-default-metrics-tls" not found
Jul 23 21:52:19.194079 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:19.193916    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 21:52:19.194079 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:19.193948    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls podName:743f6aa9-b1d3-42de-8019-2905221ebbf5 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:27.193938108 +0000 UTC m=+51.228645640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9hdj" (UID: "743f6aa9-b1d3-42de-8019-2905221ebbf5") : secret "insights-runtime-extractor-tls" not found
Jul 23 21:52:19.194079 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:19.194005    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 21:52:19.194079 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:19.194015    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b7d875c7f-nrsnb: secret "image-registry-tls" not found
Jul 23 21:52:19.194079 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:19.194045    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls podName:578f4b1c-488c-4785-aec7-7d78ede6e712 nodeName:}" failed. No retries permitted until 2026-07-23 21:52:27.194035104 +0000 UTC m=+51.228742635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls") pod "image-registry-5b7d875c7f-nrsnb" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712") : secret "image-registry-tls" not found
Jul 23 21:52:27.257244 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.257191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:27.257244 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.257246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:27.257758 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.257270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:27.261119 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.261088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26a3edf1-777d-4953-a47c-88670d366937-metrics-tls\") pod \"dns-default-ldwf6\" (UID: \"26a3edf1-777d-4953-a47c-88670d366937\") " pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:27.261279 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.261251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/743f6aa9-b1d3-42de-8019-2905221ebbf5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9hdj\" (UID: \"743f6aa9-b1d3-42de-8019-2905221ebbf5\") " pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:27.261355 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.261331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls\") pod \"image-registry-5b7d875c7f-nrsnb\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") " pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:27.293404 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.293365    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:27.300016 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.299981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:27.315547 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.315523    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x9hdj"
Jul 23 21:52:27.489137 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.489102    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ldwf6"]
Jul 23 21:52:27.492610 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:27.492584    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a3edf1_777d_4953_a47c_88670d366937.slice/crio-707b9bdcb6f478965cbb8bef951876f790a250ed8dd60e30bd44f5e0db040495 WatchSource:0}: Error finding container 707b9bdcb6f478965cbb8bef951876f790a250ed8dd60e30bd44f5e0db040495: Status 404 returned error can't find the container with id 707b9bdcb6f478965cbb8bef951876f790a250ed8dd60e30bd44f5e0db040495
Jul 23 21:52:27.492771 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.492749    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b7d875c7f-nrsnb"]
Jul 23 21:52:27.495496 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:27.495471    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578f4b1c_488c_4785_aec7_7d78ede6e712.slice/crio-aa6d7a5b119ff323e30694c976cfc45eb784ba1cb7d67c11eb126f1a1708c6c4 WatchSource:0}: Error finding container aa6d7a5b119ff323e30694c976cfc45eb784ba1cb7d67c11eb126f1a1708c6c4: Status 404 returned error can't find the container with id aa6d7a5b119ff323e30694c976cfc45eb784ba1cb7d67c11eb126f1a1708c6c4
Jul 23 21:52:27.509017 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.508937    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x9hdj"]
Jul 23 21:52:27.511616 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:27.511583    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743f6aa9_b1d3_42de_8019_2905221ebbf5.slice/crio-12d3a124453fce500fff431864dd88b24c44d455adbce8d99e4e21f9ebe5dab0 WatchSource:0}: Error finding container 12d3a124453fce500fff431864dd88b24c44d455adbce8d99e4e21f9ebe5dab0: Status 404 returned error can't find the container with id 12d3a124453fce500fff431864dd88b24c44d455adbce8d99e4e21f9ebe5dab0
Jul 23 21:52:27.857862 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.857824    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb" event={"ID":"578f4b1c-488c-4785-aec7-7d78ede6e712","Type":"ContainerStarted","Data":"ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8"}
Jul 23 21:52:27.858054 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.857887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb" event={"ID":"578f4b1c-488c-4785-aec7-7d78ede6e712","Type":"ContainerStarted","Data":"aa6d7a5b119ff323e30694c976cfc45eb784ba1cb7d67c11eb126f1a1708c6c4"}
Jul 23 21:52:27.858054 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.857915    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:27.859242 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.859168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9hdj" event={"ID":"743f6aa9-b1d3-42de-8019-2905221ebbf5","Type":"ContainerStarted","Data":"12d3a124453fce500fff431864dd88b24c44d455adbce8d99e4e21f9ebe5dab0"}
Jul 23 21:52:27.860336 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.860314    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ldwf6" event={"ID":"26a3edf1-777d-4953-a47c-88670d366937","Type":"ContainerStarted","Data":"707b9bdcb6f478965cbb8bef951876f790a250ed8dd60e30bd44f5e0db040495"}
Jul 23 21:52:27.880200 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:27.880150    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb" podStartSLOduration=26.880134753 podStartE2EDuration="26.880134753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:52:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:27.879180512 +0000 UTC m=+51.913888053" watchObservedRunningTime="2026-07-23 21:52:27.880134753 +0000 UTC m=+51.914842301"
Jul 23 21:52:30.872626 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:30.872589    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ldwf6" event={"ID":"26a3edf1-777d-4953-a47c-88670d366937","Type":"ContainerStarted","Data":"12bf9c182d6afabad1d01fb1ebf69e21b0252d43555e49d62e44a214d79a23db"}
Jul 23 21:52:30.873083 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:30.872680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ldwf6" event={"ID":"26a3edf1-777d-4953-a47c-88670d366937","Type":"ContainerStarted","Data":"3e537bb112e4c95e401634be3e8a91bd379e2adaee0ff6629f02fa63697bd163"}
Jul 23 21:52:30.873083 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:30.872742    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:30.893520 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:30.893475    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ldwf6" podStartSLOduration=17.557771818 podStartE2EDuration="19.893460824s" totalImagesPullingTime="2.335689006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:30.893097172 +0000 UTC m=+54.927804712" watchObservedRunningTime="2026-07-23 21:52:30.893460824 +0000 UTC m=+54.928168409"
Jul 23 21:52:32.881190 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.881162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9hdj" event={"ID":"743f6aa9-b1d3-42de-8019-2905221ebbf5","Type":"ContainerStarted","Data":"8b4896b737f25519d119567ec56e8d318ec47fea0af8658473db5338120208b8"}
Jul 23 21:52:32.981333 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.981292    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr"]
Jul 23 21:52:32.983476 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.983459    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5"]
Jul 23 21:52:32.983606 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.983589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr"
Jul 23 21:52:32.985264 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.985202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5"
Jul 23 21:52:32.986167 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.986148    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 23 21:52:32.986440 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.986426    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 23 21:52:32.986498 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.986429    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-q87pm\""
Jul 23 21:52:32.986548 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.986525    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"]
Jul 23 21:52:32.987710 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.987694    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 23 21:52:32.988140 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.988121    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fqs4h\""
Jul 23 21:52:32.988297 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.988281    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:32.988631 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.988612    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 21:52:32.988747 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.988731    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 21:52:32.988855 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.988835    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 21:52:32.990376 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.990303    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"]
Jul 23 21:52:32.990918 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.990902    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 23 21:52:32.992474 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.992458    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:32.994790 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.994770    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 23 21:52:32.994868 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.994775    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 23 21:52:32.994868 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.994775    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 23 21:52:32.994951 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:32.994777    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 23 21:52:33.001094 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.001039    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5"]
Jul 23 21:52:33.003176 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.003157    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr"]
Jul 23 21:52:33.006235 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.006194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"]
Jul 23 21:52:33.025899 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.025876    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"]
Jul 23 21:52:33.066187 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.066120    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b7d875c7f-nrsnb"]
Jul 23 21:52:33.105776 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.105739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5af52a0-b63e-4100-90c0-40f077b7de7a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sjvhr\" (UID: \"a5af52a0-b63e-4100-90c0-40f077b7de7a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr"
Jul 23 21:52:33.105776 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.105779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.105984 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.105810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-hub\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.105984 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.105841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llv2v\" (UniqueName: \"kubernetes.io/projected/8cc398c0-aca8-479a-aa02-5506585f1fef-kube-api-access-llv2v\") pod \"klusterlet-addon-workmgr-76549d98f6-4xxxr\" (UID: \"8cc398c0-aca8-479a-aa02-5506585f1fef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:33.105984 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.105861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a5af52a0-b63e-4100-90c0-40f077b7de7a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-sjvhr\" (UID: \"a5af52a0-b63e-4100-90c0-40f077b7de7a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr"
Jul 23 21:52:33.105984 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.105901    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cc398c0-aca8-479a-aa02-5506585f1fef-tmp\") pod \"klusterlet-addon-workmgr-76549d98f6-4xxxr\" (UID: \"8cc398c0-aca8-479a-aa02-5506585f1fef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:33.106102 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.105998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8cc398c0-aca8-479a-aa02-5506585f1fef-klusterlet-config\") pod \"klusterlet-addon-workmgr-76549d98f6-4xxxr\" (UID: \"8cc398c0-aca8-479a-aa02-5506585f1fef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:33.106102 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.106026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9l5d\" (UniqueName: \"kubernetes.io/projected/2c3b4b16-9cd8-4dbb-8742-2877356f661a-kube-api-access-k9l5d\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.106102 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.106050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tvjc\" (UniqueName: \"kubernetes.io/projected/708d97e7-634e-42a2-9ba8-23da1f9c6947-kube-api-access-6tvjc\") pod \"managed-serviceaccount-addon-agent-7456c9568b-4tbh5\" (UID: \"708d97e7-634e-42a2-9ba8-23da1f9c6947\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5"
Jul 23 21:52:33.106102 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.106090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-ca\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.106235 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.106121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/708d97e7-634e-42a2-9ba8-23da1f9c6947-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7456c9568b-4tbh5\" (UID: \"708d97e7-634e-42a2-9ba8-23da1f9c6947\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5"
Jul 23 21:52:33.106235 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.106152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3b4b16-9cd8-4dbb-8742-2877356f661a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.106235 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.106169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.203442 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.203404    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-768bf9c6cf-2tsfw"]
Jul 23 21:52:33.205394 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.205375    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.206541 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.206517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-ca\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.206645 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.206567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/708d97e7-634e-42a2-9ba8-23da1f9c6947-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7456c9568b-4tbh5\" (UID: \"708d97e7-634e-42a2-9ba8-23da1f9c6947\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5"
Jul 23 21:52:33.206752 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.206729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3b4b16-9cd8-4dbb-8742-2877356f661a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.206811 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.206773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.206867 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.206812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5af52a0-b63e-4100-90c0-40f077b7de7a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sjvhr\" (UID: \"a5af52a0-b63e-4100-90c0-40f077b7de7a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr"
Jul 23 21:52:33.206867 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.206830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.206867 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.206855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-hub\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.207017 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.206897    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llv2v\" (UniqueName: \"kubernetes.io/projected/8cc398c0-aca8-479a-aa02-5506585f1fef-kube-api-access-llv2v\") pod \"klusterlet-addon-workmgr-76549d98f6-4xxxr\" (UID: \"8cc398c0-aca8-479a-aa02-5506585f1fef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:33.207017 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.206923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a5af52a0-b63e-4100-90c0-40f077b7de7a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-sjvhr\" (UID: \"a5af52a0-b63e-4100-90c0-40f077b7de7a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr"
Jul 23 21:52:33.207017 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.206964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cc398c0-aca8-479a-aa02-5506585f1fef-tmp\") pod \"klusterlet-addon-workmgr-76549d98f6-4xxxr\" (UID: \"8cc398c0-aca8-479a-aa02-5506585f1fef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:33.207017 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.207003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8cc398c0-aca8-479a-aa02-5506585f1fef-klusterlet-config\") pod \"klusterlet-addon-workmgr-76549d98f6-4xxxr\" (UID: \"8cc398c0-aca8-479a-aa02-5506585f1fef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:33.207291 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.207028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9l5d\" (UniqueName: \"kubernetes.io/projected/2c3b4b16-9cd8-4dbb-8742-2877356f661a-kube-api-access-k9l5d\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.207291 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.207054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tvjc\" (UniqueName: \"kubernetes.io/projected/708d97e7-634e-42a2-9ba8-23da1f9c6947-kube-api-access-6tvjc\") pod \"managed-serviceaccount-addon-agent-7456c9568b-4tbh5\" (UID: \"708d97e7-634e-42a2-9ba8-23da1f9c6947\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5"
Jul 23 21:52:33.207534 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.207509    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3b4b16-9cd8-4dbb-8742-2877356f661a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.207722 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.207700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cc398c0-aca8-479a-aa02-5506585f1fef-tmp\") pod \"klusterlet-addon-workmgr-76549d98f6-4xxxr\" (UID: \"8cc398c0-aca8-479a-aa02-5506585f1fef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:33.208006 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.207983    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a5af52a0-b63e-4100-90c0-40f077b7de7a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-sjvhr\" (UID: \"a5af52a0-b63e-4100-90c0-40f077b7de7a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr"
Jul 23 21:52:33.210424 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.210379    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-hub\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.210563 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.210543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-ca\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.210827 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.210806    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8cc398c0-aca8-479a-aa02-5506585f1fef-klusterlet-config\") pod \"klusterlet-addon-workmgr-76549d98f6-4xxxr\" (UID: \"8cc398c0-aca8-479a-aa02-5506585f1fef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:33.211076 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.211051    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.211484 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.211455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5af52a0-b63e-4100-90c0-40f077b7de7a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-sjvhr\" (UID: \"a5af52a0-b63e-4100-90c0-40f077b7de7a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr"
Jul 23 21:52:33.212345 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.212326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/708d97e7-634e-42a2-9ba8-23da1f9c6947-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7456c9568b-4tbh5\" (UID: \"708d97e7-634e-42a2-9ba8-23da1f9c6947\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5"
Jul 23 21:52:33.212627 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.212608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2c3b4b16-9cd8-4dbb-8742-2877356f661a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.228706 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.228672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tvjc\" (UniqueName: \"kubernetes.io/projected/708d97e7-634e-42a2-9ba8-23da1f9c6947-kube-api-access-6tvjc\") pod \"managed-serviceaccount-addon-agent-7456c9568b-4tbh5\" (UID: \"708d97e7-634e-42a2-9ba8-23da1f9c6947\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5"
Jul 23 21:52:33.229827 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.229789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9l5d\" (UniqueName: \"kubernetes.io/projected/2c3b4b16-9cd8-4dbb-8742-2877356f661a-kube-api-access-k9l5d\") pod \"cluster-proxy-proxy-agent-7dfd544b87-98kbb\" (UID: \"2c3b4b16-9cd8-4dbb-8742-2877356f661a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.236227 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.236184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llv2v\" (UniqueName: \"kubernetes.io/projected/8cc398c0-aca8-479a-aa02-5506585f1fef-kube-api-access-llv2v\") pod \"klusterlet-addon-workmgr-76549d98f6-4xxxr\" (UID: \"8cc398c0-aca8-479a-aa02-5506585f1fef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:33.288561 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.288527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768bf9c6cf-2tsfw"]
Jul 23 21:52:33.293871 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.293839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr"
Jul 23 21:52:33.307388 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.307292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5"
Jul 23 21:52:33.307526 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.307471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/171807f4-d64c-4480-aab9-932bf7b11f0d-ca-trust-extracted\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.307526 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.307520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/171807f4-d64c-4480-aab9-932bf7b11f0d-registry-tls\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.307635 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.307579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/171807f4-d64c-4480-aab9-932bf7b11f0d-installation-pull-secrets\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.307635 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.307606    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/171807f4-d64c-4480-aab9-932bf7b11f0d-bound-sa-token\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.307738 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.307659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/171807f4-d64c-4480-aab9-932bf7b11f0d-trusted-ca\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.307738 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.307710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/171807f4-d64c-4480-aab9-932bf7b11f0d-image-registry-private-configuration\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.307832 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.307755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b77qx\" (UniqueName: \"kubernetes.io/projected/171807f4-d64c-4480-aab9-932bf7b11f0d-kube-api-access-b77qx\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.307832 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.307780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/171807f4-d64c-4480-aab9-932bf7b11f0d-registry-certificates\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.315966 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.315934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:33.322402 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.322339    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"
Jul 23 21:52:33.412516 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.411837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/171807f4-d64c-4480-aab9-932bf7b11f0d-installation-pull-secrets\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.412516 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.411884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/171807f4-d64c-4480-aab9-932bf7b11f0d-bound-sa-token\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.412516 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.411955    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/171807f4-d64c-4480-aab9-932bf7b11f0d-trusted-ca\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.412516 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.411999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/171807f4-d64c-4480-aab9-932bf7b11f0d-image-registry-private-configuration\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.412516 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.412044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b77qx\" (UniqueName: \"kubernetes.io/projected/171807f4-d64c-4480-aab9-932bf7b11f0d-kube-api-access-b77qx\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.412516 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.412073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/171807f4-d64c-4480-aab9-932bf7b11f0d-registry-certificates\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.412516 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.412106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/171807f4-d64c-4480-aab9-932bf7b11f0d-ca-trust-extracted\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.412516 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.412147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/171807f4-d64c-4480-aab9-932bf7b11f0d-registry-tls\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.413792 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.413552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/171807f4-d64c-4480-aab9-932bf7b11f0d-ca-trust-extracted\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.415362 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.415042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/171807f4-d64c-4480-aab9-932bf7b11f0d-trusted-ca\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.416138 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.416090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/171807f4-d64c-4480-aab9-932bf7b11f0d-registry-certificates\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.421880 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.421808    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/171807f4-d64c-4480-aab9-932bf7b11f0d-image-registry-private-configuration\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.422823 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.422778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/171807f4-d64c-4480-aab9-932bf7b11f0d-installation-pull-secrets\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.424723 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.424676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/171807f4-d64c-4480-aab9-932bf7b11f0d-registry-tls\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.441241 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.441149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/171807f4-d64c-4480-aab9-932bf7b11f0d-bound-sa-token\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.443051 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.442991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b77qx\" (UniqueName: \"kubernetes.io/projected/171807f4-d64c-4480-aab9-932bf7b11f0d-kube-api-access-b77qx\") pod \"image-registry-768bf9c6cf-2tsfw\" (UID: \"171807f4-d64c-4480-aab9-932bf7b11f0d\") " pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.490397 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.490304    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr"]
Jul 23 21:52:33.494838 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:33.494781    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5af52a0_b63e_4100_90c0_40f077b7de7a.slice/crio-26354c5bf86c0a8f1edcc54138e6b3ff0c2d0cadaf2e874c8c4c77b0bc9ff235 WatchSource:0}: Error finding container 26354c5bf86c0a8f1edcc54138e6b3ff0c2d0cadaf2e874c8c4c77b0bc9ff235: Status 404 returned error can't find the container with id 26354c5bf86c0a8f1edcc54138e6b3ff0c2d0cadaf2e874c8c4c77b0bc9ff235
Jul 23 21:52:33.514887 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.514818    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5"]
Jul 23 21:52:33.518814 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:33.518768    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod708d97e7_634e_42a2_9ba8_23da1f9c6947.slice/crio-48c1f3c0d2dcd3c9e35f642a4a962e4f2259993150714755814d167872072d3a WatchSource:0}: Error finding container 48c1f3c0d2dcd3c9e35f642a4a962e4f2259993150714755814d167872072d3a: Status 404 returned error can't find the container with id 48c1f3c0d2dcd3c9e35f642a4a962e4f2259993150714755814d167872072d3a
Jul 23 21:52:33.538624 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.538555    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb"]
Jul 23 21:52:33.541674 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:33.541647    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c3b4b16_9cd8_4dbb_8742_2877356f661a.slice/crio-8892dab0d1050ec418dfd3dd7efb50d4a7f304e6bc912e6ac5dc124942547429 WatchSource:0}: Error finding container 8892dab0d1050ec418dfd3dd7efb50d4a7f304e6bc912e6ac5dc124942547429: Status 404 returned error can't find the container with id 8892dab0d1050ec418dfd3dd7efb50d4a7f304e6bc912e6ac5dc124942547429
Jul 23 21:52:33.552996 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.552968    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.722675 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.722646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768bf9c6cf-2tsfw"]
Jul 23 21:52:33.725372 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:33.725332    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171807f4_d64c_4480_aab9_932bf7b11f0d.slice/crio-461e6341f7e862832ec5fd022608dbf89933ea5da12b266e3f45a997ba996084 WatchSource:0}: Error finding container 461e6341f7e862832ec5fd022608dbf89933ea5da12b266e3f45a997ba996084: Status 404 returned error can't find the container with id 461e6341f7e862832ec5fd022608dbf89933ea5da12b266e3f45a997ba996084
Jul 23 21:52:33.744826 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.744761    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"]
Jul 23 21:52:33.761401 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:33.761367    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc398c0_aca8_479a_aa02_5506585f1fef.slice/crio-388cc71f4105923f5deccd2f5c97444d1e293857b5042b80439f7916d97cd600 WatchSource:0}: Error finding container 388cc71f4105923f5deccd2f5c97444d1e293857b5042b80439f7916d97cd600: Status 404 returned error can't find the container with id 388cc71f4105923f5deccd2f5c97444d1e293857b5042b80439f7916d97cd600
Jul 23 21:52:33.887075 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.886990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw" event={"ID":"171807f4-d64c-4480-aab9-932bf7b11f0d","Type":"ContainerStarted","Data":"901045e22f5d773d8a3f1d688f4d216dcd63c815d6c1eb213121fbe635697e47"}
Jul 23 21:52:33.887075 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.887052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw" event={"ID":"171807f4-d64c-4480-aab9-932bf7b11f0d","Type":"ContainerStarted","Data":"461e6341f7e862832ec5fd022608dbf89933ea5da12b266e3f45a997ba996084"}
Jul 23 21:52:33.887584 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.887191    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:33.888786 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.888759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr" event={"ID":"8cc398c0-aca8-479a-aa02-5506585f1fef","Type":"ContainerStarted","Data":"388cc71f4105923f5deccd2f5c97444d1e293857b5042b80439f7916d97cd600"}
Jul 23 21:52:33.890158 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.890118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5" event={"ID":"708d97e7-634e-42a2-9ba8-23da1f9c6947","Type":"ContainerStarted","Data":"48c1f3c0d2dcd3c9e35f642a4a962e4f2259993150714755814d167872072d3a"}
Jul 23 21:52:33.891847 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.891820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr" event={"ID":"a5af52a0-b63e-4100-90c0-40f077b7de7a","Type":"ContainerStarted","Data":"26354c5bf86c0a8f1edcc54138e6b3ff0c2d0cadaf2e874c8c4c77b0bc9ff235"}
Jul 23 21:52:33.893055 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.893027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb" event={"ID":"2c3b4b16-9cd8-4dbb-8742-2877356f661a","Type":"ContainerStarted","Data":"8892dab0d1050ec418dfd3dd7efb50d4a7f304e6bc912e6ac5dc124942547429"}
Jul 23 21:52:33.910029 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:33.909974    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw" podStartSLOduration=0.909955194 podStartE2EDuration="909.955194ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:52:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:33.909400791 +0000 UTC m=+57.944108334" watchObservedRunningTime="2026-07-23 21:52:33.909955194 +0000 UTC m=+57.944662734"
Jul 23 21:52:37.798168 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:37.798134    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdxmw"
Jul 23 21:52:40.878370 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:40.878332    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ldwf6"
Jul 23 21:52:41.185828 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.185740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:52:41.185828 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.185789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nsjz\" (UniqueName: \"kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz\") pod \"network-check-target-w5jk7\" (UID: \"f621510a-a35d-492a-a989-9024c85c2964\") " pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:41.189078 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.189045    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 21:52:41.189240 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.189168    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 21:52:41.199370 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.199340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7af186d-aaae-47e9-8196-fb393bbc3bc7-metrics-certs\") pod \"network-metrics-daemon-hphl7\" (UID: \"e7af186d-aaae-47e9-8196-fb393bbc3bc7\") " pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:52:41.199559 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.199538    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 21:52:41.210477 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.210446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nsjz\" (UniqueName: \"kubernetes.io/projected/f621510a-a35d-492a-a989-9024c85c2964-kube-api-access-2nsjz\") pod \"network-check-target-w5jk7\" (UID: \"f621510a-a35d-492a-a989-9024c85c2964\") " pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:41.286888 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.286854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:52:41.289816 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.289794    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 21:52:41.299732 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.299708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/494f1e0c-becb-4576-87d6-c79ae2f4c8e0-original-pull-secret\") pod \"global-pull-secret-syncer-c56hs\" (UID: \"494f1e0c-becb-4576-87d6-c79ae2f4c8e0\") " pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:52:41.488445 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.488379    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c56hs"
Jul 23 21:52:41.498193 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.498169    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jd2p5\""
Jul 23 21:52:41.506398 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.506382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hphl7"
Jul 23 21:52:41.512103 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.512082    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sc2x2\""
Jul 23 21:52:41.522127 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.522109    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:41.858638 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.858544    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w5jk7"]
Jul 23 21:52:41.862871 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:41.862838    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf621510a_a35d_492a_a989_9024c85c2964.slice/crio-42ee61124fc74ad813b11b123ae46d9237b267bde8474d987602c55a3910cdac WatchSource:0}: Error finding container 42ee61124fc74ad813b11b123ae46d9237b267bde8474d987602c55a3910cdac: Status 404 returned error can't find the container with id 42ee61124fc74ad813b11b123ae46d9237b267bde8474d987602c55a3910cdac
Jul 23 21:52:41.873034 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.872773    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hphl7"]
Jul 23 21:52:41.894922 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.894866    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c56hs"]
Jul 23 21:52:41.898088 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:41.898064    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494f1e0c_becb_4576_87d6_c79ae2f4c8e0.slice/crio-4cbfa76aa3184a508e5ee88afce132c26d4adbdcabb1f72910331b9995269f7b WatchSource:0}: Error finding container 4cbfa76aa3184a508e5ee88afce132c26d4adbdcabb1f72910331b9995269f7b: Status 404 returned error can't find the container with id 4cbfa76aa3184a508e5ee88afce132c26d4adbdcabb1f72910331b9995269f7b
Jul 23 21:52:41.932286 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.932254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr" event={"ID":"8cc398c0-aca8-479a-aa02-5506585f1fef","Type":"ContainerStarted","Data":"cd22d33ab1b9fbbc4648b2e9238f96aefd5013e440a927c1aa1e68b63cfa011b"}
Jul 23 21:52:41.932402 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.932352    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:41.934123 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.934099    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr"
Jul 23 21:52:41.934443 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.934417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5" event={"ID":"708d97e7-634e-42a2-9ba8-23da1f9c6947","Type":"ContainerStarted","Data":"25c5152965bb756609f5a61179da8cd035a89e137a69efff9679782fb395e5b4"}
Jul 23 21:52:41.936483 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.936458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr" event={"ID":"a5af52a0-b63e-4100-90c0-40f077b7de7a","Type":"ContainerStarted","Data":"89043ebee6eab5285c312e447c3ad7d908c4f33a21831b5c996304b455bed2bd"}
Jul 23 21:52:41.938183 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.938162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c56hs" event={"ID":"494f1e0c-becb-4576-87d6-c79ae2f4c8e0","Type":"ContainerStarted","Data":"4cbfa76aa3184a508e5ee88afce132c26d4adbdcabb1f72910331b9995269f7b"}
Jul 23 21:52:41.939225 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.939186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hphl7" event={"ID":"e7af186d-aaae-47e9-8196-fb393bbc3bc7","Type":"ContainerStarted","Data":"2583da6cbf87e937bfdd66977e5126eeb025c3218b47a5dd41da3984e4b5f39b"}
Jul 23 21:52:41.941229 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.941079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9hdj" event={"ID":"743f6aa9-b1d3-42de-8019-2905221ebbf5","Type":"ContainerStarted","Data":"b7ce970b8fe4ae144bcc3233fc3d2ecbdd2cbdd62879e68b0044dcd1ed1934cd"}
Jul 23 21:52:41.943015 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.942996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb" event={"ID":"2c3b4b16-9cd8-4dbb-8742-2877356f661a","Type":"ContainerStarted","Data":"29cce807fdd9f801d1c66ea6242cfa25dc2701a7f95f143a36beb19648c7c84b"}
Jul 23 21:52:41.943110 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.943023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb" event={"ID":"2c3b4b16-9cd8-4dbb-8742-2877356f661a","Type":"ContainerStarted","Data":"47829fb9dfc5ada4ef44fc0bc5ae8d896fa08d6eda9dd6e22dac108ddae7f4d8"}
Jul 23 21:52:41.944033 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.944016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w5jk7" event={"ID":"f621510a-a35d-492a-a989-9024c85c2964","Type":"ContainerStarted","Data":"42ee61124fc74ad813b11b123ae46d9237b267bde8474d987602c55a3910cdac"}
Jul 23 21:52:41.950282 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.949657    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76549d98f6-4xxxr" podStartSLOduration=2.042179645 podStartE2EDuration="9.949642106s" totalImagesPullingTime="7.907462461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:41.949145137 +0000 UTC m=+65.983852676" watchObservedRunningTime="2026-07-23 21:52:41.949642106 +0000 UTC m=+65.984349643"
Jul 23 21:52:41.966723 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.966681    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7456c9568b-4tbh5" podStartSLOduration=1.8285055350000001 podStartE2EDuration="9.966669241s" totalImagesPullingTime="8.138163706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:41.96626611 +0000 UTC m=+66.000973650" watchObservedRunningTime="2026-07-23 21:52:41.966669241 +0000 UTC m=+66.001376758"
Jul 23 21:52:41.984420 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:41.984371    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-sjvhr" podStartSLOduration=1.837838449 podStartE2EDuration="9.984356162s" totalImagesPullingTime="8.146517713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:41.983493917 +0000 UTC m=+66.018201455" watchObservedRunningTime="2026-07-23 21:52:41.984356162 +0000 UTC m=+66.019063700"
Jul 23 21:52:42.953562 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:42.953527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb" event={"ID":"2c3b4b16-9cd8-4dbb-8742-2877356f661a","Type":"ContainerStarted","Data":"fc8ba91125425bb6ee6bcfa7c32a795559d20f09e9b8fae79412d95698311b59"}
Jul 23 21:52:42.980043 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:42.979770    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7dfd544b87-98kbb" podStartSLOduration=2.8552561560000003 podStartE2EDuration="10.979750774s" totalImagesPullingTime="8.124494618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:42.978074142 +0000 UTC m=+67.012781682" watchObservedRunningTime="2026-07-23 21:52:42.979750774 +0000 UTC m=+67.014458318"
Jul 23 21:52:43.073765 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:43.073443    2565 patch_prober.go:28] interesting pod/image-registry-5b7d875c7f-nrsnb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 21:52:43.073765 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:43.073515    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb" podUID="578f4b1c-488c-4785-aec7-7d78ede6e712" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 21:52:43.961341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:43.960970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hphl7" event={"ID":"e7af186d-aaae-47e9-8196-fb393bbc3bc7","Type":"ContainerStarted","Data":"7c40f2b552b68e4554011d75914aaee8f01d64202605ce36eb37ba3bc72e3817"}
Jul 23 21:52:43.961341 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:43.961029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hphl7" event={"ID":"e7af186d-aaae-47e9-8196-fb393bbc3bc7","Type":"ContainerStarted","Data":"77947eed8410f45c48b055a8cb2fbbccda36128efaefeadd2d7f179f9e8e558c"}
Jul 23 21:52:43.980181 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:43.979936    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hphl7" podStartSLOduration=66.359721142 podStartE2EDuration="1m7.979915459s" totalImagesPullingTime="1.620194317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:43.977763711 +0000 UTC m=+68.012471266" watchObservedRunningTime="2026-07-23 21:52:43.979915459 +0000 UTC m=+68.014623000"
Jul 23 21:52:48.982366 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:48.982271    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c56hs" event={"ID":"494f1e0c-becb-4576-87d6-c79ae2f4c8e0","Type":"ContainerStarted","Data":"1acfcaab75de5ba7ffe6f937723b850e8228ac15e5663826e218a7971457fa3a"}
Jul 23 21:52:48.984269 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:48.984243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9hdj" event={"ID":"743f6aa9-b1d3-42de-8019-2905221ebbf5","Type":"ContainerStarted","Data":"43906faf885bc204618385adf4620bb3634a9f7f18bd5541d71999bd3a41385d"}
Jul 23 21:52:48.985692 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:48.985666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w5jk7" event={"ID":"f621510a-a35d-492a-a989-9024c85c2964","Type":"ContainerStarted","Data":"208fee5abb69b76c043739945cf0643591274244777f60bf3e5321704dd61047"}
Jul 23 21:52:48.985801 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:48.985719    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:52:48.998335 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:48.998288    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c56hs" podStartSLOduration=66.2805434 podStartE2EDuration="1m12.998274596s" totalImagesPullingTime="6.717731196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:48.997593458 +0000 UTC m=+73.032300999" watchObservedRunningTime="2026-07-23 21:52:48.998274596 +0000 UTC m=+73.032982135"
Jul 23 21:52:49.013083 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:49.013036    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w5jk7" podStartSLOduration=66.263556403 podStartE2EDuration="1m13.013022415s" totalImagesPullingTime="6.749466012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:49.01208391 +0000 UTC m=+73.046791473" watchObservedRunningTime="2026-07-23 21:52:49.013022415 +0000 UTC m=+73.047729955"
Jul 23 21:52:51.452452 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.452392    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x9hdj" podStartSLOduration=19.53555823 podStartE2EDuration="40.45237297s" totalImagesPullingTime="20.91681474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:52:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:49.032351906 +0000 UTC m=+73.067059449" watchObservedRunningTime="2026-07-23 21:52:51.45237297 +0000 UTC m=+75.487080508"
Jul 23 21:52:51.453028 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.453011    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m579m"]
Jul 23 21:52:51.455261 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.455239    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.458192 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.458167    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 21:52:51.459616 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.459426    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 21:52:51.459616 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.459443    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 21:52:51.459616 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.459477    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 21:52:51.459616 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.459482    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 21:52:51.459616 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.459426    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gzhmv\""
Jul 23 21:52:51.459917 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.459664    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 21:52:51.572745 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.572710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-tls\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.572936 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.572752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.572936 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.572785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-textfile\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.572936 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.572842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a900a9f-b631-467e-a7c2-51f90e9583d1-metrics-client-ca\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.572936 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.572883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-wtmp\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.572936 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.572908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbkfm\" (UniqueName: \"kubernetes.io/projected/7a900a9f-b631-467e-a7c2-51f90e9583d1-kube-api-access-hbkfm\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.573135 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.572935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a900a9f-b631-467e-a7c2-51f90e9583d1-sys\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.573135 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.572998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.573135 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.573027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a900a9f-b631-467e-a7c2-51f90e9583d1-root\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.673707 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.673671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a900a9f-b631-467e-a7c2-51f90e9583d1-root\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.673891 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.673714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-tls\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.673891 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.673755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.673891 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.673788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-textfile\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.673891 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.673794    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a900a9f-b631-467e-a7c2-51f90e9583d1-root\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.673891 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.673819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a900a9f-b631-467e-a7c2-51f90e9583d1-metrics-client-ca\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.674140 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.673904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-wtmp\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.674140 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.673941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbkfm\" (UniqueName: \"kubernetes.io/projected/7a900a9f-b631-467e-a7c2-51f90e9583d1-kube-api-access-hbkfm\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.674140 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.673968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a900a9f-b631-467e-a7c2-51f90e9583d1-sys\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.674140 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.674029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.674140 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.674086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-wtmp\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.674411 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.674150    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-textfile\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.674411 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.674203    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a900a9f-b631-467e-a7c2-51f90e9583d1-sys\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.674507 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.674448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a900a9f-b631-467e-a7c2-51f90e9583d1-metrics-client-ca\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.674507 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.674472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.676342 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.676320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.676440 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.676352    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a900a9f-b631-467e-a7c2-51f90e9583d1-node-exporter-tls\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.682328 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.682305    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbkfm\" (UniqueName: \"kubernetes.io/projected/7a900a9f-b631-467e-a7c2-51f90e9583d1-kube-api-access-hbkfm\") pod \"node-exporter-m579m\" (UID: \"7a900a9f-b631-467e-a7c2-51f90e9583d1\") " pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.767011 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.766931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m579m"
Jul 23 21:52:51.778015 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:52:51.777983    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a900a9f_b631_467e_a7c2_51f90e9583d1.slice/crio-75c3fefc678c57533c1f8c0a7ca8da6f825a8f0c0720284f8d3ae5ae04834346 WatchSource:0}: Error finding container 75c3fefc678c57533c1f8c0a7ca8da6f825a8f0c0720284f8d3ae5ae04834346: Status 404 returned error can't find the container with id 75c3fefc678c57533c1f8c0a7ca8da6f825a8f0c0720284f8d3ae5ae04834346
Jul 23 21:52:51.997205 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:51.997166    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m579m" event={"ID":"7a900a9f-b631-467e-a7c2-51f90e9583d1","Type":"ContainerStarted","Data":"75c3fefc678c57533c1f8c0a7ca8da6f825a8f0c0720284f8d3ae5ae04834346"}
Jul 23 21:52:53.002339 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:53.002254    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a900a9f-b631-467e-a7c2-51f90e9583d1" containerID="d5a725117bd8cf2dbc60e8455fe6eeee59c67c02d69dff659dfb7627ac0734b7" exitCode=0
Jul 23 21:52:53.002339 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:53.002292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m579m" event={"ID":"7a900a9f-b631-467e-a7c2-51f90e9583d1","Type":"ContainerDied","Data":"d5a725117bd8cf2dbc60e8455fe6eeee59c67c02d69dff659dfb7627ac0734b7"}
Jul 23 21:52:53.070731 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:53.070705    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:54.007869 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:54.007834    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m579m" event={"ID":"7a900a9f-b631-467e-a7c2-51f90e9583d1","Type":"ContainerStarted","Data":"8e628672d09f21580dc64f282d5b5fba0ad5b9cc829a375f2e942ab8f2173961"}
Jul 23 21:52:54.008251 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:54.007892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m579m" event={"ID":"7a900a9f-b631-467e-a7c2-51f90e9583d1","Type":"ContainerStarted","Data":"e52c43b6275ac847cbebfbca9f6a4cf37edf08767a5523b862790b9983da37d9"}
Jul 23 21:52:54.027132 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:54.027084    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m579m" podStartSLOduration=2.021200568 podStartE2EDuration="3.027069223s" totalImagesPullingTime="941.32552ms" totalInitContainerRuntime="64.543135ms" isStatefulPod=true podCreationTimestamp="2026-07-23 21:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:52:54.026815138 +0000 UTC m=+78.061522676" watchObservedRunningTime="2026-07-23 21:52:54.027069223 +0000 UTC m=+78.061776762"
Jul 23 21:52:54.905830 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:54.905802    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-768bf9c6cf-2tsfw"
Jul 23 21:52:58.085452 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.085377    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb" podUID="578f4b1c-488c-4785-aec7-7d78ede6e712" containerName="registry" containerID="cri-o://ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8" gracePeriod=30
Jul 23 21:52:58.321483 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.321460    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:58.440060 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.439990    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls\") pod \"578f4b1c-488c-4785-aec7-7d78ede6e712\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") "
Jul 23 21:52:58.440060 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.440025    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-trusted-ca\") pod \"578f4b1c-488c-4785-aec7-7d78ede6e712\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") "
Jul 23 21:52:58.440060 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.440058    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-image-registry-private-configuration\") pod \"578f4b1c-488c-4785-aec7-7d78ede6e712\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") "
Jul 23 21:52:58.440293 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.440082    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-certificates\") pod \"578f4b1c-488c-4785-aec7-7d78ede6e712\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") "
Jul 23 21:52:58.440293 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.440105    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-installation-pull-secrets\") pod \"578f4b1c-488c-4785-aec7-7d78ede6e712\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") "
Jul 23 21:52:58.440293 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.440122    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/578f4b1c-488c-4785-aec7-7d78ede6e712-ca-trust-extracted\") pod \"578f4b1c-488c-4785-aec7-7d78ede6e712\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") "
Jul 23 21:52:58.440293 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.440141    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv6v7\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-kube-api-access-vv6v7\") pod \"578f4b1c-488c-4785-aec7-7d78ede6e712\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") "
Jul 23 21:52:58.440293 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.440163    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-bound-sa-token\") pod \"578f4b1c-488c-4785-aec7-7d78ede6e712\" (UID: \"578f4b1c-488c-4785-aec7-7d78ede6e712\") "
Jul 23 21:52:58.440961 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.440704    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "578f4b1c-488c-4785-aec7-7d78ede6e712" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 21:52:58.440961 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.440875    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "578f4b1c-488c-4785-aec7-7d78ede6e712" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 21:52:58.442561 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.442534    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "578f4b1c-488c-4785-aec7-7d78ede6e712" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 21:52:58.442658 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.442615    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "578f4b1c-488c-4785-aec7-7d78ede6e712" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 21:52:58.442904 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.442879    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "578f4b1c-488c-4785-aec7-7d78ede6e712" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 21:52:58.442965 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.442915    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-kube-api-access-vv6v7" (OuterVolumeSpecName: "kube-api-access-vv6v7") pod "578f4b1c-488c-4785-aec7-7d78ede6e712" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712"). InnerVolumeSpecName "kube-api-access-vv6v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 21:52:58.443014 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.442966    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "578f4b1c-488c-4785-aec7-7d78ede6e712" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 21:52:58.448915 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.448892    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/578f4b1c-488c-4785-aec7-7d78ede6e712-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "578f4b1c-488c-4785-aec7-7d78ede6e712" (UID: "578f4b1c-488c-4785-aec7-7d78ede6e712"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 21:52:58.541293 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.541267    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-tls\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:52:58.541293 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.541290    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-trusted-ca\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:52:58.541423 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.541300    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-image-registry-private-configuration\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:52:58.541423 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.541308    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/578f4b1c-488c-4785-aec7-7d78ede6e712-registry-certificates\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:52:58.541423 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.541317    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/578f4b1c-488c-4785-aec7-7d78ede6e712-installation-pull-secrets\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:52:58.541423 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.541329    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/578f4b1c-488c-4785-aec7-7d78ede6e712-ca-trust-extracted\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:52:58.541423 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.541340    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv6v7\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-kube-api-access-vv6v7\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:52:58.541423 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:58.541349    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/578f4b1c-488c-4785-aec7-7d78ede6e712-bound-sa-token\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:52:59.026596 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:59.026563    2565 generic.go:356] "Generic (PLEG): container finished" podID="578f4b1c-488c-4785-aec7-7d78ede6e712" containerID="ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8" exitCode=0
Jul 23 21:52:59.026736 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:59.026602    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb"
Jul 23 21:52:59.026736 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:59.026632    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb" event={"ID":"578f4b1c-488c-4785-aec7-7d78ede6e712","Type":"ContainerDied","Data":"ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8"}
Jul 23 21:52:59.026736 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:59.026671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b7d875c7f-nrsnb" event={"ID":"578f4b1c-488c-4785-aec7-7d78ede6e712","Type":"ContainerDied","Data":"aa6d7a5b119ff323e30694c976cfc45eb784ba1cb7d67c11eb126f1a1708c6c4"}
Jul 23 21:52:59.026736 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:59.026690    2565 scope.go:117] "RemoveContainer" containerID="ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8"
Jul 23 21:52:59.034493 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:59.034475    2565 scope.go:117] "RemoveContainer" containerID="ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8"
Jul 23 21:52:59.034802 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:52:59.034781    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8\": container with ID starting with ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8 not found: ID does not exist" containerID="ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8"
Jul 23 21:52:59.034868 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:59.034810    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8"} err="failed to get container status \"ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8\": rpc error: code = NotFound desc = could not find container \"ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8\": container with ID starting with ad6b695e9663586898696161569df96b57706f856b8feb5e3bbe4a578eee78f8 not found: ID does not exist"
Jul 23 21:52:59.043972 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:59.043948    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b7d875c7f-nrsnb"]
Jul 23 21:52:59.047460 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:52:59.047439    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b7d875c7f-nrsnb"]
Jul 23 21:53:00.480773 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:53:00.480740    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="578f4b1c-488c-4785-aec7-7d78ede6e712" path="/var/lib/kubelet/pods/578f4b1c-488c-4785-aec7-7d78ede6e712/volumes"
Jul 23 21:53:19.991872 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:53:19.991843    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w5jk7"
Jul 23 21:55:51.594509 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.594475    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"]
Jul 23 21:55:51.594993 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.594715    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="578f4b1c-488c-4785-aec7-7d78ede6e712" containerName="registry"
Jul 23 21:55:51.594993 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.594726    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="578f4b1c-488c-4785-aec7-7d78ede6e712" containerName="registry"
Jul 23 21:55:51.594993 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.594778    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="578f4b1c-488c-4785-aec7-7d78ede6e712" containerName="registry"
Jul 23 21:55:51.596544 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.596529    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.600327 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.600305    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 21:55:51.600327 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.600316    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 21:55:51.600536 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.600517    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 21:55:51.600791 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.600761    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 21:55:51.608201 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.608182    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zt4v2\""
Jul 23 21:55:51.616449 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.616428    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"]
Jul 23 21:55:51.758407 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.758377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1093003f-9d80-4fc7-bc8f-a85ee38573f2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.758407 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.758414    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1093003f-9d80-4fc7-bc8f-a85ee38573f2-manifests\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.758657 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.758457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1093003f-9d80-4fc7-bc8f-a85ee38573f2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.758657 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.758515    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28fk6\" (UniqueName: \"kubernetes.io/projected/1093003f-9d80-4fc7-bc8f-a85ee38573f2-kube-api-access-28fk6\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.758657 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.758604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1093003f-9d80-4fc7-bc8f-a85ee38573f2-tmp\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.860053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.859967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1093003f-9d80-4fc7-bc8f-a85ee38573f2-tmp\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.860053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.860016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1093003f-9d80-4fc7-bc8f-a85ee38573f2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.860053 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.860036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1093003f-9d80-4fc7-bc8f-a85ee38573f2-manifests\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.860375 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.860071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1093003f-9d80-4fc7-bc8f-a85ee38573f2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.860375 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.860095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28fk6\" (UniqueName: \"kubernetes.io/projected/1093003f-9d80-4fc7-bc8f-a85ee38573f2-kube-api-access-28fk6\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.861334 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.860908    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1093003f-9d80-4fc7-bc8f-a85ee38573f2-manifests\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.863442 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.863410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1093003f-9d80-4fc7-bc8f-a85ee38573f2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.866159 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.866133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1093003f-9d80-4fc7-bc8f-a85ee38573f2-tmp\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.866388 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.866365    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1093003f-9d80-4fc7-bc8f-a85ee38573f2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.873706 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.873687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28fk6\" (UniqueName: \"kubernetes.io/projected/1093003f-9d80-4fc7-bc8f-a85ee38573f2-kube-api-access-28fk6\") pod \"opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c\" (UID: \"1093003f-9d80-4fc7-bc8f-a85ee38573f2\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:51.906748 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:51.906717    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:52.041096 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:52.041038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"]
Jul 23 21:55:52.044198 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:55:52.044172    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1093003f_9d80_4fc7_bc8f_a85ee38573f2.slice/crio-59ed107f7806f95fb429d8aa0fdce8b504339620ff4c95644db2b09191ad1084 WatchSource:0}: Error finding container 59ed107f7806f95fb429d8aa0fdce8b504339620ff4c95644db2b09191ad1084: Status 404 returned error can't find the container with id 59ed107f7806f95fb429d8aa0fdce8b504339620ff4c95644db2b09191ad1084
Jul 23 21:55:52.595502 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:52.595465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c" event={"ID":"1093003f-9d80-4fc7-bc8f-a85ee38573f2","Type":"ContainerStarted","Data":"59ed107f7806f95fb429d8aa0fdce8b504339620ff4c95644db2b09191ad1084"}
Jul 23 21:55:55.608966 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:55.608932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c" event={"ID":"1093003f-9d80-4fc7-bc8f-a85ee38573f2","Type":"ContainerStarted","Data":"b2dbb9acf6ed3f8d9c1d4bd269b942d6d28152168e7d6194b7397fdf8b4858e5"}
Jul 23 21:55:56.613650 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:56.613619    2565 generic.go:356] "Generic (PLEG): container finished" podID="1093003f-9d80-4fc7-bc8f-a85ee38573f2" containerID="b2dbb9acf6ed3f8d9c1d4bd269b942d6d28152168e7d6194b7397fdf8b4858e5" exitCode=0
Jul 23 21:55:56.614033 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:56.613693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c" event={"ID":"1093003f-9d80-4fc7-bc8f-a85ee38573f2","Type":"ContainerDied","Data":"b2dbb9acf6ed3f8d9c1d4bd269b942d6d28152168e7d6194b7397fdf8b4858e5"}
Jul 23 21:55:57.621059 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:57.621019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c" event={"ID":"1093003f-9d80-4fc7-bc8f-a85ee38573f2","Type":"ContainerStarted","Data":"e9e7fc07e8c8985c0a12080fc183f38dff9d46c0f2ac1590d6ecbb6d44cbea35"}
Jul 23 21:55:57.621452 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:57.621129    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:55:57.646320 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:55:57.646258    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c" podStartSLOduration=2.265395518 podStartE2EDuration="6.646238189s" totalImagesPullingTime="3.29346691s" totalInitContainerRuntime="1.087375761s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:55:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:55:57.644858181 +0000 UTC m=+261.679565721" watchObservedRunningTime="2026-07-23 21:55:57.646238189 +0000 UTC m=+261.680945729"
Jul 23 21:56:08.626916 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:08.626834    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c"
Jul 23 21:56:12.382497 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.382448    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"]
Jul 23 21:56:12.391018 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.390995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"
Jul 23 21:56:12.396783 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.396761    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 21:56:12.397066 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.397035    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 21:56:12.398859 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.398835    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 21:56:12.399087 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.399065    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 21:56:12.399245 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.399122    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"]
Jul 23 21:56:12.408544 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.408513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmd86\" (UniqueName: \"kubernetes.io/projected/6e09906a-82fe-4223-9b67-9c6f71b54e86-kube-api-access-gmd86\") pod \"kube-auth-proxy-5dc6f65d97-w7985\" (UID: \"6e09906a-82fe-4223-9b67-9c6f71b54e86\") " pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"
Jul 23 21:56:12.408655 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.408557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e09906a-82fe-4223-9b67-9c6f71b54e86-tls-certs\") pod \"kube-auth-proxy-5dc6f65d97-w7985\" (UID: \"6e09906a-82fe-4223-9b67-9c6f71b54e86\") " pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"
Jul 23 21:56:12.408719 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.408656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e09906a-82fe-4223-9b67-9c6f71b54e86-tmp\") pod \"kube-auth-proxy-5dc6f65d97-w7985\" (UID: \"6e09906a-82fe-4223-9b67-9c6f71b54e86\") " pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"
Jul 23 21:56:12.509262 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.509224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e09906a-82fe-4223-9b67-9c6f71b54e86-tmp\") pod \"kube-auth-proxy-5dc6f65d97-w7985\" (UID: \"6e09906a-82fe-4223-9b67-9c6f71b54e86\") " pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"
Jul 23 21:56:12.509426 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.509305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmd86\" (UniqueName: \"kubernetes.io/projected/6e09906a-82fe-4223-9b67-9c6f71b54e86-kube-api-access-gmd86\") pod \"kube-auth-proxy-5dc6f65d97-w7985\" (UID: \"6e09906a-82fe-4223-9b67-9c6f71b54e86\") " pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"
Jul 23 21:56:12.509426 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.509335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e09906a-82fe-4223-9b67-9c6f71b54e86-tls-certs\") pod \"kube-auth-proxy-5dc6f65d97-w7985\" (UID: \"6e09906a-82fe-4223-9b67-9c6f71b54e86\") " pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"
Jul 23 21:56:12.511593 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.511572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e09906a-82fe-4223-9b67-9c6f71b54e86-tmp\") pod \"kube-auth-proxy-5dc6f65d97-w7985\" (UID: \"6e09906a-82fe-4223-9b67-9c6f71b54e86\") " pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"
Jul 23 21:56:12.511825 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.511803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e09906a-82fe-4223-9b67-9c6f71b54e86-tls-certs\") pod \"kube-auth-proxy-5dc6f65d97-w7985\" (UID: \"6e09906a-82fe-4223-9b67-9c6f71b54e86\") " pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"
Jul 23 21:56:12.526209 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.526184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmd86\" (UniqueName: \"kubernetes.io/projected/6e09906a-82fe-4223-9b67-9c6f71b54e86-kube-api-access-gmd86\") pod \"kube-auth-proxy-5dc6f65d97-w7985\" (UID: \"6e09906a-82fe-4223-9b67-9c6f71b54e86\") " pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"
Jul 23 21:56:12.550949 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.550923    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-brvfj"]
Jul 23 21:56:12.553102 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.553083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-brvfj"
Jul 23 21:56:12.557285 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.557264    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 23 21:56:12.557506 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.557483    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gh7wf\""
Jul 23 21:56:12.571431 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.571407    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-brvfj"]
Jul 23 21:56:12.610382 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.610349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65646dc6-bbb8-44ec-8b5c-297e8372aa69-cert\") pod \"odh-model-controller-7998c67dc4-brvfj\" (UID: \"65646dc6-bbb8-44ec-8b5c-297e8372aa69\") " pod="opendatahub/odh-model-controller-7998c67dc4-brvfj"
Jul 23 21:56:12.610563 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.610412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqp78\" (UniqueName: \"kubernetes.io/projected/65646dc6-bbb8-44ec-8b5c-297e8372aa69-kube-api-access-qqp78\") pod \"odh-model-controller-7998c67dc4-brvfj\" (UID: \"65646dc6-bbb8-44ec-8b5c-297e8372aa69\") " pod="opendatahub/odh-model-controller-7998c67dc4-brvfj"
Jul 23 21:56:12.701229 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.701136    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"
Jul 23 21:56:12.711541 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.711511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65646dc6-bbb8-44ec-8b5c-297e8372aa69-cert\") pod \"odh-model-controller-7998c67dc4-brvfj\" (UID: \"65646dc6-bbb8-44ec-8b5c-297e8372aa69\") " pod="opendatahub/odh-model-controller-7998c67dc4-brvfj"
Jul 23 21:56:12.711659 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.711574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqp78\" (UniqueName: \"kubernetes.io/projected/65646dc6-bbb8-44ec-8b5c-297e8372aa69-kube-api-access-qqp78\") pod \"odh-model-controller-7998c67dc4-brvfj\" (UID: \"65646dc6-bbb8-44ec-8b5c-297e8372aa69\") " pod="opendatahub/odh-model-controller-7998c67dc4-brvfj"
Jul 23 21:56:12.711705 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:56:12.711677    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 23 21:56:12.711788 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:56:12.711775    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65646dc6-bbb8-44ec-8b5c-297e8372aa69-cert podName:65646dc6-bbb8-44ec-8b5c-297e8372aa69 nodeName:}" failed. No retries permitted until 2026-07-23 21:56:13.211751144 +0000 UTC m=+277.246458680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/65646dc6-bbb8-44ec-8b5c-297e8372aa69-cert") pod "odh-model-controller-7998c67dc4-brvfj" (UID: "65646dc6-bbb8-44ec-8b5c-297e8372aa69") : secret "odh-model-controller-webhook-cert" not found
Jul 23 21:56:12.728530 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.728500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqp78\" (UniqueName: \"kubernetes.io/projected/65646dc6-bbb8-44ec-8b5c-297e8372aa69-kube-api-access-qqp78\") pod \"odh-model-controller-7998c67dc4-brvfj\" (UID: \"65646dc6-bbb8-44ec-8b5c-297e8372aa69\") " pod="opendatahub/odh-model-controller-7998c67dc4-brvfj"
Jul 23 21:56:12.859399 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:12.859374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985"]
Jul 23 21:56:12.862599 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:56:12.862559    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e09906a_82fe_4223_9b67_9c6f71b54e86.slice/crio-515763add30b816d4d372a334cc37db75c196bfce89eebaa8f465032ce59af5b WatchSource:0}: Error finding container 515763add30b816d4d372a334cc37db75c196bfce89eebaa8f465032ce59af5b: Status 404 returned error can't find the container with id 515763add30b816d4d372a334cc37db75c196bfce89eebaa8f465032ce59af5b
Jul 23 21:56:13.214818 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:13.214782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65646dc6-bbb8-44ec-8b5c-297e8372aa69-cert\") pod \"odh-model-controller-7998c67dc4-brvfj\" (UID: \"65646dc6-bbb8-44ec-8b5c-297e8372aa69\") " pod="opendatahub/odh-model-controller-7998c67dc4-brvfj"
Jul 23 21:56:13.220015 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:13.217447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65646dc6-bbb8-44ec-8b5c-297e8372aa69-cert\") pod \"odh-model-controller-7998c67dc4-brvfj\" (UID: \"65646dc6-bbb8-44ec-8b5c-297e8372aa69\") " pod="opendatahub/odh-model-controller-7998c67dc4-brvfj"
Jul 23 21:56:13.462940 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:13.462900    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-brvfj"
Jul 23 21:56:13.644875 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:13.644844    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-brvfj"]
Jul 23 21:56:13.648267 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:56:13.648235    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65646dc6_bbb8_44ec_8b5c_297e8372aa69.slice/crio-00c875c2ea384a352775d1536af65e7f974c7d108c9082ecbaae4bcc0306fa5d WatchSource:0}: Error finding container 00c875c2ea384a352775d1536af65e7f974c7d108c9082ecbaae4bcc0306fa5d: Status 404 returned error can't find the container with id 00c875c2ea384a352775d1536af65e7f974c7d108c9082ecbaae4bcc0306fa5d
Jul 23 21:56:13.678100 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:13.678034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-brvfj" event={"ID":"65646dc6-bbb8-44ec-8b5c-297e8372aa69","Type":"ContainerStarted","Data":"00c875c2ea384a352775d1536af65e7f974c7d108c9082ecbaae4bcc0306fa5d"}
Jul 23 21:56:13.679719 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:13.679687    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985" event={"ID":"6e09906a-82fe-4223-9b67-9c6f71b54e86","Type":"ContainerStarted","Data":"515763add30b816d4d372a334cc37db75c196bfce89eebaa8f465032ce59af5b"}
Jul 23 21:56:17.698526 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:17.698481    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-brvfj" event={"ID":"65646dc6-bbb8-44ec-8b5c-297e8372aa69","Type":"ContainerStarted","Data":"6ee5f876610dfb6d434c740ef96ca03aad4fd68f6bc19f829f6392dbde4fda23"}
Jul 23 21:56:17.699003 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:17.698716    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-brvfj"
Jul 23 21:56:17.699979 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:17.699955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985" event={"ID":"6e09906a-82fe-4223-9b67-9c6f71b54e86","Type":"ContainerStarted","Data":"26bce790a63c21c1aa79f5ff05212387e95d07b091057e8e778bd6e3ec950241"}
Jul 23 21:56:17.717359 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:17.717300    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-brvfj" podStartSLOduration=2.6362798229999997 podStartE2EDuration="5.717279242s" totalImagesPullingTime="3.080999419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:56:17.715895889 +0000 UTC m=+281.750603430" watchObservedRunningTime="2026-07-23 21:56:17.717279242 +0000 UTC m=+281.751986781"
Jul 23 21:56:17.734830 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:17.734778    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dc6f65d97-w7985" podStartSLOduration=1.907242036 podStartE2EDuration="5.734759139s" totalImagesPullingTime="3.827517103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:56:17.733555809 +0000 UTC m=+281.768263362" watchObservedRunningTime="2026-07-23 21:56:17.734759139 +0000 UTC m=+281.769466727"
Jul 23 21:56:18.187634 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.187593    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"]
Jul 23 21:56:18.190800 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.190781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.194311 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.194288    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 21:56:18.194453 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.194329    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 21:56:18.194453 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.194385    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 21:56:18.194637 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.194621    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 21:56:18.194716 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.194651    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jwz6v\""
Jul 23 21:56:18.194716 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.194682    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 21:56:18.201400 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.201375    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"]
Jul 23 21:56:18.258581 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.258544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb5475d5-7d42-491b-881c-8019b85155ef-metrics-cert\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.258775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.258593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccslc\" (UniqueName: \"kubernetes.io/projected/fb5475d5-7d42-491b-881c-8019b85155ef-kube-api-access-ccslc\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.258775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.258619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5475d5-7d42-491b-881c-8019b85155ef-cert\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.258775 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.258696    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fb5475d5-7d42-491b-881c-8019b85155ef-manager-config\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.359089 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.359050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fb5475d5-7d42-491b-881c-8019b85155ef-manager-config\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.359291 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.359104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb5475d5-7d42-491b-881c-8019b85155ef-metrics-cert\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.359291 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.359136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccslc\" (UniqueName: \"kubernetes.io/projected/fb5475d5-7d42-491b-881c-8019b85155ef-kube-api-access-ccslc\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.359291 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.359161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5475d5-7d42-491b-881c-8019b85155ef-cert\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.359989 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.359950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fb5475d5-7d42-491b-881c-8019b85155ef-manager-config\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.361828 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.361805    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5475d5-7d42-491b-881c-8019b85155ef-cert\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.361974 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.361951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb5475d5-7d42-491b-881c-8019b85155ef-metrics-cert\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.368648 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.368626    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccslc\" (UniqueName: \"kubernetes.io/projected/fb5475d5-7d42-491b-881c-8019b85155ef-kube-api-access-ccslc\") pod \"lws-controller-manager-66b46854f4-sxbbg\" (UID: \"fb5475d5-7d42-491b-881c-8019b85155ef\") " pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.500082 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.499992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:18.646356 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.646329    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"]
Jul 23 21:56:18.648692 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:56:18.648664    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5475d5_7d42_491b_881c_8019b85155ef.slice/crio-c085f6c8450851f271823889e68945310a700a60be24f8b71c21721b820ed8bb WatchSource:0}: Error finding container c085f6c8450851f271823889e68945310a700a60be24f8b71c21721b820ed8bb: Status 404 returned error can't find the container with id c085f6c8450851f271823889e68945310a700a60be24f8b71c21721b820ed8bb
Jul 23 21:56:18.706274 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:18.706236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg" event={"ID":"fb5475d5-7d42-491b-881c-8019b85155ef","Type":"ContainerStarted","Data":"c085f6c8450851f271823889e68945310a700a60be24f8b71c21721b820ed8bb"}
Jul 23 21:56:21.719673 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:21.719635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg" event={"ID":"fb5475d5-7d42-491b-881c-8019b85155ef","Type":"ContainerStarted","Data":"b3ea7f463bb474caab442477177aad9a8b73bd61c5d5df29d7810543cc708800"}
Jul 23 21:56:21.720091 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:21.719778    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:21.745081 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:21.745030    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg" podStartSLOduration=1.437587786 podStartE2EDuration="3.745017055s" totalImagesPullingTime="2.307429269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:56:21.742936938 +0000 UTC m=+285.777644475" watchObservedRunningTime="2026-07-23 21:56:21.745017055 +0000 UTC m=+285.779724594"
Jul 23 21:56:28.708663 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:28.708636    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-brvfj"
Jul 23 21:56:32.725113 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:32.725083    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66b46854f4-sxbbg"
Jul 23 21:56:36.356507 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:36.356457    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 21:56:36.357921 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:36.357897    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 21:56:36.360988 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:56:36.360969    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 21:58:49.639115 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:49.639079    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zjlxf"]
Jul 23 21:58:49.641207 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:49.641189    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zjlxf"
Jul 23 21:58:49.643947 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:49.643923    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mh59l\""
Jul 23 21:58:49.644899 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:49.644875    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 21:58:49.644987 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:49.644965    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 21:58:49.651462 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:49.651439    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zjlxf"]
Jul 23 21:58:49.733011 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:49.732982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss45k\" (UniqueName: \"kubernetes.io/projected/01df18ad-9543-4886-b7a0-ecda15b49545-kube-api-access-ss45k\") pod \"authorino-58cd955675-zjlxf\" (UID: \"01df18ad-9543-4886-b7a0-ecda15b49545\") " pod="kuadrant-system/authorino-58cd955675-zjlxf"
Jul 23 21:58:49.833475 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:49.833444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss45k\" (UniqueName: \"kubernetes.io/projected/01df18ad-9543-4886-b7a0-ecda15b49545-kube-api-access-ss45k\") pod \"authorino-58cd955675-zjlxf\" (UID: \"01df18ad-9543-4886-b7a0-ecda15b49545\") " pod="kuadrant-system/authorino-58cd955675-zjlxf"
Jul 23 21:58:49.845507 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:49.845476    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss45k\" (UniqueName: \"kubernetes.io/projected/01df18ad-9543-4886-b7a0-ecda15b49545-kube-api-access-ss45k\") pod \"authorino-58cd955675-zjlxf\" (UID: \"01df18ad-9543-4886-b7a0-ecda15b49545\") " pod="kuadrant-system/authorino-58cd955675-zjlxf"
Jul 23 21:58:49.950504 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:49.950442    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zjlxf"
Jul 23 21:58:50.068823 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:50.068796    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zjlxf"]
Jul 23 21:58:50.071308 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:58:50.071275    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01df18ad_9543_4886_b7a0_ecda15b49545.slice/crio-2ee2ac0135d705a4fdf39855f7506a84ff9c67232f4ffd86df34b1d333f509c4 WatchSource:0}: Error finding container 2ee2ac0135d705a4fdf39855f7506a84ff9c67232f4ffd86df34b1d333f509c4: Status 404 returned error can't find the container with id 2ee2ac0135d705a4fdf39855f7506a84ff9c67232f4ffd86df34b1d333f509c4
Jul 23 21:58:50.072676 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:50.072654    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 21:58:50.236729 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:50.236649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zjlxf" event={"ID":"01df18ad-9543-4886-b7a0-ecda15b49545","Type":"ContainerStarted","Data":"2ee2ac0135d705a4fdf39855f7506a84ff9c67232f4ffd86df34b1d333f509c4"}
Jul 23 21:58:53.251714 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:53.251676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zjlxf" event={"ID":"01df18ad-9543-4886-b7a0-ecda15b49545","Type":"ContainerStarted","Data":"5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c"}
Jul 23 21:58:53.268409 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:53.268351    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zjlxf" podStartSLOduration=1.19088611 podStartE2EDuration="4.268334718s" totalImagesPullingTime="3.077448608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:58:53.267887439 +0000 UTC m=+437.302594979" watchObservedRunningTime="2026-07-23 21:58:53.268334718 +0000 UTC m=+437.303042257"
Jul 23 21:58:54.816641 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:54.816611    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zjlxf"]
Jul 23 21:58:55.258389 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:55.258284    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zjlxf" podUID="01df18ad-9543-4886-b7a0-ecda15b49545" containerName="authorino" containerID="cri-o://5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c" gracePeriod=30
Jul 23 21:58:55.496608 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:55.496583    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zjlxf"
Jul 23 21:58:55.582175 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:55.582145    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss45k\" (UniqueName: \"kubernetes.io/projected/01df18ad-9543-4886-b7a0-ecda15b49545-kube-api-access-ss45k\") pod \"01df18ad-9543-4886-b7a0-ecda15b49545\" (UID: \"01df18ad-9543-4886-b7a0-ecda15b49545\") "
Jul 23 21:58:55.584385 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:55.584361    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01df18ad-9543-4886-b7a0-ecda15b49545-kube-api-access-ss45k" (OuterVolumeSpecName: "kube-api-access-ss45k") pod "01df18ad-9543-4886-b7a0-ecda15b49545" (UID: "01df18ad-9543-4886-b7a0-ecda15b49545"). InnerVolumeSpecName "kube-api-access-ss45k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 21:58:55.683312 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:55.683271    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss45k\" (UniqueName: \"kubernetes.io/projected/01df18ad-9543-4886-b7a0-ecda15b49545-kube-api-access-ss45k\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:58:56.264089 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:56.264054    2565 generic.go:356] "Generic (PLEG): container finished" podID="01df18ad-9543-4886-b7a0-ecda15b49545" containerID="5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c" exitCode=0
Jul 23 21:58:56.264089 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:56.264091    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zjlxf"
Jul 23 21:58:56.264572 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:56.264140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zjlxf" event={"ID":"01df18ad-9543-4886-b7a0-ecda15b49545","Type":"ContainerDied","Data":"5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c"}
Jul 23 21:58:56.264572 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:56.264181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zjlxf" event={"ID":"01df18ad-9543-4886-b7a0-ecda15b49545","Type":"ContainerDied","Data":"2ee2ac0135d705a4fdf39855f7506a84ff9c67232f4ffd86df34b1d333f509c4"}
Jul 23 21:58:56.264572 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:56.264200    2565 scope.go:117] "RemoveContainer" containerID="5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c"
Jul 23 21:58:56.272857 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:56.272840    2565 scope.go:117] "RemoveContainer" containerID="5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c"
Jul 23 21:58:56.273119 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:58:56.273099    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c\": container with ID starting with 5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c not found: ID does not exist" containerID="5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c"
Jul 23 21:58:56.273179 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:56.273131    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c"} err="failed to get container status \"5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c\": rpc error: code = NotFound desc = could not find container \"5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c\": container with ID starting with 5cf88e2956e4a044c6560bf1c2b4b41211685e379959d4b7deef24816503947c not found: ID does not exist"
Jul 23 21:58:56.286407 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:56.286382    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zjlxf"]
Jul 23 21:58:56.290174 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:56.290155    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zjlxf"]
Jul 23 21:58:56.480824 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:58:56.480792    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01df18ad-9543-4886-b7a0-ecda15b49545" path="/var/lib/kubelet/pods/01df18ad-9543-4886-b7a0-ecda15b49545/volumes"
Jul 23 21:59:17.485740 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.485710    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cqnfq"]
Jul 23 21:59:17.486186 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.486090    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01df18ad-9543-4886-b7a0-ecda15b49545" containerName="authorino"
Jul 23 21:59:17.486186 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.486107    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="01df18ad-9543-4886-b7a0-ecda15b49545" containerName="authorino"
Jul 23 21:59:17.486186 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.486179    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="01df18ad-9543-4886-b7a0-ecda15b49545" containerName="authorino"
Jul 23 21:59:17.490080 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.490058    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cqnfq"
Jul 23 21:59:17.492531 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.492511    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 21:59:17.492664 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.492552    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mh59l\""
Jul 23 21:59:17.493633 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.493619    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 21:59:17.499849 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.499820    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cqnfq"]
Jul 23 21:59:17.661047 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.661010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhd89\" (UniqueName: \"kubernetes.io/projected/eac72200-7b05-4b36-9ea5-499d06858424-kube-api-access-vhd89\") pod \"authorino-5d4b67c446-cqnfq\" (UID: \"eac72200-7b05-4b36-9ea5-499d06858424\") " pod="kuadrant-system/authorino-5d4b67c446-cqnfq"
Jul 23 21:59:17.737971 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.737880    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cqnfq"]
Jul 23 21:59:17.738150 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:59:17.738128    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vhd89], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-cqnfq" podUID="eac72200-7b05-4b36-9ea5-499d06858424"
Jul 23 21:59:17.761891 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.761860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhd89\" (UniqueName: \"kubernetes.io/projected/eac72200-7b05-4b36-9ea5-499d06858424-kube-api-access-vhd89\") pod \"authorino-5d4b67c446-cqnfq\" (UID: \"eac72200-7b05-4b36-9ea5-499d06858424\") " pod="kuadrant-system/authorino-5d4b67c446-cqnfq"
Jul 23 21:59:17.765530 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.765507    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5748688446-flhwk"]
Jul 23 21:59:17.767363 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.767348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5748688446-flhwk"
Jul 23 21:59:17.771655 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.771632    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhd89\" (UniqueName: \"kubernetes.io/projected/eac72200-7b05-4b36-9ea5-499d06858424-kube-api-access-vhd89\") pod \"authorino-5d4b67c446-cqnfq\" (UID: \"eac72200-7b05-4b36-9ea5-499d06858424\") " pod="kuadrant-system/authorino-5d4b67c446-cqnfq"
Jul 23 21:59:17.779422 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.779293    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5748688446-flhwk"]
Jul 23 21:59:17.863187 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.863138    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlkd2\" (UniqueName: \"kubernetes.io/projected/8801f77d-4427-4557-8318-373db097a104-kube-api-access-wlkd2\") pod \"authorino-5748688446-flhwk\" (UID: \"8801f77d-4427-4557-8318-373db097a104\") " pod="kuadrant-system/authorino-5748688446-flhwk"
Jul 23 21:59:17.941814 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.941781    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5748688446-flhwk"]
Jul 23 21:59:17.941999 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:59:17.941982    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wlkd2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5748688446-flhwk" podUID="8801f77d-4427-4557-8318-373db097a104"
Jul 23 21:59:17.963808 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.963772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlkd2\" (UniqueName: \"kubernetes.io/projected/8801f77d-4427-4557-8318-373db097a104-kube-api-access-wlkd2\") pod \"authorino-5748688446-flhwk\" (UID: \"8801f77d-4427-4557-8318-373db097a104\") " pod="kuadrant-system/authorino-5748688446-flhwk"
Jul 23 21:59:17.979109 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:17.979076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlkd2\" (UniqueName: \"kubernetes.io/projected/8801f77d-4427-4557-8318-373db097a104-kube-api-access-wlkd2\") pod \"authorino-5748688446-flhwk\" (UID: \"8801f77d-4427-4557-8318-373db097a104\") " pod="kuadrant-system/authorino-5748688446-flhwk"
Jul 23 21:59:18.344298 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:18.344267    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5748688446-flhwk"
Jul 23 21:59:18.344298 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:18.344279    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cqnfq"
Jul 23 21:59:18.350029 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:18.350009    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5748688446-flhwk"
Jul 23 21:59:18.352679 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:18.352664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cqnfq"
Jul 23 21:59:18.365481 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:18.365453    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhd89\" (UniqueName: \"kubernetes.io/projected/eac72200-7b05-4b36-9ea5-499d06858424-kube-api-access-vhd89\") pod \"eac72200-7b05-4b36-9ea5-499d06858424\" (UID: \"eac72200-7b05-4b36-9ea5-499d06858424\") "
Jul 23 21:59:18.367423 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:18.367401    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eac72200-7b05-4b36-9ea5-499d06858424-kube-api-access-vhd89" (OuterVolumeSpecName: "kube-api-access-vhd89") pod "eac72200-7b05-4b36-9ea5-499d06858424" (UID: "eac72200-7b05-4b36-9ea5-499d06858424"). InnerVolumeSpecName "kube-api-access-vhd89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 21:59:18.466311 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:18.466279    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlkd2\" (UniqueName: \"kubernetes.io/projected/8801f77d-4427-4557-8318-373db097a104-kube-api-access-wlkd2\") pod \"8801f77d-4427-4557-8318-373db097a104\" (UID: \"8801f77d-4427-4557-8318-373db097a104\") "
Jul 23 21:59:18.466494 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:18.466435    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhd89\" (UniqueName: \"kubernetes.io/projected/eac72200-7b05-4b36-9ea5-499d06858424-kube-api-access-vhd89\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:59:18.468385 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:18.468361    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8801f77d-4427-4557-8318-373db097a104-kube-api-access-wlkd2" (OuterVolumeSpecName: "kube-api-access-wlkd2") pod "8801f77d-4427-4557-8318-373db097a104" (UID: "8801f77d-4427-4557-8318-373db097a104"). InnerVolumeSpecName "kube-api-access-wlkd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 21:59:18.567425 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:18.567392    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlkd2\" (UniqueName: \"kubernetes.io/projected/8801f77d-4427-4557-8318-373db097a104-kube-api-access-wlkd2\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:59:19.347284 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:19.347258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5748688446-flhwk"
Jul 23 21:59:19.347458 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:19.347258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cqnfq"
Jul 23 21:59:19.379204 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:19.379174    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cqnfq"]
Jul 23 21:59:19.383013 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:19.382991    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cqnfq"]
Jul 23 21:59:19.405904 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:19.405871    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5748688446-flhwk"]
Jul 23 21:59:19.411679 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:19.411655    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5748688446-flhwk"]
Jul 23 21:59:20.480570 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:20.480538    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8801f77d-4427-4557-8318-373db097a104" path="/var/lib/kubelet/pods/8801f77d-4427-4557-8318-373db097a104/volumes"
Jul 23 21:59:20.480957 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:20.480731    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eac72200-7b05-4b36-9ea5-499d06858424" path="/var/lib/kubelet/pods/eac72200-7b05-4b36-9ea5-499d06858424/volumes"
Jul 23 21:59:24.947290 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:24.947257    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-lvlfd"]
Jul 23 21:59:24.950576 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:24.950560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:24.954389 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:24.954369    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b7jzw\""
Jul 23 21:59:24.954548 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:24.954531    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 21:59:24.972010 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:24.971985    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 21:59:24.985397 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:24.985373    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-lvlfd"]
Jul 23 21:59:25.008535 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.008502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64vs2\" (UniqueName: \"kubernetes.io/projected/539a805f-c6dd-49f5-89da-ba60ae13e754-kube-api-access-64vs2\") pod \"maas-controller-b9fbb96bd-lvlfd\" (UID: \"539a805f-c6dd-49f5-89da-ba60ae13e754\") " pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:25.008671 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.008559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/539a805f-c6dd-49f5-89da-ba60ae13e754-webhook-cert\") pod \"maas-controller-b9fbb96bd-lvlfd\" (UID: \"539a805f-c6dd-49f5-89da-ba60ae13e754\") " pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:25.108954 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.108917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/539a805f-c6dd-49f5-89da-ba60ae13e754-webhook-cert\") pod \"maas-controller-b9fbb96bd-lvlfd\" (UID: \"539a805f-c6dd-49f5-89da-ba60ae13e754\") " pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:25.109116 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.108983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64vs2\" (UniqueName: \"kubernetes.io/projected/539a805f-c6dd-49f5-89da-ba60ae13e754-kube-api-access-64vs2\") pod \"maas-controller-b9fbb96bd-lvlfd\" (UID: \"539a805f-c6dd-49f5-89da-ba60ae13e754\") " pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:25.111459 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.111439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/539a805f-c6dd-49f5-89da-ba60ae13e754-webhook-cert\") pod \"maas-controller-b9fbb96bd-lvlfd\" (UID: \"539a805f-c6dd-49f5-89da-ba60ae13e754\") " pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:25.118291 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.118268    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64vs2\" (UniqueName: \"kubernetes.io/projected/539a805f-c6dd-49f5-89da-ba60ae13e754-kube-api-access-64vs2\") pod \"maas-controller-b9fbb96bd-lvlfd\" (UID: \"539a805f-c6dd-49f5-89da-ba60ae13e754\") " pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:25.182691 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.182647    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5764b54ddf-nqvf4"]
Jul 23 21:59:25.185944 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.185924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 21:59:25.195927 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.195902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-nqvf4"]
Jul 23 21:59:25.210085 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.209966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbcpl\" (UniqueName: \"kubernetes.io/projected/71d8f84f-0f33-4ff7-a0a2-2060d156c686-kube-api-access-mbcpl\") pod \"maas-controller-5764b54ddf-nqvf4\" (UID: \"71d8f84f-0f33-4ff7-a0a2-2060d156c686\") " pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 21:59:25.210085 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.210036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71d8f84f-0f33-4ff7-a0a2-2060d156c686-webhook-cert\") pod \"maas-controller-5764b54ddf-nqvf4\" (UID: \"71d8f84f-0f33-4ff7-a0a2-2060d156c686\") " pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 21:59:25.260232 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.260193    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:25.310935 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.310904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71d8f84f-0f33-4ff7-a0a2-2060d156c686-webhook-cert\") pod \"maas-controller-5764b54ddf-nqvf4\" (UID: \"71d8f84f-0f33-4ff7-a0a2-2060d156c686\") " pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 21:59:25.311078 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.311006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbcpl\" (UniqueName: \"kubernetes.io/projected/71d8f84f-0f33-4ff7-a0a2-2060d156c686-kube-api-access-mbcpl\") pod \"maas-controller-5764b54ddf-nqvf4\" (UID: \"71d8f84f-0f33-4ff7-a0a2-2060d156c686\") " pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 21:59:25.313678 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.313632    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71d8f84f-0f33-4ff7-a0a2-2060d156c686-webhook-cert\") pod \"maas-controller-5764b54ddf-nqvf4\" (UID: \"71d8f84f-0f33-4ff7-a0a2-2060d156c686\") " pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 21:59:25.321232 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.321184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbcpl\" (UniqueName: \"kubernetes.io/projected/71d8f84f-0f33-4ff7-a0a2-2060d156c686-kube-api-access-mbcpl\") pod \"maas-controller-5764b54ddf-nqvf4\" (UID: \"71d8f84f-0f33-4ff7-a0a2-2060d156c686\") " pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 21:59:25.392239 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.392165    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-lvlfd"]
Jul 23 21:59:25.395525 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:59:25.395498    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539a805f_c6dd_49f5_89da_ba60ae13e754.slice/crio-20d41f79a7ac20a6822811a2e6e312722a4936ae59c970f7d50729968fa157b4 WatchSource:0}: Error finding container 20d41f79a7ac20a6822811a2e6e312722a4936ae59c970f7d50729968fa157b4: Status 404 returned error can't find the container with id 20d41f79a7ac20a6822811a2e6e312722a4936ae59c970f7d50729968fa157b4
Jul 23 21:59:25.496240 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.496127    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 21:59:25.625203 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:25.625180    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-nqvf4"]
Jul 23 21:59:25.627162 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:59:25.627136    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d8f84f_0f33_4ff7_a0a2_2060d156c686.slice/crio-232ae7a2a5de8bdce130c451832d3abdfe083f03ed2df4a7390c4f45a55c70bd WatchSource:0}: Error finding container 232ae7a2a5de8bdce130c451832d3abdfe083f03ed2df4a7390c4f45a55c70bd: Status 404 returned error can't find the container with id 232ae7a2a5de8bdce130c451832d3abdfe083f03ed2df4a7390c4f45a55c70bd
Jul 23 21:59:26.376478 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:26.376392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd" event={"ID":"539a805f-c6dd-49f5-89da-ba60ae13e754","Type":"ContainerStarted","Data":"20d41f79a7ac20a6822811a2e6e312722a4936ae59c970f7d50729968fa157b4"}
Jul 23 21:59:26.378630 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:26.378596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5764b54ddf-nqvf4" event={"ID":"71d8f84f-0f33-4ff7-a0a2-2060d156c686","Type":"ContainerStarted","Data":"232ae7a2a5de8bdce130c451832d3abdfe083f03ed2df4a7390c4f45a55c70bd"}
Jul 23 21:59:28.389575 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:28.389523    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd" event={"ID":"539a805f-c6dd-49f5-89da-ba60ae13e754","Type":"ContainerStarted","Data":"4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7"}
Jul 23 21:59:28.390074 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:28.389605    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:28.391465 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:28.391436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5764b54ddf-nqvf4" event={"ID":"71d8f84f-0f33-4ff7-a0a2-2060d156c686","Type":"ContainerStarted","Data":"fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac"}
Jul 23 21:59:28.391640 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:28.391569    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 21:59:28.426079 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:28.426034    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd" podStartSLOduration=1.843865676 podStartE2EDuration="4.426018094s" totalImagesPullingTime="2.582152418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:59:28.424771917 +0000 UTC m=+472.459479468" watchObservedRunningTime="2026-07-23 21:59:28.426018094 +0000 UTC m=+472.460725632"
Jul 23 21:59:28.485678 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:28.485628    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5764b54ddf-nqvf4" podStartSLOduration=1.128815663 podStartE2EDuration="3.485611166s" totalImagesPullingTime="2.356795503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:59:28.483289991 +0000 UTC m=+472.517997530" watchObservedRunningTime="2026-07-23 21:59:28.485611166 +0000 UTC m=+472.520318704"
Jul 23 21:59:39.397617 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:39.397587    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 21:59:39.398097 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:39.397661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:39.469446 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:39.469416    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-lvlfd"]
Jul 23 21:59:39.469644 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:39.469606    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd" podUID="539a805f-c6dd-49f5-89da-ba60ae13e754" containerName="manager" containerID="cri-o://4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7" gracePeriod=30
Jul 23 21:59:39.700738 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:39.700715    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:39.710602 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:39.710573    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64vs2\" (UniqueName: \"kubernetes.io/projected/539a805f-c6dd-49f5-89da-ba60ae13e754-kube-api-access-64vs2\") pod \"539a805f-c6dd-49f5-89da-ba60ae13e754\" (UID: \"539a805f-c6dd-49f5-89da-ba60ae13e754\") "
Jul 23 21:59:39.710744 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:39.710661    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/539a805f-c6dd-49f5-89da-ba60ae13e754-webhook-cert\") pod \"539a805f-c6dd-49f5-89da-ba60ae13e754\" (UID: \"539a805f-c6dd-49f5-89da-ba60ae13e754\") "
Jul 23 21:59:39.712701 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:39.712673    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/539a805f-c6dd-49f5-89da-ba60ae13e754-kube-api-access-64vs2" (OuterVolumeSpecName: "kube-api-access-64vs2") pod "539a805f-c6dd-49f5-89da-ba60ae13e754" (UID: "539a805f-c6dd-49f5-89da-ba60ae13e754"). InnerVolumeSpecName "kube-api-access-64vs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 21:59:39.712792 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:39.712673    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/539a805f-c6dd-49f5-89da-ba60ae13e754-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "539a805f-c6dd-49f5-89da-ba60ae13e754" (UID: "539a805f-c6dd-49f5-89da-ba60ae13e754"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 21:59:39.811724 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:39.811692    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/539a805f-c6dd-49f5-89da-ba60ae13e754-webhook-cert\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:59:39.811724 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:39.811718    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64vs2\" (UniqueName: \"kubernetes.io/projected/539a805f-c6dd-49f5-89da-ba60ae13e754-kube-api-access-64vs2\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 21:59:40.437522 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:40.437484    2565 generic.go:356] "Generic (PLEG): container finished" podID="539a805f-c6dd-49f5-89da-ba60ae13e754" containerID="4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7" exitCode=0
Jul 23 21:59:40.437890 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:40.437528    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd"
Jul 23 21:59:40.437890 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:40.437572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd" event={"ID":"539a805f-c6dd-49f5-89da-ba60ae13e754","Type":"ContainerDied","Data":"4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7"}
Jul 23 21:59:40.437890 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:40.437624    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9fbb96bd-lvlfd" event={"ID":"539a805f-c6dd-49f5-89da-ba60ae13e754","Type":"ContainerDied","Data":"20d41f79a7ac20a6822811a2e6e312722a4936ae59c970f7d50729968fa157b4"}
Jul 23 21:59:40.437890 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:40.437647    2565 scope.go:117] "RemoveContainer" containerID="4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7"
Jul 23 21:59:40.446339 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:40.446322    2565 scope.go:117] "RemoveContainer" containerID="4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7"
Jul 23 21:59:40.446597 ip-10-0-134-91 kubenswrapper[2565]: E0723 21:59:40.446580    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7\": container with ID starting with 4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7 not found: ID does not exist" containerID="4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7"
Jul 23 21:59:40.446641 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:40.446605    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7"} err="failed to get container status \"4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7\": rpc error: code = NotFound desc = could not find container \"4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7\": container with ID starting with 4924259c6f431eff94c5a4b5795a352e254c5f389278fe185c4a99dbe90a8ad7 not found: ID does not exist"
Jul 23 21:59:40.466151 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:40.466125    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-lvlfd"]
Jul 23 21:59:40.470577 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:40.470559    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-lvlfd"]
Jul 23 21:59:40.481285 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:40.481265    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="539a805f-c6dd-49f5-89da-ba60ae13e754" path="/var/lib/kubelet/pods/539a805f-c6dd-49f5-89da-ba60ae13e754/volumes"
Jul 23 21:59:58.810485 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.810448    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"]
Jul 23 21:59:58.810956 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.810748    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="539a805f-c6dd-49f5-89da-ba60ae13e754" containerName="manager"
Jul 23 21:59:58.810956 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.810762    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="539a805f-c6dd-49f5-89da-ba60ae13e754" containerName="manager"
Jul 23 21:59:58.810956 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.810810    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="539a805f-c6dd-49f5-89da-ba60ae13e754" containerName="manager"
Jul 23 21:59:58.815131 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.815114    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 21:59:58.821643 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.821388    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 21:59:58.821643 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.821390    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 21:59:58.821643 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.821437    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nz9df\""
Jul 23 21:59:58.821845 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.821829    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 21:59:58.828955 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.828929    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"]
Jul 23 21:59:58.831568 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.831545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2j8l\" (UniqueName: \"kubernetes.io/projected/b8b98248-50ec-4f97-9a70-f58454d60305-kube-api-access-r2j8l\") pod \"maas-api-79b7dbcf5c-tqwrh\" (UID: \"b8b98248-50ec-4f97-9a70-f58454d60305\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 21:59:58.831693 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.831579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8b98248-50ec-4f97-9a70-f58454d60305-maas-api-tls\") pod \"maas-api-79b7dbcf5c-tqwrh\" (UID: \"b8b98248-50ec-4f97-9a70-f58454d60305\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 21:59:58.831693 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.831602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b98248-50ec-4f97-9a70-f58454d60305-openshift-service-ca\") pod \"maas-api-79b7dbcf5c-tqwrh\" (UID: \"b8b98248-50ec-4f97-9a70-f58454d60305\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 21:59:58.932116 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.932073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2j8l\" (UniqueName: \"kubernetes.io/projected/b8b98248-50ec-4f97-9a70-f58454d60305-kube-api-access-r2j8l\") pod \"maas-api-79b7dbcf5c-tqwrh\" (UID: \"b8b98248-50ec-4f97-9a70-f58454d60305\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 21:59:58.932332 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.932124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8b98248-50ec-4f97-9a70-f58454d60305-maas-api-tls\") pod \"maas-api-79b7dbcf5c-tqwrh\" (UID: \"b8b98248-50ec-4f97-9a70-f58454d60305\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 21:59:58.932332 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.932149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b98248-50ec-4f97-9a70-f58454d60305-openshift-service-ca\") pod \"maas-api-79b7dbcf5c-tqwrh\" (UID: \"b8b98248-50ec-4f97-9a70-f58454d60305\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 21:59:58.932832 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.932807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b98248-50ec-4f97-9a70-f58454d60305-openshift-service-ca\") pod \"maas-api-79b7dbcf5c-tqwrh\" (UID: \"b8b98248-50ec-4f97-9a70-f58454d60305\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 21:59:58.934532 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.934511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8b98248-50ec-4f97-9a70-f58454d60305-maas-api-tls\") pod \"maas-api-79b7dbcf5c-tqwrh\" (UID: \"b8b98248-50ec-4f97-9a70-f58454d60305\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 21:59:58.940531 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:58.940505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2j8l\" (UniqueName: \"kubernetes.io/projected/b8b98248-50ec-4f97-9a70-f58454d60305-kube-api-access-r2j8l\") pod \"maas-api-79b7dbcf5c-tqwrh\" (UID: \"b8b98248-50ec-4f97-9a70-f58454d60305\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 21:59:59.125367 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.125286    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 21:59:59.274980 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.274947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"]
Jul 23 21:59:59.278708 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:59:59.278679    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b98248_50ec_4f97_9a70_f58454d60305.slice/crio-b6cd7f94e67227d46a84cc132d9060579920d046a86cefdb3f295e7ab41ebd25 WatchSource:0}: Error finding container b6cd7f94e67227d46a84cc132d9060579920d046a86cefdb3f295e7ab41ebd25: Status 404 returned error can't find the container with id b6cd7f94e67227d46a84cc132d9060579920d046a86cefdb3f295e7ab41ebd25
Jul 23 21:59:59.464954 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.464883    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"]
Jul 23 21:59:59.469415 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.469395    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"
Jul 23 21:59:59.472676 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.472660    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 21:59:59.501781 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.501755    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"]
Jul 23 21:59:59.518490 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.518462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh" event={"ID":"b8b98248-50ec-4f97-9a70-f58454d60305","Type":"ContainerStarted","Data":"b6cd7f94e67227d46a84cc132d9060579920d046a86cefdb3f295e7ab41ebd25"}
Jul 23 21:59:59.537305 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.537273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsrpv\" (UniqueName: \"kubernetes.io/projected/429a86ce-fca9-4355-97dd-a424234d2937-kube-api-access-zsrpv\") pod \"payload-pre-processing-7677b774bb-zrgwh\" (UID: \"429a86ce-fca9-4355-97dd-a424234d2937\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"
Jul 23 21:59:59.537440 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.537321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/429a86ce-fca9-4355-97dd-a424234d2937-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-zrgwh\" (UID: \"429a86ce-fca9-4355-97dd-a424234d2937\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"
Jul 23 21:59:59.638654 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.638616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/429a86ce-fca9-4355-97dd-a424234d2937-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-zrgwh\" (UID: \"429a86ce-fca9-4355-97dd-a424234d2937\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"
Jul 23 21:59:59.638816 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.638706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsrpv\" (UniqueName: \"kubernetes.io/projected/429a86ce-fca9-4355-97dd-a424234d2937-kube-api-access-zsrpv\") pod \"payload-pre-processing-7677b774bb-zrgwh\" (UID: \"429a86ce-fca9-4355-97dd-a424234d2937\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"
Jul 23 21:59:59.639332 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.639312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/429a86ce-fca9-4355-97dd-a424234d2937-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-zrgwh\" (UID: \"429a86ce-fca9-4355-97dd-a424234d2937\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"
Jul 23 21:59:59.659561 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.659535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsrpv\" (UniqueName: \"kubernetes.io/projected/429a86ce-fca9-4355-97dd-a424234d2937-kube-api-access-zsrpv\") pod \"payload-pre-processing-7677b774bb-zrgwh\" (UID: \"429a86ce-fca9-4355-97dd-a424234d2937\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"
Jul 23 21:59:59.779156 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.779129    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"
Jul 23 21:59:59.905235 ip-10-0-134-91 kubenswrapper[2565]: I0723 21:59:59.905183    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"]
Jul 23 21:59:59.908753 ip-10-0-134-91 kubenswrapper[2565]: W0723 21:59:59.908726    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429a86ce_fca9_4355_97dd_a424234d2937.slice/crio-da4041359fc98777d911ba0b601ab1ef98b79bdeaf90854c41f964959f0c0881 WatchSource:0}: Error finding container da4041359fc98777d911ba0b601ab1ef98b79bdeaf90854c41f964959f0c0881: Status 404 returned error can't find the container with id da4041359fc98777d911ba0b601ab1ef98b79bdeaf90854c41f964959f0c0881
Jul 23 22:00:00.524954 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:00.524886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh" event={"ID":"429a86ce-fca9-4355-97dd-a424234d2937","Type":"ContainerStarted","Data":"da4041359fc98777d911ba0b601ab1ef98b79bdeaf90854c41f964959f0c0881"}
Jul 23 22:00:01.531674 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:01.531638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh" event={"ID":"b8b98248-50ec-4f97-9a70-f58454d60305","Type":"ContainerStarted","Data":"9ad41984c44122df9cc6ba2a6bbb85afd02298bf00e3a13dc8988d8f0a909073"}
Jul 23 22:00:01.532100 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:01.531790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 22:00:01.556084 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:01.556030    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh" podStartSLOduration=1.934496091 podStartE2EDuration="3.556011766s" totalImagesPullingTime="1.621515675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:00:01.554374462 +0000 UTC m=+505.589082003" watchObservedRunningTime="2026-07-23 22:00:01.556011766 +0000 UTC m=+505.590719306"
Jul 23 22:00:02.537830 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:02.537793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh" event={"ID":"429a86ce-fca9-4355-97dd-a424234d2937","Type":"ContainerStarted","Data":"77012d546637db23c0639143f2d1e117688a385f286c323536d77c34d037560d"}
Jul 23 22:00:02.558073 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:02.558021    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh" podStartSLOduration=1.252135931 podStartE2EDuration="3.558004056s" totalImagesPullingTime="2.305868125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:00:02.556705068 +0000 UTC m=+506.591412610" watchObservedRunningTime="2026-07-23 22:00:02.558004056 +0000 UTC m=+506.592711595"
Jul 23 22:00:03.541814 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:03.541786    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"
Jul 23 22:00:07.543086 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:07.543057    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-tqwrh"
Jul 23 22:00:14.547970 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:14.547937    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-zrgwh"
Jul 23 22:00:28.390498 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.390463    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"]
Jul 23 22:00:28.393802 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.393785    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.396458 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.396437    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 22:00:28.396608 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.396590    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 22:00:28.397636 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.397612    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4jfgf\""
Jul 23 22:00:28.397636 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.397627    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 23 22:00:28.404564 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.404543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"]
Jul 23 22:00:28.457574 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.457532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.457745 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.457581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.457745 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.457648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b93e476-c46b-479a-87f8-5f7a06ca18a8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.457745 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.457667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.457745 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.457692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzzn8\" (UniqueName: \"kubernetes.io/projected/9b93e476-c46b-479a-87f8-5f7a06ca18a8-kube-api-access-vzzn8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.457959 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.457774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.559097 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.559057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.559097 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.559099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.559377 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.559159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.559377 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.559243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b93e476-c46b-479a-87f8-5f7a06ca18a8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.559491 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.559375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.559491 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.559412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzzn8\" (UniqueName: \"kubernetes.io/projected/9b93e476-c46b-479a-87f8-5f7a06ca18a8-kube-api-access-vzzn8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.559632 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.559569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.559632 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.559593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.559769 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.559748    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.561501 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.561482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b93e476-c46b-479a-87f8-5f7a06ca18a8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.561744 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.561726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b93e476-c46b-479a-87f8-5f7a06ca18a8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.576500 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.576470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzzn8\" (UniqueName: \"kubernetes.io/projected/9b93e476-c46b-479a-87f8-5f7a06ca18a8-kube-api-access-vzzn8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xpl55\" (UID: \"9b93e476-c46b-479a-87f8-5f7a06ca18a8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.704431 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.704351    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:28.831944 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:28.831911    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"]
Jul 23 22:00:28.835193 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:00:28.835167    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b93e476_c46b_479a_87f8_5f7a06ca18a8.slice/crio-82ca7c8a9f8684e8960c58f49d91874e569f3a20698e9821a805582d0b6bd96c WatchSource:0}: Error finding container 82ca7c8a9f8684e8960c58f49d91874e569f3a20698e9821a805582d0b6bd96c: Status 404 returned error can't find the container with id 82ca7c8a9f8684e8960c58f49d91874e569f3a20698e9821a805582d0b6bd96c
Jul 23 22:00:29.647451 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:29.647405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55" event={"ID":"9b93e476-c46b-479a-87f8-5f7a06ca18a8","Type":"ContainerStarted","Data":"82ca7c8a9f8684e8960c58f49d91874e569f3a20698e9821a805582d0b6bd96c"}
Jul 23 22:00:30.653495 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:30.653453    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55" event={"ID":"9b93e476-c46b-479a-87f8-5f7a06ca18a8","Type":"ContainerStarted","Data":"af4575368c8656483442023dcc17d4080521a9b7232a2c3aede98937a1a6291b"}
Jul 23 22:00:30.672408 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:30.672360    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55" podStartSLOduration=1.40696264 podStartE2EDuration="2.672344777s" totalImagesPullingTime="1.265382137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:00:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:00:30.672234305 +0000 UTC m=+534.706941835" watchObservedRunningTime="2026-07-23 22:00:30.672344777 +0000 UTC m=+534.707052315"
Jul 23 22:00:38.704548 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:38.704512    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:38.704954 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:38.704612    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:38.717591 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:38.717563    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:39.699000 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:39.698972    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xpl55"
Jul 23 22:00:45.781780 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:45.781746    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"]
Jul 23 22:00:45.787721 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:45.787696    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:45.790463 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:45.790444    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 23 22:00:45.795492 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:45.795466    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"]
Jul 23 22:00:45.903190 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:45.903155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68zkx\" (UniqueName: \"kubernetes.io/projected/225e065b-18b9-4546-9040-e7fcd25d4b23-kube-api-access-68zkx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:45.903362 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:45.903195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:45.903362 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:45.903258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:45.903362 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:45.903287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:45.903362 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:45.903335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:45.903498 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:45.903428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/225e065b-18b9-4546-9040-e7fcd25d4b23-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.004533 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.004502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/225e065b-18b9-4546-9040-e7fcd25d4b23-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.004712 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.004542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68zkx\" (UniqueName: \"kubernetes.io/projected/225e065b-18b9-4546-9040-e7fcd25d4b23-kube-api-access-68zkx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.004712 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.004574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.004712 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.004611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.004712 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.004645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.004712 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.004669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.005098 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.005069    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.005238 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.005109    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.005238 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.005156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.007017 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.006996    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/225e065b-18b9-4546-9040-e7fcd25d4b23-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.007103 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.007045    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/225e065b-18b9-4546-9040-e7fcd25d4b23-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.012145 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.012122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68zkx\" (UniqueName: \"kubernetes.io/projected/225e065b-18b9-4546-9040-e7fcd25d4b23-kube-api-access-68zkx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw\" (UID: \"225e065b-18b9-4546-9040-e7fcd25d4b23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.101187 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.101096    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:46.224597 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.224561    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"]
Jul 23 22:00:46.227632 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:00:46.227603    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod225e065b_18b9_4546_9040_e7fcd25d4b23.slice/crio-c5e5e0ded0f18740eae79c310e51b362d92fcf0809f3af92a07080255e53b9d2 WatchSource:0}: Error finding container c5e5e0ded0f18740eae79c310e51b362d92fcf0809f3af92a07080255e53b9d2: Status 404 returned error can't find the container with id c5e5e0ded0f18740eae79c310e51b362d92fcf0809f3af92a07080255e53b9d2
Jul 23 22:00:46.715961 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.715918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw" event={"ID":"225e065b-18b9-4546-9040-e7fcd25d4b23","Type":"ContainerStarted","Data":"8e9776df3bdf0851883b274d2734f18713aded5a4c7624320c07401097eb81be"}
Jul 23 22:00:46.716151 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.715975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw" event={"ID":"225e065b-18b9-4546-9040-e7fcd25d4b23","Type":"ContainerStarted","Data":"c5e5e0ded0f18740eae79c310e51b362d92fcf0809f3af92a07080255e53b9d2"}
Jul 23 22:00:46.734317 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:46.734192    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw" podStartSLOduration=1.482053672 podStartE2EDuration="1.734174974s" totalImagesPullingTime="252.121302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:00:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:00:46.73374855 +0000 UTC m=+550.768456112" watchObservedRunningTime="2026-07-23 22:00:46.734174974 +0000 UTC m=+550.768882514"
Jul 23 22:00:52.885386 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:52.885351    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"]
Jul 23 22:00:52.888760 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:52.888742    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:52.891198 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:52.891180    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 23 22:00:52.899983 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:52.899963    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"]
Jul 23 22:00:52.959611 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:52.959583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:52.959746 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:52.959638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:52.959746 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:52.959719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5nl2\" (UniqueName: \"kubernetes.io/projected/1a0d75ce-a111-4698-8350-67380a97f089-kube-api-access-b5nl2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:52.959855 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:52.959761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a0d75ce-a111-4698-8350-67380a97f089-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:52.959855 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:52.959794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:52.959926 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:52.959889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.061109 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.061082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.061260 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.061122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.061332 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.061273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.061389 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.061328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5nl2\" (UniqueName: \"kubernetes.io/projected/1a0d75ce-a111-4698-8350-67380a97f089-kube-api-access-b5nl2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.061389 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.061361    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a0d75ce-a111-4698-8350-67380a97f089-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.061489 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.061393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.061542 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.061527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.061593 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.061574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.061736 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.061718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.063306 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.063288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a0d75ce-a111-4698-8350-67380a97f089-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.063620 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.063600    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a0d75ce-a111-4698-8350-67380a97f089-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.069592 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.069569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5nl2\" (UniqueName: \"kubernetes.io/projected/1a0d75ce-a111-4698-8350-67380a97f089-kube-api-access-b5nl2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qp689\" (UID: \"1a0d75ce-a111-4698-8350-67380a97f089\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.198298 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.198230    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:00:53.322576 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.322547    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"]
Jul 23 22:00:53.325171 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:00:53.325148    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a0d75ce_a111_4698_8350_67380a97f089.slice/crio-17b35aa74bc18852e68a3970db858272300263a2270f6dd6697a0f2da115a570 WatchSource:0}: Error finding container 17b35aa74bc18852e68a3970db858272300263a2270f6dd6697a0f2da115a570: Status 404 returned error can't find the container with id 17b35aa74bc18852e68a3970db858272300263a2270f6dd6697a0f2da115a570
Jul 23 22:00:53.745226 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.745189    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689" event={"ID":"1a0d75ce-a111-4698-8350-67380a97f089","Type":"ContainerStarted","Data":"13a9f9c3d56d6c86df92589253308010cc57b994e085403831c739bf7f8f10be"}
Jul 23 22:00:53.745407 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.745257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689" event={"ID":"1a0d75ce-a111-4698-8350-67380a97f089","Type":"ContainerStarted","Data":"17b35aa74bc18852e68a3970db858272300263a2270f6dd6697a0f2da115a570"}
Jul 23 22:00:53.765142 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:53.765083    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689" podStartSLOduration=1.504649152 podStartE2EDuration="1.765067022s" totalImagesPullingTime="260.41787ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:00:53.764078579 +0000 UTC m=+557.798786130" watchObservedRunningTime="2026-07-23 22:00:53.765067022 +0000 UTC m=+557.799774561"
Jul 23 22:00:56.101611 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:56.101558    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:56.102056 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:56.101681    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:56.114264 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:56.114210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:00:56.768733 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:00:56.768706    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw"
Jul 23 22:01:03.198402 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:01:03.198356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:01:03.198912 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:01:03.198441    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:01:03.210761 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:01:03.210735    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:01:03.799056 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:01:03.799029    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qp689"
Jul 23 22:01:36.379358 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:01:36.379328    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:01:36.379886 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:01:36.379469    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:02:03.502351 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.502275    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68c5d857ff-xprjc"]
Jul 23 22:02:03.505393 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.505376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c5d857ff-xprjc"
Jul 23 22:02:03.509112 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.509086    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 22:02:03.509250 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.509184    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mh59l\""
Jul 23 22:02:03.509305 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.509276    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 22:02:03.509487 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.509472    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 22:02:03.514109 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.514086    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68c5d857ff-xprjc"]
Jul 23 22:02:03.539853 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.539824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdjrx\" (UniqueName: \"kubernetes.io/projected/bef6f1a2-4117-4614-a641-12ca5c633f26-kube-api-access-zdjrx\") pod \"authorino-68c5d857ff-xprjc\" (UID: \"bef6f1a2-4117-4614-a641-12ca5c633f26\") " pod="kuadrant-system/authorino-68c5d857ff-xprjc"
Jul 23 22:02:03.540021 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.539870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bef6f1a2-4117-4614-a641-12ca5c633f26-tls-cert\") pod \"authorino-68c5d857ff-xprjc\" (UID: \"bef6f1a2-4117-4614-a641-12ca5c633f26\") " pod="kuadrant-system/authorino-68c5d857ff-xprjc"
Jul 23 22:02:03.640742 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.640701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdjrx\" (UniqueName: \"kubernetes.io/projected/bef6f1a2-4117-4614-a641-12ca5c633f26-kube-api-access-zdjrx\") pod \"authorino-68c5d857ff-xprjc\" (UID: \"bef6f1a2-4117-4614-a641-12ca5c633f26\") " pod="kuadrant-system/authorino-68c5d857ff-xprjc"
Jul 23 22:02:03.640916 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.640752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bef6f1a2-4117-4614-a641-12ca5c633f26-tls-cert\") pod \"authorino-68c5d857ff-xprjc\" (UID: \"bef6f1a2-4117-4614-a641-12ca5c633f26\") " pod="kuadrant-system/authorino-68c5d857ff-xprjc"
Jul 23 22:02:03.643178 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.643157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bef6f1a2-4117-4614-a641-12ca5c633f26-tls-cert\") pod \"authorino-68c5d857ff-xprjc\" (UID: \"bef6f1a2-4117-4614-a641-12ca5c633f26\") " pod="kuadrant-system/authorino-68c5d857ff-xprjc"
Jul 23 22:02:03.649238 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.649201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdjrx\" (UniqueName: \"kubernetes.io/projected/bef6f1a2-4117-4614-a641-12ca5c633f26-kube-api-access-zdjrx\") pod \"authorino-68c5d857ff-xprjc\" (UID: \"bef6f1a2-4117-4614-a641-12ca5c633f26\") " pod="kuadrant-system/authorino-68c5d857ff-xprjc"
Jul 23 22:02:03.815246 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.815199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c5d857ff-xprjc"
Jul 23 22:02:03.947391 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:03.947358    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68c5d857ff-xprjc"]
Jul 23 22:02:03.950257 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:02:03.950231    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbef6f1a2_4117_4614_a641_12ca5c633f26.slice/crio-e5ef8f14f71d037e7e954ba1ab25870239d74b2084e505c44829d4b8fe55cb8d WatchSource:0}: Error finding container e5ef8f14f71d037e7e954ba1ab25870239d74b2084e505c44829d4b8fe55cb8d: Status 404 returned error can't find the container with id e5ef8f14f71d037e7e954ba1ab25870239d74b2084e505c44829d4b8fe55cb8d
Jul 23 22:02:04.041854 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:04.041821    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68c5d857ff-xprjc" event={"ID":"bef6f1a2-4117-4614-a641-12ca5c633f26","Type":"ContainerStarted","Data":"e5ef8f14f71d037e7e954ba1ab25870239d74b2084e505c44829d4b8fe55cb8d"}
Jul 23 22:02:05.047982 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:05.047938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68c5d857ff-xprjc" event={"ID":"bef6f1a2-4117-4614-a641-12ca5c633f26","Type":"ContainerStarted","Data":"dbb5085ebd8409baa548174c01ef896981ee69fc1bec1f3cf48b4240fe850fde"}
Jul 23 22:02:05.068175 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:05.068126    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68c5d857ff-xprjc" podStartSLOduration=1.652534895 podStartE2EDuration="2.068109142s" totalImagesPullingTime="415.574247ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:02:05.06654944 +0000 UTC m=+629.101256978" watchObservedRunningTime="2026-07-23 22:02:05.068109142 +0000 UTC m=+629.102816681"
Jul 23 22:02:53.314646 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:53.314602    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-nqvf4"]
Jul 23 22:02:53.315250 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:53.314924    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5764b54ddf-nqvf4" podUID="71d8f84f-0f33-4ff7-a0a2-2060d156c686" containerName="manager" containerID="cri-o://fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac" gracePeriod=30
Jul 23 22:02:53.568291 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:53.568203    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 22:02:53.679797 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:53.679745    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71d8f84f-0f33-4ff7-a0a2-2060d156c686-webhook-cert\") pod \"71d8f84f-0f33-4ff7-a0a2-2060d156c686\" (UID: \"71d8f84f-0f33-4ff7-a0a2-2060d156c686\") "
Jul 23 22:02:53.679983 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:53.679859    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbcpl\" (UniqueName: \"kubernetes.io/projected/71d8f84f-0f33-4ff7-a0a2-2060d156c686-kube-api-access-mbcpl\") pod \"71d8f84f-0f33-4ff7-a0a2-2060d156c686\" (UID: \"71d8f84f-0f33-4ff7-a0a2-2060d156c686\") "
Jul 23 22:02:53.681937 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:53.681903    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d8f84f-0f33-4ff7-a0a2-2060d156c686-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "71d8f84f-0f33-4ff7-a0a2-2060d156c686" (UID: "71d8f84f-0f33-4ff7-a0a2-2060d156c686"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:02:53.682051 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:53.681917    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d8f84f-0f33-4ff7-a0a2-2060d156c686-kube-api-access-mbcpl" (OuterVolumeSpecName: "kube-api-access-mbcpl") pod "71d8f84f-0f33-4ff7-a0a2-2060d156c686" (UID: "71d8f84f-0f33-4ff7-a0a2-2060d156c686"). InnerVolumeSpecName "kube-api-access-mbcpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:02:53.780786 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:53.780743    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71d8f84f-0f33-4ff7-a0a2-2060d156c686-webhook-cert\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:02:53.780786 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:53.780780    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbcpl\" (UniqueName: \"kubernetes.io/projected/71d8f84f-0f33-4ff7-a0a2-2060d156c686-kube-api-access-mbcpl\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:02:54.255900 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:54.255867    2565 generic.go:356] "Generic (PLEG): container finished" podID="71d8f84f-0f33-4ff7-a0a2-2060d156c686" containerID="fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac" exitCode=0
Jul 23 22:02:54.256070 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:54.255912    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5764b54ddf-nqvf4"
Jul 23 22:02:54.256070 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:54.255958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5764b54ddf-nqvf4" event={"ID":"71d8f84f-0f33-4ff7-a0a2-2060d156c686","Type":"ContainerDied","Data":"fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac"}
Jul 23 22:02:54.256070 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:54.256006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5764b54ddf-nqvf4" event={"ID":"71d8f84f-0f33-4ff7-a0a2-2060d156c686","Type":"ContainerDied","Data":"232ae7a2a5de8bdce130c451832d3abdfe083f03ed2df4a7390c4f45a55c70bd"}
Jul 23 22:02:54.256070 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:54.256030    2565 scope.go:117] "RemoveContainer" containerID="fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac"
Jul 23 22:02:54.265072 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:54.265053    2565 scope.go:117] "RemoveContainer" containerID="fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac"
Jul 23 22:02:54.265386 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:02:54.265365    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac\": container with ID starting with fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac not found: ID does not exist" containerID="fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac"
Jul 23 22:02:54.265466 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:54.265398    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac"} err="failed to get container status \"fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac\": rpc error: code = NotFound desc = could not find container \"fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac\": container with ID starting with fb7077dc07ee05bfcfe552cf4a5476f52e78e45ad17365f29e277e434b50baac not found: ID does not exist"
Jul 23 22:02:54.286623 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:54.286594    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-nqvf4"]
Jul 23 22:02:54.288196 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:54.288178    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-nqvf4"]
Jul 23 22:02:54.481510 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:02:54.481480    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71d8f84f-0f33-4ff7-a0a2-2060d156c686" path="/var/lib/kubelet/pods/71d8f84f-0f33-4ff7-a0a2-2060d156c686/volumes"
Jul 23 22:03:55.118996 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.118962    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5764b54ddf-xzplc"]
Jul 23 22:03:55.119486 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.119274    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d8f84f-0f33-4ff7-a0a2-2060d156c686" containerName="manager"
Jul 23 22:03:55.119486 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.119287    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d8f84f-0f33-4ff7-a0a2-2060d156c686" containerName="manager"
Jul 23 22:03:55.119486 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.119342    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d8f84f-0f33-4ff7-a0a2-2060d156c686" containerName="manager"
Jul 23 22:03:55.123400 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.123384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:03:55.127391 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.127369    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 22:03:55.127513 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.127372    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 22:03:55.127513 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.127372    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b7jzw\""
Jul 23 22:03:55.131916 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.131893    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-xzplc"]
Jul 23 22:03:55.193669 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.193633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtbrx\" (UniqueName: \"kubernetes.io/projected/232813aa-a600-4d83-9411-e85f714cea5d-kube-api-access-vtbrx\") pod \"maas-controller-5764b54ddf-xzplc\" (UID: \"232813aa-a600-4d83-9411-e85f714cea5d\") " pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:03:55.193837 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.193689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/232813aa-a600-4d83-9411-e85f714cea5d-webhook-cert\") pod \"maas-controller-5764b54ddf-xzplc\" (UID: \"232813aa-a600-4d83-9411-e85f714cea5d\") " pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:03:55.295123 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.295079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtbrx\" (UniqueName: \"kubernetes.io/projected/232813aa-a600-4d83-9411-e85f714cea5d-kube-api-access-vtbrx\") pod \"maas-controller-5764b54ddf-xzplc\" (UID: \"232813aa-a600-4d83-9411-e85f714cea5d\") " pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:03:55.295350 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.295138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/232813aa-a600-4d83-9411-e85f714cea5d-webhook-cert\") pod \"maas-controller-5764b54ddf-xzplc\" (UID: \"232813aa-a600-4d83-9411-e85f714cea5d\") " pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:03:55.297550 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.297523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/232813aa-a600-4d83-9411-e85f714cea5d-webhook-cert\") pod \"maas-controller-5764b54ddf-xzplc\" (UID: \"232813aa-a600-4d83-9411-e85f714cea5d\") " pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:03:55.306680 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.306659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtbrx\" (UniqueName: \"kubernetes.io/projected/232813aa-a600-4d83-9411-e85f714cea5d-kube-api-access-vtbrx\") pod \"maas-controller-5764b54ddf-xzplc\" (UID: \"232813aa-a600-4d83-9411-e85f714cea5d\") " pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:03:55.434693 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.434598    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:03:55.567729 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.567660    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-xzplc"]
Jul 23 22:03:55.570382 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:03:55.570346    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232813aa_a600_4d83_9411_e85f714cea5d.slice/crio-49b686dde4cfcde0f5e4a7df2012b11d402eaea70ec668639ad0820d0b05653e WatchSource:0}: Error finding container 49b686dde4cfcde0f5e4a7df2012b11d402eaea70ec668639ad0820d0b05653e: Status 404 returned error can't find the container with id 49b686dde4cfcde0f5e4a7df2012b11d402eaea70ec668639ad0820d0b05653e
Jul 23 22:03:55.571783 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:55.571759    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 22:03:56.513082 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:56.513041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5764b54ddf-xzplc" event={"ID":"232813aa-a600-4d83-9411-e85f714cea5d","Type":"ContainerStarted","Data":"60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08"}
Jul 23 22:03:56.513486 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:56.513106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5764b54ddf-xzplc" event={"ID":"232813aa-a600-4d83-9411-e85f714cea5d","Type":"ContainerStarted","Data":"49b686dde4cfcde0f5e4a7df2012b11d402eaea70ec668639ad0820d0b05653e"}
Jul 23 22:03:56.513486 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:56.513189    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:03:56.534654 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:03:56.534606    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5764b54ddf-xzplc" podStartSLOduration=1.149259495 podStartE2EDuration="1.534590262s" totalImagesPullingTime="385.330767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:03:56.533010675 +0000 UTC m=+740.567718233" watchObservedRunningTime="2026-07-23 22:03:56.534590262 +0000 UTC m=+740.569297800"
Jul 23 22:04:07.519772 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:07.519742    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:04:12.189371 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.189338    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-xzplc"]
Jul 23 22:04:12.189797 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.189541    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5764b54ddf-xzplc" podUID="232813aa-a600-4d83-9411-e85f714cea5d" containerName="manager" containerID="cri-o://60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08" gracePeriod=30
Jul 23 22:04:12.426764 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.426739    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:04:12.558922 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.558895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtbrx\" (UniqueName: \"kubernetes.io/projected/232813aa-a600-4d83-9411-e85f714cea5d-kube-api-access-vtbrx\") pod \"232813aa-a600-4d83-9411-e85f714cea5d\" (UID: \"232813aa-a600-4d83-9411-e85f714cea5d\") "
Jul 23 22:04:12.559092 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.558960    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/232813aa-a600-4d83-9411-e85f714cea5d-webhook-cert\") pod \"232813aa-a600-4d83-9411-e85f714cea5d\" (UID: \"232813aa-a600-4d83-9411-e85f714cea5d\") "
Jul 23 22:04:12.560885 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.560855    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/232813aa-a600-4d83-9411-e85f714cea5d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "232813aa-a600-4d83-9411-e85f714cea5d" (UID: "232813aa-a600-4d83-9411-e85f714cea5d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:04:12.560994 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.560902    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/232813aa-a600-4d83-9411-e85f714cea5d-kube-api-access-vtbrx" (OuterVolumeSpecName: "kube-api-access-vtbrx") pod "232813aa-a600-4d83-9411-e85f714cea5d" (UID: "232813aa-a600-4d83-9411-e85f714cea5d"). InnerVolumeSpecName "kube-api-access-vtbrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:04:12.584645 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.584618    2565 generic.go:356] "Generic (PLEG): container finished" podID="232813aa-a600-4d83-9411-e85f714cea5d" containerID="60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08" exitCode=0
Jul 23 22:04:12.584743 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.584658    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5764b54ddf-xzplc" event={"ID":"232813aa-a600-4d83-9411-e85f714cea5d","Type":"ContainerDied","Data":"60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08"}
Jul 23 22:04:12.584743 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.584665    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5764b54ddf-xzplc"
Jul 23 22:04:12.584743 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.584703    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5764b54ddf-xzplc" event={"ID":"232813aa-a600-4d83-9411-e85f714cea5d","Type":"ContainerDied","Data":"49b686dde4cfcde0f5e4a7df2012b11d402eaea70ec668639ad0820d0b05653e"}
Jul 23 22:04:12.584743 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.584726    2565 scope.go:117] "RemoveContainer" containerID="60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08"
Jul 23 22:04:12.593263 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.593233    2565 scope.go:117] "RemoveContainer" containerID="60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08"
Jul 23 22:04:12.593525 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:04:12.593505    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08\": container with ID starting with 60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08 not found: ID does not exist" containerID="60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08"
Jul 23 22:04:12.593569 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.593532    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08"} err="failed to get container status \"60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08\": rpc error: code = NotFound desc = could not find container \"60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08\": container with ID starting with 60a35f80b67f42513f0b8558a715a5e20971682bc9aa0028c439dda98a46ed08 not found: ID does not exist"
Jul 23 22:04:12.606375 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.606354    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-xzplc"]
Jul 23 22:04:12.610099 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.610081    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-xzplc"]
Jul 23 22:04:12.660359 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.660338    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtbrx\" (UniqueName: \"kubernetes.io/projected/232813aa-a600-4d83-9411-e85f714cea5d-kube-api-access-vtbrx\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:04:12.660359 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:12.660360    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/232813aa-a600-4d83-9411-e85f714cea5d-webhook-cert\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:04:13.536748 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.536717    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5764b54ddf-57njt"]
Jul 23 22:04:13.537120 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.537008    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232813aa-a600-4d83-9411-e85f714cea5d" containerName="manager"
Jul 23 22:04:13.537120 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.537019    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="232813aa-a600-4d83-9411-e85f714cea5d" containerName="manager"
Jul 23 22:04:13.537120 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.537067    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="232813aa-a600-4d83-9411-e85f714cea5d" containerName="manager"
Jul 23 22:04:13.541684 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.541667    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5764b54ddf-57njt"
Jul 23 22:04:13.545350 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.545327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b7jzw\""
Jul 23 22:04:13.545472 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.545327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 22:04:13.545472 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.545328    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 22:04:13.549831 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.549810    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-57njt"]
Jul 23 22:04:13.669976 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.669941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h875\" (UniqueName: \"kubernetes.io/projected/3668072c-8691-4b1c-b7a2-5b3aa4ba667f-kube-api-access-7h875\") pod \"maas-controller-5764b54ddf-57njt\" (UID: \"3668072c-8691-4b1c-b7a2-5b3aa4ba667f\") " pod="opendatahub/maas-controller-5764b54ddf-57njt"
Jul 23 22:04:13.670150 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.669988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3668072c-8691-4b1c-b7a2-5b3aa4ba667f-webhook-cert\") pod \"maas-controller-5764b54ddf-57njt\" (UID: \"3668072c-8691-4b1c-b7a2-5b3aa4ba667f\") " pod="opendatahub/maas-controller-5764b54ddf-57njt"
Jul 23 22:04:13.770710 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.770669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3668072c-8691-4b1c-b7a2-5b3aa4ba667f-webhook-cert\") pod \"maas-controller-5764b54ddf-57njt\" (UID: \"3668072c-8691-4b1c-b7a2-5b3aa4ba667f\") " pod="opendatahub/maas-controller-5764b54ddf-57njt"
Jul 23 22:04:13.770843 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.770760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h875\" (UniqueName: \"kubernetes.io/projected/3668072c-8691-4b1c-b7a2-5b3aa4ba667f-kube-api-access-7h875\") pod \"maas-controller-5764b54ddf-57njt\" (UID: \"3668072c-8691-4b1c-b7a2-5b3aa4ba667f\") " pod="opendatahub/maas-controller-5764b54ddf-57njt"
Jul 23 22:04:13.773048 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.773024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3668072c-8691-4b1c-b7a2-5b3aa4ba667f-webhook-cert\") pod \"maas-controller-5764b54ddf-57njt\" (UID: \"3668072c-8691-4b1c-b7a2-5b3aa4ba667f\") " pod="opendatahub/maas-controller-5764b54ddf-57njt"
Jul 23 22:04:13.778514 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.778481    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h875\" (UniqueName: \"kubernetes.io/projected/3668072c-8691-4b1c-b7a2-5b3aa4ba667f-kube-api-access-7h875\") pod \"maas-controller-5764b54ddf-57njt\" (UID: \"3668072c-8691-4b1c-b7a2-5b3aa4ba667f\") " pod="opendatahub/maas-controller-5764b54ddf-57njt"
Jul 23 22:04:13.852027 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.851936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5764b54ddf-57njt"
Jul 23 22:04:13.976987 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:13.976934    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5764b54ddf-57njt"]
Jul 23 22:04:13.979335 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:04:13.979310    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3668072c_8691_4b1c_b7a2_5b3aa4ba667f.slice/crio-6d37554839349e7e45eacbcd8e196119f5732a7b791bf06f5b1c27c51bcd5491 WatchSource:0}: Error finding container 6d37554839349e7e45eacbcd8e196119f5732a7b791bf06f5b1c27c51bcd5491: Status 404 returned error can't find the container with id 6d37554839349e7e45eacbcd8e196119f5732a7b791bf06f5b1c27c51bcd5491
Jul 23 22:04:14.482380 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:14.482339    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="232813aa-a600-4d83-9411-e85f714cea5d" path="/var/lib/kubelet/pods/232813aa-a600-4d83-9411-e85f714cea5d/volumes"
Jul 23 22:04:14.596408 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:14.596371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5764b54ddf-57njt" event={"ID":"3668072c-8691-4b1c-b7a2-5b3aa4ba667f","Type":"ContainerStarted","Data":"4a0c9376d9e06844cdab5568b0195bb7fd222f72e7cb96fcdc223cbc59e9d912"}
Jul 23 22:04:14.596812 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:14.596421    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5764b54ddf-57njt" event={"ID":"3668072c-8691-4b1c-b7a2-5b3aa4ba667f","Type":"ContainerStarted","Data":"6d37554839349e7e45eacbcd8e196119f5732a7b791bf06f5b1c27c51bcd5491"}
Jul 23 22:04:14.596812 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:14.596504    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5764b54ddf-57njt"
Jul 23 22:04:14.614574 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:14.614525    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5764b54ddf-57njt" podStartSLOduration=1.343216241 podStartE2EDuration="1.614509945s" totalImagesPullingTime="271.293704ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:04:14.612853238 +0000 UTC m=+758.647560792" watchObservedRunningTime="2026-07-23 22:04:14.614509945 +0000 UTC m=+758.649217484"
Jul 23 22:04:25.602838 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:04:25.602807    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5764b54ddf-57njt"
Jul 23 22:06:36.401628 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:06:36.401601    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:06:36.402816 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:06:36.402793    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:11:36.425993 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:11:36.425963    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:11:36.427868 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:11:36.427834    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:13:03.767689 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.767650    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"]
Jul 23 22:13:03.771003 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.770976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.773824 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.773799    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-bc6d27b0-kserve-self-signed-certs\""
Jul 23 22:13:03.775367 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.775337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-tmp-dir\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.775481 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.775387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-dshm\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.775481 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.775424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz5vs\" (UniqueName: \"kubernetes.io/projected/0dd36898-359f-4eaf-98d6-a94b966a99ef-kube-api-access-kz5vs\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.775565 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.775485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-home\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.775565 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.775551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-model-cache\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.775637 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.775578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd36898-359f-4eaf-98d6-a94b966a99ef-tls-certs\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.780145 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.780118    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"]
Jul 23 22:13:03.876146 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.876108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-home\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.876343 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.876160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-model-cache\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.876343 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.876305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd36898-359f-4eaf-98d6-a94b966a99ef-tls-certs\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.876460 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.876369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-tmp-dir\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.876460 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.876412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-dshm\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.876460 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.876450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz5vs\" (UniqueName: \"kubernetes.io/projected/0dd36898-359f-4eaf-98d6-a94b966a99ef-kube-api-access-kz5vs\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.876652 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.876629    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-model-cache\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.876728 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.876689    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-home\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.876788 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.876737    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-tmp-dir\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.878701 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.878660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-dshm\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.879080 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.879056    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd36898-359f-4eaf-98d6-a94b966a99ef-tls-certs\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:03.885415 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:03.885391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz5vs\" (UniqueName: \"kubernetes.io/projected/0dd36898-359f-4eaf-98d6-a94b966a99ef-kube-api-access-kz5vs\") pod \"e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") " pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:04.080739 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:04.080661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:04.223977 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:04.223950    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"]
Jul 23 22:13:04.226536 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:13:04.226509    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0dd36898_359f_4eaf_98d6_a94b966a99ef.slice/crio-6469550eda160a70662f83baf9c8b43be0499f6ef75d54497ff04719fcee732e WatchSource:0}: Error finding container 6469550eda160a70662f83baf9c8b43be0499f6ef75d54497ff04719fcee732e: Status 404 returned error can't find the container with id 6469550eda160a70662f83baf9c8b43be0499f6ef75d54497ff04719fcee732e
Jul 23 22:13:04.789392 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:04.789359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5" event={"ID":"0dd36898-359f-4eaf-98d6-a94b966a99ef","Type":"ContainerStarted","Data":"8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c"}
Jul 23 22:13:04.789392 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:04.789399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5" event={"ID":"0dd36898-359f-4eaf-98d6-a94b966a99ef","Type":"ContainerStarted","Data":"6469550eda160a70662f83baf9c8b43be0499f6ef75d54497ff04719fcee732e"}
Jul 23 22:13:04.807496 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:04.807452    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5" podStartSLOduration=1.807433567 podStartE2EDuration="1.807433567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:13:04.805827658 +0000 UTC m=+1288.840535196" watchObservedRunningTime="2026-07-23 22:13:04.807433567 +0000 UTC m=+1288.842141106"
Jul 23 22:13:14.081353 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:14.081317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:14.081796 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:14.081365    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:14.094903 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:14.094874    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:14.842620 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:14.842588    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:34.605450 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:34.605409    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"]
Jul 23 22:13:49.631838 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.631789    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5" podUID="0dd36898-359f-4eaf-98d6-a94b966a99ef" containerName="main" containerID="cri-o://8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c" gracePeriod=45
Jul 23 22:13:49.880266 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.880235    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:49.929325 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.929247    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-model-cache\") pod \"0dd36898-359f-4eaf-98d6-a94b966a99ef\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") "
Jul 23 22:13:49.929325 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.929282    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd36898-359f-4eaf-98d6-a94b966a99ef-tls-certs\") pod \"0dd36898-359f-4eaf-98d6-a94b966a99ef\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") "
Jul 23 22:13:49.929325 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.929308    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-tmp-dir\") pod \"0dd36898-359f-4eaf-98d6-a94b966a99ef\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") "
Jul 23 22:13:49.929325 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.929326    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz5vs\" (UniqueName: \"kubernetes.io/projected/0dd36898-359f-4eaf-98d6-a94b966a99ef-kube-api-access-kz5vs\") pod \"0dd36898-359f-4eaf-98d6-a94b966a99ef\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") "
Jul 23 22:13:49.929640 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.929459    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-dshm\") pod \"0dd36898-359f-4eaf-98d6-a94b966a99ef\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") "
Jul 23 22:13:49.929640 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.929495    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-home\") pod \"0dd36898-359f-4eaf-98d6-a94b966a99ef\" (UID: \"0dd36898-359f-4eaf-98d6-a94b966a99ef\") "
Jul 23 22:13:49.929640 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.929564    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-model-cache" (OuterVolumeSpecName: "model-cache") pod "0dd36898-359f-4eaf-98d6-a94b966a99ef" (UID: "0dd36898-359f-4eaf-98d6-a94b966a99ef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:13:49.929640 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.929579    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0dd36898-359f-4eaf-98d6-a94b966a99ef" (UID: "0dd36898-359f-4eaf-98d6-a94b966a99ef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:13:49.929837 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.929762    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-model-cache\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:13:49.929837 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.929774    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-home" (OuterVolumeSpecName: "home") pod "0dd36898-359f-4eaf-98d6-a94b966a99ef" (UID: "0dd36898-359f-4eaf-98d6-a94b966a99ef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:13:49.929837 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.929783    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-tmp-dir\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:13:49.931750 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.931721    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-dshm" (OuterVolumeSpecName: "dshm") pod "0dd36898-359f-4eaf-98d6-a94b966a99ef" (UID: "0dd36898-359f-4eaf-98d6-a94b966a99ef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:13:49.931750 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.931732    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd36898-359f-4eaf-98d6-a94b966a99ef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0dd36898-359f-4eaf-98d6-a94b966a99ef" (UID: "0dd36898-359f-4eaf-98d6-a94b966a99ef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:13:49.931895 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.931765    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd36898-359f-4eaf-98d6-a94b966a99ef-kube-api-access-kz5vs" (OuterVolumeSpecName: "kube-api-access-kz5vs") pod "0dd36898-359f-4eaf-98d6-a94b966a99ef" (UID: "0dd36898-359f-4eaf-98d6-a94b966a99ef"). InnerVolumeSpecName "kube-api-access-kz5vs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:13:49.986195 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.986158    2565 generic.go:356] "Generic (PLEG): container finished" podID="0dd36898-359f-4eaf-98d6-a94b966a99ef" containerID="8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c" exitCode=0
Jul 23 22:13:49.986384 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.986208    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"
Jul 23 22:13:49.986384 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.986206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5" event={"ID":"0dd36898-359f-4eaf-98d6-a94b966a99ef","Type":"ContainerDied","Data":"8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c"}
Jul 23 22:13:49.986384 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.986282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5" event={"ID":"0dd36898-359f-4eaf-98d6-a94b966a99ef","Type":"ContainerDied","Data":"6469550eda160a70662f83baf9c8b43be0499f6ef75d54497ff04719fcee732e"}
Jul 23 22:13:49.986384 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.986306    2565 scope.go:117] "RemoveContainer" containerID="8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c"
Jul 23 22:13:49.995210 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.995192    2565 scope.go:117] "RemoveContainer" containerID="8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c"
Jul 23 22:13:49.995507 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:13:49.995488    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c\": container with ID starting with 8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c not found: ID does not exist" containerID="8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c"
Jul 23 22:13:49.995566 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:49.995517    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c"} err="failed to get container status \"8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c\": rpc error: code = NotFound desc = could not find container \"8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c\": container with ID starting with 8bdb30ac767dee8e64f167c341d8b1fe663e9c41e16e3b1ae595105206483f0c not found: ID does not exist"
Jul 23 22:13:50.007205 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:50.007178    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"]
Jul 23 22:13:50.010683 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:50.010654    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-bc6d27b0-kserve-6c6d7c7f75-thkk5"]
Jul 23 22:13:50.030674 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:50.030641    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz5vs\" (UniqueName: \"kubernetes.io/projected/0dd36898-359f-4eaf-98d6-a94b966a99ef-kube-api-access-kz5vs\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:13:50.030674 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:50.030671    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-dshm\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:13:50.030807 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:50.030682    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dd36898-359f-4eaf-98d6-a94b966a99ef-home\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:13:50.030807 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:50.030699    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dd36898-359f-4eaf-98d6-a94b966a99ef-tls-certs\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:13:50.486735 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:13:50.486697    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dd36898-359f-4eaf-98d6-a94b966a99ef" path="/var/lib/kubelet/pods/0dd36898-359f-4eaf-98d6-a94b966a99ef/volumes"
Jul 23 22:16:36.448695 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:16:36.448667    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:16:36.451658 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:16:36.451637    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:17:26.536996 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.536911    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"]
Jul 23 22:17:26.537488 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.537381    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd36898-359f-4eaf-98d6-a94b966a99ef" containerName="main"
Jul 23 22:17:26.537488 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.537396    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd36898-359f-4eaf-98d6-a94b966a99ef" containerName="main"
Jul 23 22:17:26.537558 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.537490    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd36898-359f-4eaf-98d6-a94b966a99ef" containerName="main"
Jul 23 22:17:26.540646 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.540625    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:26.543875 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.543849    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d9fc566f-serving-cert\""
Jul 23 22:17:26.557857 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.557821    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"]
Jul 23 22:17:26.680046 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.680008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfqz5\" (UniqueName: \"kubernetes.io/projected/91f9dabf-6f62-4a14-b674-202caacb929d-kube-api-access-lfqz5\") pod \"maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:26.680327 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.680090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91f9dabf-6f62-4a14-b674-202caacb929d-openshift-service-ca\") pod \"maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:26.680327 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.680120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91f9dabf-6f62-4a14-b674-202caacb929d-maas-api-tls\") pod \"maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:26.781425 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.781393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91f9dabf-6f62-4a14-b674-202caacb929d-openshift-service-ca\") pod \"maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:26.781605 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.781451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91f9dabf-6f62-4a14-b674-202caacb929d-maas-api-tls\") pod \"maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:26.781605 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.781498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfqz5\" (UniqueName: \"kubernetes.io/projected/91f9dabf-6f62-4a14-b674-202caacb929d-kube-api-access-lfqz5\") pod \"maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:26.781691 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:17:26.781603    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-serving-cert: secret "maas-api-e2e-ait-d9fc566f-serving-cert" not found
Jul 23 22:17:26.781729 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:17:26.781691    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91f9dabf-6f62-4a14-b674-202caacb929d-maas-api-tls podName:91f9dabf-6f62-4a14-b674-202caacb929d nodeName:}" failed. No retries permitted until 2026-07-23 22:17:27.281667361 +0000 UTC m=+1551.316374895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91f9dabf-6f62-4a14-b674-202caacb929d-maas-api-tls") pod "maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr" (UID: "91f9dabf-6f62-4a14-b674-202caacb929d") : secret "maas-api-e2e-ait-d9fc566f-serving-cert" not found
Jul 23 22:17:26.782121 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.782101    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91f9dabf-6f62-4a14-b674-202caacb929d-openshift-service-ca\") pod \"maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:26.792051 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:26.791984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfqz5\" (UniqueName: \"kubernetes.io/projected/91f9dabf-6f62-4a14-b674-202caacb929d-kube-api-access-lfqz5\") pod \"maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:27.285521 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:27.285484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91f9dabf-6f62-4a14-b674-202caacb929d-maas-api-tls\") pod \"maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:27.287969 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:27.287946    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91f9dabf-6f62-4a14-b674-202caacb929d-maas-api-tls\") pod \"maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:27.451049 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:27.451008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:27.598664 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:27.598562    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"]
Jul 23 22:17:27.601803 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:17:27.601768    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f9dabf_6f62_4a14_b674_202caacb929d.slice/crio-bb36d5969487b342891ed0517ea0916b966930d143712b714c6e76bcfe7b0eff WatchSource:0}: Error finding container bb36d5969487b342891ed0517ea0916b966930d143712b714c6e76bcfe7b0eff: Status 404 returned error can't find the container with id bb36d5969487b342891ed0517ea0916b966930d143712b714c6e76bcfe7b0eff
Jul 23 22:17:27.603430 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:27.603410    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 22:17:27.886745 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:27.886641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr" event={"ID":"91f9dabf-6f62-4a14-b674-202caacb929d","Type":"ContainerStarted","Data":"bb36d5969487b342891ed0517ea0916b966930d143712b714c6e76bcfe7b0eff"}
Jul 23 22:17:28.892026 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:28.891990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr" event={"ID":"91f9dabf-6f62-4a14-b674-202caacb929d","Type":"ContainerStarted","Data":"d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6"}
Jul 23 22:17:28.892436 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:28.892110    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:17:28.916142 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:28.916091    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr" podStartSLOduration=2.468654845 podStartE2EDuration="2.916076938s" totalImagesPullingTime="447.422093ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:17:28.915412275 +0000 UTC m=+1552.950119817" watchObservedRunningTime="2026-07-23 22:17:28.916076938 +0000 UTC m=+1552.950784477"
Jul 23 22:17:34.901495 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:17:34.901468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:18:02.570105 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.570068    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"]
Jul 23 22:18:02.570954 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.570459    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr" podUID="91f9dabf-6f62-4a14-b674-202caacb929d" containerName="maas-api" containerID="cri-o://d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6" gracePeriod=30
Jul 23 22:18:02.820902 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.820842    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:18:02.890380 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.890346    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91f9dabf-6f62-4a14-b674-202caacb929d-maas-api-tls\") pod \"91f9dabf-6f62-4a14-b674-202caacb929d\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") "
Jul 23 22:18:02.890546 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.890409    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91f9dabf-6f62-4a14-b674-202caacb929d-openshift-service-ca\") pod \"91f9dabf-6f62-4a14-b674-202caacb929d\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") "
Jul 23 22:18:02.890546 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.890437    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfqz5\" (UniqueName: \"kubernetes.io/projected/91f9dabf-6f62-4a14-b674-202caacb929d-kube-api-access-lfqz5\") pod \"91f9dabf-6f62-4a14-b674-202caacb929d\" (UID: \"91f9dabf-6f62-4a14-b674-202caacb929d\") "
Jul 23 22:18:02.890750 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.890724    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91f9dabf-6f62-4a14-b674-202caacb929d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91f9dabf-6f62-4a14-b674-202caacb929d" (UID: "91f9dabf-6f62-4a14-b674-202caacb929d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 22:18:02.892578 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.892551    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91f9dabf-6f62-4a14-b674-202caacb929d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91f9dabf-6f62-4a14-b674-202caacb929d" (UID: "91f9dabf-6f62-4a14-b674-202caacb929d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:18:02.892674 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.892614    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f9dabf-6f62-4a14-b674-202caacb929d-kube-api-access-lfqz5" (OuterVolumeSpecName: "kube-api-access-lfqz5") pod "91f9dabf-6f62-4a14-b674-202caacb929d" (UID: "91f9dabf-6f62-4a14-b674-202caacb929d"). InnerVolumeSpecName "kube-api-access-lfqz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:18:02.992027 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.991986    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91f9dabf-6f62-4a14-b674-202caacb929d-maas-api-tls\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:18:02.992027 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.992021    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91f9dabf-6f62-4a14-b674-202caacb929d-openshift-service-ca\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:18:02.992027 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:02.992035    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfqz5\" (UniqueName: \"kubernetes.io/projected/91f9dabf-6f62-4a14-b674-202caacb929d-kube-api-access-lfqz5\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:18:03.031668 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:03.031630    2565 generic.go:356] "Generic (PLEG): container finished" podID="91f9dabf-6f62-4a14-b674-202caacb929d" containerID="d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6" exitCode=0
Jul 23 22:18:03.031819 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:03.031680    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"
Jul 23 22:18:03.031819 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:03.031693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr" event={"ID":"91f9dabf-6f62-4a14-b674-202caacb929d","Type":"ContainerDied","Data":"d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6"}
Jul 23 22:18:03.031819 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:03.031765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr" event={"ID":"91f9dabf-6f62-4a14-b674-202caacb929d","Type":"ContainerDied","Data":"bb36d5969487b342891ed0517ea0916b966930d143712b714c6e76bcfe7b0eff"}
Jul 23 22:18:03.031819 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:03.031787    2565 scope.go:117] "RemoveContainer" containerID="d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6"
Jul 23 22:18:03.040027 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:03.040009    2565 scope.go:117] "RemoveContainer" containerID="d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6"
Jul 23 22:18:03.040321 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:18:03.040302    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6\": container with ID starting with d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6 not found: ID does not exist" containerID="d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6"
Jul 23 22:18:03.040396 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:03.040328    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6"} err="failed to get container status \"d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6\": rpc error: code = NotFound desc = could not find container \"d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6\": container with ID starting with d6d31e84bf509c24f3d56ebf7b1685f43a249a35d9764c6390cdb9ce2ec5dec6 not found: ID does not exist"
Jul 23 22:18:03.053071 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:03.053047    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"]
Jul 23 22:18:03.056422 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:03.056401    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9fc566f-757bbbc4bf-lf7lr"]
Jul 23 22:18:04.481831 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:04.481796    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91f9dabf-6f62-4a14-b674-202caacb929d" path="/var/lib/kubelet/pods/91f9dabf-6f62-4a14-b674-202caacb929d/volumes"
Jul 23 22:18:10.787452 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:10.787422    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"]
Jul 23 22:18:10.787826 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:10.787741    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f9dabf-6f62-4a14-b674-202caacb929d" containerName="maas-api"
Jul 23 22:18:10.787826 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:10.787753    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f9dabf-6f62-4a14-b674-202caacb929d" containerName="maas-api"
Jul 23 22:18:10.787826 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:10.787824    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f9dabf-6f62-4a14-b674-202caacb929d" containerName="maas-api"
Jul 23 22:18:10.790780 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:10.790761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:10.793902 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:10.793879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c334d424-serving-cert\""
Jul 23 22:18:10.804547 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:10.804521    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"]
Jul 23 22:18:10.958827 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:10.958790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9e838a3-325d-4b47-b9f9-104a17fc5c28-openshift-service-ca\") pod \"maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:10.958827 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:10.958832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wkb4\" (UniqueName: \"kubernetes.io/projected/a9e838a3-325d-4b47-b9f9-104a17fc5c28-kube-api-access-9wkb4\") pod \"maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:10.959095 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:10.958998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9e838a3-325d-4b47-b9f9-104a17fc5c28-maas-api-tls\") pod \"maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:11.060234 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:11.060119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9e838a3-325d-4b47-b9f9-104a17fc5c28-maas-api-tls\") pod \"maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:11.060234 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:11.060162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9e838a3-325d-4b47-b9f9-104a17fc5c28-openshift-service-ca\") pod \"maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:11.060234 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:11.060191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wkb4\" (UniqueName: \"kubernetes.io/projected/a9e838a3-325d-4b47-b9f9-104a17fc5c28-kube-api-access-9wkb4\") pod \"maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:11.060886 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:11.060856    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9e838a3-325d-4b47-b9f9-104a17fc5c28-openshift-service-ca\") pod \"maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:11.062763 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:11.062739    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9e838a3-325d-4b47-b9f9-104a17fc5c28-maas-api-tls\") pod \"maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:11.078872 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:11.078848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wkb4\" (UniqueName: \"kubernetes.io/projected/a9e838a3-325d-4b47-b9f9-104a17fc5c28-kube-api-access-9wkb4\") pod \"maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:11.101858 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:11.101837    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:11.234812 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:11.234789    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"]
Jul 23 22:18:11.237105 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:18:11.237078    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e838a3_325d_4b47_b9f9_104a17fc5c28.slice/crio-77a0bb90af3e560b873fb6f108bae9ddc3d2b131280db0e932a7591930e008bf WatchSource:0}: Error finding container 77a0bb90af3e560b873fb6f108bae9ddc3d2b131280db0e932a7591930e008bf: Status 404 returned error can't find the container with id 77a0bb90af3e560b873fb6f108bae9ddc3d2b131280db0e932a7591930e008bf
Jul 23 22:18:12.071289 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:12.071251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r" event={"ID":"a9e838a3-325d-4b47-b9f9-104a17fc5c28","Type":"ContainerStarted","Data":"ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad"}
Jul 23 22:18:12.071663 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:12.071316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r" event={"ID":"a9e838a3-325d-4b47-b9f9-104a17fc5c28","Type":"ContainerStarted","Data":"77a0bb90af3e560b873fb6f108bae9ddc3d2b131280db0e932a7591930e008bf"}
Jul 23 22:18:12.071663 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:12.071358    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:12.090705 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:12.090650    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r" podStartSLOduration=1.6989338410000001 podStartE2EDuration="2.09063681s" totalImagesPullingTime="391.702969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:18:12.090015832 +0000 UTC m=+1596.124723372" watchObservedRunningTime="2026-07-23 22:18:12.09063681 +0000 UTC m=+1596.125344349"
Jul 23 22:18:18.080742 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:18.080715    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:46.223284 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.223247    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"]
Jul 23 22:18:46.223782 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.223497    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r" podUID="a9e838a3-325d-4b47-b9f9-104a17fc5c28" containerName="maas-api" containerID="cri-o://ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad" gracePeriod=30
Jul 23 22:18:46.464389 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.464364    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:46.555928 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.555895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9e838a3-325d-4b47-b9f9-104a17fc5c28-openshift-service-ca\") pod \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") "
Jul 23 22:18:46.556094 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.555967    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9e838a3-325d-4b47-b9f9-104a17fc5c28-maas-api-tls\") pod \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") "
Jul 23 22:18:46.556094 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.556009    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wkb4\" (UniqueName: \"kubernetes.io/projected/a9e838a3-325d-4b47-b9f9-104a17fc5c28-kube-api-access-9wkb4\") pod \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\" (UID: \"a9e838a3-325d-4b47-b9f9-104a17fc5c28\") "
Jul 23 22:18:46.556329 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.556298    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9e838a3-325d-4b47-b9f9-104a17fc5c28-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a9e838a3-325d-4b47-b9f9-104a17fc5c28" (UID: "a9e838a3-325d-4b47-b9f9-104a17fc5c28"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 22:18:46.556468 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.556426    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9e838a3-325d-4b47-b9f9-104a17fc5c28-openshift-service-ca\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:18:46.558655 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.558634    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e838a3-325d-4b47-b9f9-104a17fc5c28-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a9e838a3-325d-4b47-b9f9-104a17fc5c28" (UID: "a9e838a3-325d-4b47-b9f9-104a17fc5c28"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:18:46.558756 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.558658    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9e838a3-325d-4b47-b9f9-104a17fc5c28-kube-api-access-9wkb4" (OuterVolumeSpecName: "kube-api-access-9wkb4") pod "a9e838a3-325d-4b47-b9f9-104a17fc5c28" (UID: "a9e838a3-325d-4b47-b9f9-104a17fc5c28"). InnerVolumeSpecName "kube-api-access-9wkb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:18:46.656871 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.656833    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wkb4\" (UniqueName: \"kubernetes.io/projected/a9e838a3-325d-4b47-b9f9-104a17fc5c28-kube-api-access-9wkb4\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:18:46.656871 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:46.656868    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9e838a3-325d-4b47-b9f9-104a17fc5c28-maas-api-tls\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:18:47.215173 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:47.215140    2565 generic.go:356] "Generic (PLEG): container finished" podID="a9e838a3-325d-4b47-b9f9-104a17fc5c28" containerID="ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad" exitCode=0
Jul 23 22:18:47.215339 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:47.215183    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"
Jul 23 22:18:47.215339 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:47.215241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r" event={"ID":"a9e838a3-325d-4b47-b9f9-104a17fc5c28","Type":"ContainerDied","Data":"ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad"}
Jul 23 22:18:47.215339 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:47.215286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r" event={"ID":"a9e838a3-325d-4b47-b9f9-104a17fc5c28","Type":"ContainerDied","Data":"77a0bb90af3e560b873fb6f108bae9ddc3d2b131280db0e932a7591930e008bf"}
Jul 23 22:18:47.215339 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:47.215308    2565 scope.go:117] "RemoveContainer" containerID="ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad"
Jul 23 22:18:47.224852 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:47.224640    2565 scope.go:117] "RemoveContainer" containerID="ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad"
Jul 23 22:18:47.225074 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:18:47.224892    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad\": container with ID starting with ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad not found: ID does not exist" containerID="ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad"
Jul 23 22:18:47.225074 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:47.224914    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad"} err="failed to get container status \"ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad\": rpc error: code = NotFound desc = could not find container \"ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad\": container with ID starting with ee21694368a44daf6079306e5cca640cd8d2dc6a933dba269062b652e25ba0ad not found: ID does not exist"
Jul 23 22:18:47.246873 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:47.246840    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"]
Jul 23 22:18:47.252015 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:47.251994    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c334d424-598ffc6946-bwt5r"]
Jul 23 22:18:48.487034 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:48.486999    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9e838a3-325d-4b47-b9f9-104a17fc5c28" path="/var/lib/kubelet/pods/a9e838a3-325d-4b47-b9f9-104a17fc5c28/volumes"
Jul 23 22:18:53.941339 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:53.941308    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"]
Jul 23 22:18:53.941705 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:53.941605    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9e838a3-325d-4b47-b9f9-104a17fc5c28" containerName="maas-api"
Jul 23 22:18:53.941705 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:53.941616    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e838a3-325d-4b47-b9f9-104a17fc5c28" containerName="maas-api"
Jul 23 22:18:53.941705 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:53.941678    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9e838a3-325d-4b47-b9f9-104a17fc5c28" containerName="maas-api"
Jul 23 22:18:53.945781 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:53.945757    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:53.948507 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:53.948489    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c965c007-serving-cert\""
Jul 23 22:18:53.957195 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:53.957164    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"]
Jul 23 22:18:54.017023 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.016988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c96389e8-523a-4b4d-96d4-260958327245-openshift-service-ca\") pod \"maas-api-e2e-ait-c965c007-846887cdc7-5m5tj\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:54.017209 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.017044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk9n7\" (UniqueName: \"kubernetes.io/projected/c96389e8-523a-4b4d-96d4-260958327245-kube-api-access-fk9n7\") pod \"maas-api-e2e-ait-c965c007-846887cdc7-5m5tj\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:54.017209 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.017071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c96389e8-523a-4b4d-96d4-260958327245-maas-api-tls\") pod \"maas-api-e2e-ait-c965c007-846887cdc7-5m5tj\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:54.118294 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.118255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c96389e8-523a-4b4d-96d4-260958327245-maas-api-tls\") pod \"maas-api-e2e-ait-c965c007-846887cdc7-5m5tj\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:54.118473 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.118350    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c96389e8-523a-4b4d-96d4-260958327245-openshift-service-ca\") pod \"maas-api-e2e-ait-c965c007-846887cdc7-5m5tj\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:54.118473 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.118412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk9n7\" (UniqueName: \"kubernetes.io/projected/c96389e8-523a-4b4d-96d4-260958327245-kube-api-access-fk9n7\") pod \"maas-api-e2e-ait-c965c007-846887cdc7-5m5tj\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:54.118473 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:18:54.118414    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-serving-cert: secret "maas-api-e2e-ait-c965c007-serving-cert" not found
Jul 23 22:18:54.118582 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:18:54.118527    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c96389e8-523a-4b4d-96d4-260958327245-maas-api-tls podName:c96389e8-523a-4b4d-96d4-260958327245 nodeName:}" failed. No retries permitted until 2026-07-23 22:18:54.618505788 +0000 UTC m=+1638.653213312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c96389e8-523a-4b4d-96d4-260958327245-maas-api-tls") pod "maas-api-e2e-ait-c965c007-846887cdc7-5m5tj" (UID: "c96389e8-523a-4b4d-96d4-260958327245") : secret "maas-api-e2e-ait-c965c007-serving-cert" not found
Jul 23 22:18:54.119001 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.118983    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c96389e8-523a-4b4d-96d4-260958327245-openshift-service-ca\") pod \"maas-api-e2e-ait-c965c007-846887cdc7-5m5tj\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:54.130623 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.130594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk9n7\" (UniqueName: \"kubernetes.io/projected/c96389e8-523a-4b4d-96d4-260958327245-kube-api-access-fk9n7\") pod \"maas-api-e2e-ait-c965c007-846887cdc7-5m5tj\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:54.623266 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.623203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c96389e8-523a-4b4d-96d4-260958327245-maas-api-tls\") pod \"maas-api-e2e-ait-c965c007-846887cdc7-5m5tj\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:54.625670 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.625643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c96389e8-523a-4b4d-96d4-260958327245-maas-api-tls\") pod \"maas-api-e2e-ait-c965c007-846887cdc7-5m5tj\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:54.857776 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.857738    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:54.997475 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:54.997329    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"]
Jul 23 22:18:55.000280 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:18:55.000248    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc96389e8_523a_4b4d_96d4_260958327245.slice/crio-8a6cee3ed375693351b2deb290ce7ef91f2ede96cfc4cc98f6eb0bb6fe2c0e38 WatchSource:0}: Error finding container 8a6cee3ed375693351b2deb290ce7ef91f2ede96cfc4cc98f6eb0bb6fe2c0e38: Status 404 returned error can't find the container with id 8a6cee3ed375693351b2deb290ce7ef91f2ede96cfc4cc98f6eb0bb6fe2c0e38
Jul 23 22:18:55.251581 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:55.251494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj" event={"ID":"c96389e8-523a-4b4d-96d4-260958327245","Type":"ContainerStarted","Data":"8a6cee3ed375693351b2deb290ce7ef91f2ede96cfc4cc98f6eb0bb6fe2c0e38"}
Jul 23 22:18:56.257915 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:56.257880    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj" event={"ID":"c96389e8-523a-4b4d-96d4-260958327245","Type":"ContainerStarted","Data":"82d4661c19fab7afa4ebf61fc673dd8b4c32f2ac1307f69b7d75f974178b8578"}
Jul 23 22:18:56.258347 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:56.258010    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:18:56.276490 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:18:56.276437    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj" podStartSLOduration=2.902342969 podStartE2EDuration="3.276422114s" totalImagesPullingTime="374.079145ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:18:56.275240926 +0000 UTC m=+1640.309948466" watchObservedRunningTime="2026-07-23 22:18:56.276422114 +0000 UTC m=+1640.311129652"
Jul 23 22:19:02.268593 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:02.268560    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:19:30.256206 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.256171    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"]
Jul 23 22:19:30.258717 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.256401    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj" podUID="c96389e8-523a-4b4d-96d4-260958327245" containerName="maas-api" containerID="cri-o://82d4661c19fab7afa4ebf61fc673dd8b4c32f2ac1307f69b7d75f974178b8578" gracePeriod=30
Jul 23 22:19:30.405627 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.405593    2565 generic.go:356] "Generic (PLEG): container finished" podID="c96389e8-523a-4b4d-96d4-260958327245" containerID="82d4661c19fab7afa4ebf61fc673dd8b4c32f2ac1307f69b7d75f974178b8578" exitCode=0
Jul 23 22:19:30.405804 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.405665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj" event={"ID":"c96389e8-523a-4b4d-96d4-260958327245","Type":"ContainerDied","Data":"82d4661c19fab7afa4ebf61fc673dd8b4c32f2ac1307f69b7d75f974178b8578"}
Jul 23 22:19:30.496271 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.496244    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:19:30.531577 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.531542    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fk9n7\" (UniqueName: \"kubernetes.io/projected/c96389e8-523a-4b4d-96d4-260958327245-kube-api-access-fk9n7\") pod \"c96389e8-523a-4b4d-96d4-260958327245\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") "
Jul 23 22:19:30.531742 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.531628    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c96389e8-523a-4b4d-96d4-260958327245-openshift-service-ca\") pod \"c96389e8-523a-4b4d-96d4-260958327245\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") "
Jul 23 22:19:30.531742 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.531697    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c96389e8-523a-4b4d-96d4-260958327245-maas-api-tls\") pod \"c96389e8-523a-4b4d-96d4-260958327245\" (UID: \"c96389e8-523a-4b4d-96d4-260958327245\") "
Jul 23 22:19:30.532012 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.531983    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c96389e8-523a-4b4d-96d4-260958327245-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c96389e8-523a-4b4d-96d4-260958327245" (UID: "c96389e8-523a-4b4d-96d4-260958327245"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 22:19:30.533608 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.533585    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c96389e8-523a-4b4d-96d4-260958327245-kube-api-access-fk9n7" (OuterVolumeSpecName: "kube-api-access-fk9n7") pod "c96389e8-523a-4b4d-96d4-260958327245" (UID: "c96389e8-523a-4b4d-96d4-260958327245"). InnerVolumeSpecName "kube-api-access-fk9n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:19:30.533768 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.533750    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c96389e8-523a-4b4d-96d4-260958327245-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c96389e8-523a-4b4d-96d4-260958327245" (UID: "c96389e8-523a-4b4d-96d4-260958327245"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:19:30.632917 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.632877    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c96389e8-523a-4b4d-96d4-260958327245-maas-api-tls\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:19:30.632917 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.632909    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk9n7\" (UniqueName: \"kubernetes.io/projected/c96389e8-523a-4b4d-96d4-260958327245-kube-api-access-fk9n7\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:19:30.632917 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:30.632921    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c96389e8-523a-4b4d-96d4-260958327245-openshift-service-ca\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:19:31.410997 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:31.410959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj" event={"ID":"c96389e8-523a-4b4d-96d4-260958327245","Type":"ContainerDied","Data":"8a6cee3ed375693351b2deb290ce7ef91f2ede96cfc4cc98f6eb0bb6fe2c0e38"}
Jul 23 22:19:31.410997 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:31.410976    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"
Jul 23 22:19:31.411506 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:31.411020    2565 scope.go:117] "RemoveContainer" containerID="82d4661c19fab7afa4ebf61fc673dd8b4c32f2ac1307f69b7d75f974178b8578"
Jul 23 22:19:31.433375 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:31.433353    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"]
Jul 23 22:19:31.441937 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:31.441908    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c965c007-846887cdc7-5m5tj"]
Jul 23 22:19:32.481315 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:32.481284    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c96389e8-523a-4b4d-96d4-260958327245" path="/var/lib/kubelet/pods/c96389e8-523a-4b4d-96d4-260958327245/volumes"
Jul 23 22:19:39.250123 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.250092    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"]
Jul 23 22:19:39.250513 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.250428    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c96389e8-523a-4b4d-96d4-260958327245" containerName="maas-api"
Jul 23 22:19:39.250513 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.250440    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c96389e8-523a-4b4d-96d4-260958327245" containerName="maas-api"
Jul 23 22:19:39.250513 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.250507    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c96389e8-523a-4b4d-96d4-260958327245" containerName="maas-api"
Jul 23 22:19:39.253367 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.253351    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:39.256459 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.256440    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-3301d6b9-serving-cert\""
Jul 23 22:19:39.268696 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.268668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"]
Jul 23 22:19:39.304413 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.304379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdt9m\" (UniqueName: \"kubernetes.io/projected/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-kube-api-access-pdt9m\") pod \"maas-api-e2e-derive-3301d6b9-594558477c-5bhpb\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:39.304577 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.304450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-maas-api-tls\") pod \"maas-api-e2e-derive-3301d6b9-594558477c-5bhpb\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:39.304577 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.304520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-openshift-service-ca\") pod \"maas-api-e2e-derive-3301d6b9-594558477c-5bhpb\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:39.405890 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.405849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdt9m\" (UniqueName: \"kubernetes.io/projected/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-kube-api-access-pdt9m\") pod \"maas-api-e2e-derive-3301d6b9-594558477c-5bhpb\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:39.406075 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.405926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-maas-api-tls\") pod \"maas-api-e2e-derive-3301d6b9-594558477c-5bhpb\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:39.406075 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.405979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-openshift-service-ca\") pod \"maas-api-e2e-derive-3301d6b9-594558477c-5bhpb\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:39.406209 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:19:39.406078    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-serving-cert: secret "maas-api-e2e-derive-3301d6b9-serving-cert" not found
Jul 23 22:19:39.406209 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:19:39.406169    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-maas-api-tls podName:9be4fc06-4193-4c48-bc9f-b5fb4a773cd8 nodeName:}" failed. No retries permitted until 2026-07-23 22:19:39.906145772 +0000 UTC m=+1683.940853293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-maas-api-tls") pod "maas-api-e2e-derive-3301d6b9-594558477c-5bhpb" (UID: "9be4fc06-4193-4c48-bc9f-b5fb4a773cd8") : secret "maas-api-e2e-derive-3301d6b9-serving-cert" not found
Jul 23 22:19:39.406767 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.406743    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-openshift-service-ca\") pod \"maas-api-e2e-derive-3301d6b9-594558477c-5bhpb\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:39.416336 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.416310    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdt9m\" (UniqueName: \"kubernetes.io/projected/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-kube-api-access-pdt9m\") pod \"maas-api-e2e-derive-3301d6b9-594558477c-5bhpb\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:39.911541 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.911510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-maas-api-tls\") pod \"maas-api-e2e-derive-3301d6b9-594558477c-5bhpb\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:39.913890 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:39.913860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-maas-api-tls\") pod \"maas-api-e2e-derive-3301d6b9-594558477c-5bhpb\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:40.163682 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:40.163590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:40.294194 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:40.294167    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"]
Jul 23 22:19:40.295652 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:19:40.295627    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be4fc06_4193_4c48_bc9f_b5fb4a773cd8.slice/crio-ec54715e7222178dae602cf2a09336df448614ea84791eed61789642a95b6dc0 WatchSource:0}: Error finding container ec54715e7222178dae602cf2a09336df448614ea84791eed61789642a95b6dc0: Status 404 returned error can't find the container with id ec54715e7222178dae602cf2a09336df448614ea84791eed61789642a95b6dc0
Jul 23 22:19:40.452008 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:40.451916    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb" event={"ID":"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8","Type":"ContainerStarted","Data":"ec54715e7222178dae602cf2a09336df448614ea84791eed61789642a95b6dc0"}
Jul 23 22:19:41.457900 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:41.457867    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb" event={"ID":"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8","Type":"ContainerStarted","Data":"7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d"}
Jul 23 22:19:41.458312 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:41.457943    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:19:41.477818 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:41.477768    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb" podStartSLOduration=2.069630024 podStartE2EDuration="2.477754392s" totalImagesPullingTime="408.124368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:19:41.476678574 +0000 UTC m=+1685.511386112" watchObservedRunningTime="2026-07-23 22:19:41.477754392 +0000 UTC m=+1685.512461980"
Jul 23 22:19:47.467090 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:19:47.467059    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:20:14.616821 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.616725    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"]
Jul 23 22:20:14.617739 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.616991    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb" podUID="9be4fc06-4193-4c48-bc9f-b5fb4a773cd8" containerName="maas-api" containerID="cri-o://7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d" gracePeriod=30
Jul 23 22:20:14.860355 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.860328    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:20:14.897517 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.897441    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-maas-api-tls\") pod \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") "
Jul 23 22:20:14.897517 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.897476    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-openshift-service-ca\") pod \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") "
Jul 23 22:20:14.897517 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.897508    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdt9m\" (UniqueName: \"kubernetes.io/projected/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-kube-api-access-pdt9m\") pod \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\" (UID: \"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8\") "
Jul 23 22:20:14.897889 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.897858    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9be4fc06-4193-4c48-bc9f-b5fb4a773cd8" (UID: "9be4fc06-4193-4c48-bc9f-b5fb4a773cd8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 22:20:14.899567 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.899538    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9be4fc06-4193-4c48-bc9f-b5fb4a773cd8" (UID: "9be4fc06-4193-4c48-bc9f-b5fb4a773cd8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:20:14.899668 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.899607    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-kube-api-access-pdt9m" (OuterVolumeSpecName: "kube-api-access-pdt9m") pod "9be4fc06-4193-4c48-bc9f-b5fb4a773cd8" (UID: "9be4fc06-4193-4c48-bc9f-b5fb4a773cd8"). InnerVolumeSpecName "kube-api-access-pdt9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:20:14.998651 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.998618    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-maas-api-tls\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:20:14.998651 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.998644    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-openshift-service-ca\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:20:14.998651 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:14.998655    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdt9m\" (UniqueName: \"kubernetes.io/projected/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8-kube-api-access-pdt9m\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:20:15.597391 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:15.597352    2565 generic.go:356] "Generic (PLEG): container finished" podID="9be4fc06-4193-4c48-bc9f-b5fb4a773cd8" containerID="7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d" exitCode=0
Jul 23 22:20:15.597588 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:15.597396    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"
Jul 23 22:20:15.597588 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:15.597416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb" event={"ID":"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8","Type":"ContainerDied","Data":"7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d"}
Jul 23 22:20:15.597588 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:15.597466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb" event={"ID":"9be4fc06-4193-4c48-bc9f-b5fb4a773cd8","Type":"ContainerDied","Data":"ec54715e7222178dae602cf2a09336df448614ea84791eed61789642a95b6dc0"}
Jul 23 22:20:15.597588 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:15.597490    2565 scope.go:117] "RemoveContainer" containerID="7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d"
Jul 23 22:20:15.606954 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:15.606938    2565 scope.go:117] "RemoveContainer" containerID="7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d"
Jul 23 22:20:15.607193 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:20:15.607172    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d\": container with ID starting with 7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d not found: ID does not exist" containerID="7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d"
Jul 23 22:20:15.607295 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:15.607205    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d"} err="failed to get container status \"7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d\": rpc error: code = NotFound desc = could not find container \"7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d\": container with ID starting with 7bbc41d7433ebbc4edec931e97b43a950320452ea0b7d4f08138bc86970a0c3d not found: ID does not exist"
Jul 23 22:20:15.621943 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:15.621914    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"]
Jul 23 22:20:15.625793 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:15.625769    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3301d6b9-594558477c-5bhpb"]
Jul 23 22:20:16.481929 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:20:16.481896    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9be4fc06-4193-4c48-bc9f-b5fb4a773cd8" path="/var/lib/kubelet/pods/9be4fc06-4193-4c48-bc9f-b5fb4a773cd8/volumes"
Jul 23 22:21:36.473800 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:21:36.473770    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:21:36.476813 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:21:36.476790    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:22:00.603642 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.603611    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"]
Jul 23 22:22:00.604152 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.604067    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9be4fc06-4193-4c48-bc9f-b5fb4a773cd8" containerName="maas-api"
Jul 23 22:22:00.604152 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.604084    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9be4fc06-4193-4c48-bc9f-b5fb4a773cd8" containerName="maas-api"
Jul 23 22:22:00.604152 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.604153    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9be4fc06-4193-4c48-bc9f-b5fb4a773cd8" containerName="maas-api"
Jul 23 22:22:00.607040 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.607020    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:00.609554 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.609533    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5d321d11-serving-cert\""
Jul 23 22:22:00.623374 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.623352    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"]
Jul 23 22:22:00.795325 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.795285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3e76604-7ac9-407e-916c-821f7f56f681-maas-api-tls\") pod \"maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:00.795515 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.795363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdqmw\" (UniqueName: \"kubernetes.io/projected/e3e76604-7ac9-407e-916c-821f7f56f681-kube-api-access-mdqmw\") pod \"maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:00.795515 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.795447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3e76604-7ac9-407e-916c-821f7f56f681-openshift-service-ca\") pod \"maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:00.896170 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.896072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3e76604-7ac9-407e-916c-821f7f56f681-maas-api-tls\") pod \"maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:00.896170 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.896137    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqmw\" (UniqueName: \"kubernetes.io/projected/e3e76604-7ac9-407e-916c-821f7f56f681-kube-api-access-mdqmw\") pod \"maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:00.896170 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.896171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3e76604-7ac9-407e-916c-821f7f56f681-openshift-service-ca\") pod \"maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:00.896481 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:22:00.896266    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-serving-cert: secret "maas-api-e2e-mt-5d321d11-serving-cert" not found
Jul 23 22:22:00.896481 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:22:00.896350    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e76604-7ac9-407e-916c-821f7f56f681-maas-api-tls podName:e3e76604-7ac9-407e-916c-821f7f56f681 nodeName:}" failed. No retries permitted until 2026-07-23 22:22:01.396329369 +0000 UTC m=+1825.431036897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e3e76604-7ac9-407e-916c-821f7f56f681-maas-api-tls") pod "maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt" (UID: "e3e76604-7ac9-407e-916c-821f7f56f681") : secret "maas-api-e2e-mt-5d321d11-serving-cert" not found
Jul 23 22:22:00.896871 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.896848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3e76604-7ac9-407e-916c-821f7f56f681-openshift-service-ca\") pod \"maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:00.912941 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:00.912913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdqmw\" (UniqueName: \"kubernetes.io/projected/e3e76604-7ac9-407e-916c-821f7f56f681-kube-api-access-mdqmw\") pod \"maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:01.401697 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:01.401658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3e76604-7ac9-407e-916c-821f7f56f681-maas-api-tls\") pod \"maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:01.404321 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:01.404290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3e76604-7ac9-407e-916c-821f7f56f681-maas-api-tls\") pod \"maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:01.517494 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:01.517439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:01.664610 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:01.664563    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"]
Jul 23 22:22:01.667345 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:22:01.667307    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e76604_7ac9_407e_916c_821f7f56f681.slice/crio-011aa21d82efdc3be957259f4cfc99672c8d44287c327de9780f47a5f132eedb WatchSource:0}: Error finding container 011aa21d82efdc3be957259f4cfc99672c8d44287c327de9780f47a5f132eedb: Status 404 returned error can't find the container with id 011aa21d82efdc3be957259f4cfc99672c8d44287c327de9780f47a5f132eedb
Jul 23 22:22:02.035532 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:02.035497    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt" event={"ID":"e3e76604-7ac9-407e-916c-821f7f56f681","Type":"ContainerStarted","Data":"011aa21d82efdc3be957259f4cfc99672c8d44287c327de9780f47a5f132eedb"}
Jul 23 22:22:03.041813 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:03.041764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt" event={"ID":"e3e76604-7ac9-407e-916c-821f7f56f681","Type":"ContainerStarted","Data":"fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2"}
Jul 23 22:22:03.042328 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:03.041930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:03.063317 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:03.063264    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt" podStartSLOduration=2.453815711 podStartE2EDuration="3.063247922s" totalImagesPullingTime="609.432211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:22:03.061280324 +0000 UTC m=+1827.095987876" watchObservedRunningTime="2026-07-23 22:22:03.063247922 +0000 UTC m=+1827.097955468"
Jul 23 22:22:09.051261 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:09.051232    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:22.705263 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:22.705226    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"]
Jul 23 22:22:22.705801 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:22.705469    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt" podUID="e3e76604-7ac9-407e-916c-821f7f56f681" containerName="maas-api" containerID="cri-o://fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2" gracePeriod=30
Jul 23 22:22:22.938051 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:22.938030    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:22.957470 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:22.957396    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3e76604-7ac9-407e-916c-821f7f56f681-maas-api-tls\") pod \"e3e76604-7ac9-407e-916c-821f7f56f681\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") "
Jul 23 22:22:22.957590 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:22.957488    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdqmw\" (UniqueName: \"kubernetes.io/projected/e3e76604-7ac9-407e-916c-821f7f56f681-kube-api-access-mdqmw\") pod \"e3e76604-7ac9-407e-916c-821f7f56f681\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") "
Jul 23 22:22:22.960989 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:22.960945    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3e76604-7ac9-407e-916c-821f7f56f681-kube-api-access-mdqmw" (OuterVolumeSpecName: "kube-api-access-mdqmw") pod "e3e76604-7ac9-407e-916c-821f7f56f681" (UID: "e3e76604-7ac9-407e-916c-821f7f56f681"). InnerVolumeSpecName "kube-api-access-mdqmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:22:22.961108 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:22.960990    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3e76604-7ac9-407e-916c-821f7f56f681-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e3e76604-7ac9-407e-916c-821f7f56f681" (UID: "e3e76604-7ac9-407e-916c-821f7f56f681"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:22:23.058325 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.058295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3e76604-7ac9-407e-916c-821f7f56f681-openshift-service-ca\") pod \"e3e76604-7ac9-407e-916c-821f7f56f681\" (UID: \"e3e76604-7ac9-407e-916c-821f7f56f681\") "
Jul 23 22:22:23.058480 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.058459    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3e76604-7ac9-407e-916c-821f7f56f681-maas-api-tls\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:22:23.058480 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.058472    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdqmw\" (UniqueName: \"kubernetes.io/projected/e3e76604-7ac9-407e-916c-821f7f56f681-kube-api-access-mdqmw\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:22:23.058622 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.058601    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3e76604-7ac9-407e-916c-821f7f56f681-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e3e76604-7ac9-407e-916c-821f7f56f681" (UID: "e3e76604-7ac9-407e-916c-821f7f56f681"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 22:22:23.123122 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.123085    2565 generic.go:356] "Generic (PLEG): container finished" podID="e3e76604-7ac9-407e-916c-821f7f56f681" containerID="fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2" exitCode=0
Jul 23 22:22:23.123297 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.123134    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"
Jul 23 22:22:23.123297 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.123167    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt" event={"ID":"e3e76604-7ac9-407e-916c-821f7f56f681","Type":"ContainerDied","Data":"fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2"}
Jul 23 22:22:23.123297 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.123236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt" event={"ID":"e3e76604-7ac9-407e-916c-821f7f56f681","Type":"ContainerDied","Data":"011aa21d82efdc3be957259f4cfc99672c8d44287c327de9780f47a5f132eedb"}
Jul 23 22:22:23.123297 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.123267    2565 scope.go:117] "RemoveContainer" containerID="fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2"
Jul 23 22:22:23.132784 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.132770    2565 scope.go:117] "RemoveContainer" containerID="fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2"
Jul 23 22:22:23.133082 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:22:23.133062    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2\": container with ID starting with fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2 not found: ID does not exist" containerID="fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2"
Jul 23 22:22:23.133124 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.133092    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2"} err="failed to get container status \"fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2\": rpc error: code = NotFound desc = could not find container \"fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2\": container with ID starting with fb863d3b89730eb6a8f670734ac1a3e0797673bdcabe4e2eb10be2164c161fd2 not found: ID does not exist"
Jul 23 22:22:23.153473 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.149492    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"]
Jul 23 22:22:23.155495 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.155472    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5d321d11-7b95fbd75d-4wqxt"]
Jul 23 22:22:23.158929 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:23.158906    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3e76604-7ac9-407e-916c-821f7f56f681-openshift-service-ca\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:22:24.481481 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:24.481448    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3e76604-7ac9-407e-916c-821f7f56f681" path="/var/lib/kubelet/pods/e3e76604-7ac9-407e-916c-821f7f56f681/volumes"
Jul 23 22:22:56.973136 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:56.973091    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"]
Jul 23 22:22:56.973752 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:56.973614    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3e76604-7ac9-407e-916c-821f7f56f681" containerName="maas-api"
Jul 23 22:22:56.973752 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:56.973634    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3e76604-7ac9-407e-916c-821f7f56f681" containerName="maas-api"
Jul 23 22:22:56.973882 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:56.973756    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3e76604-7ac9-407e-916c-821f7f56f681" containerName="maas-api"
Jul 23 22:22:56.976862 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:56.976840    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:56.984644 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:56.984619    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0578d301-serving-cert\""
Jul 23 22:22:56.993160 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:56.993139    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"]
Jul 23 22:22:57.032108 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.032083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krcqg\" (UniqueName: \"kubernetes.io/projected/42cf6e55-c91a-4d42-a858-a7e842e217ea-kube-api-access-krcqg\") pod \"maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:57.032271 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.032133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42cf6e55-c91a-4d42-a858-a7e842e217ea-maas-api-tls\") pod \"maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:57.032344 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.032272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cf6e55-c91a-4d42-a858-a7e842e217ea-openshift-service-ca\") pod \"maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:57.133563 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.133526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cf6e55-c91a-4d42-a858-a7e842e217ea-openshift-service-ca\") pod \"maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:57.133749 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.133575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krcqg\" (UniqueName: \"kubernetes.io/projected/42cf6e55-c91a-4d42-a858-a7e842e217ea-kube-api-access-krcqg\") pod \"maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:57.133749 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.133599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42cf6e55-c91a-4d42-a858-a7e842e217ea-maas-api-tls\") pod \"maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:57.134166 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.134143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cf6e55-c91a-4d42-a858-a7e842e217ea-openshift-service-ca\") pod \"maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:57.136001 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.135981    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42cf6e55-c91a-4d42-a858-a7e842e217ea-maas-api-tls\") pod \"maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:57.146657 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.146633    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krcqg\" (UniqueName: \"kubernetes.io/projected/42cf6e55-c91a-4d42-a858-a7e842e217ea-kube-api-access-krcqg\") pod \"maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:57.287608 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.287580    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:57.417485 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.417451    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"]
Jul 23 22:22:57.420375 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:22:57.420344    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cf6e55_c91a_4d42_a858_a7e842e217ea.slice/crio-97df5218f23ae0e4e25baa8eaa29f0e4a95a977336dc18e198848d123d99dd04 WatchSource:0}: Error finding container 97df5218f23ae0e4e25baa8eaa29f0e4a95a977336dc18e198848d123d99dd04: Status 404 returned error can't find the container with id 97df5218f23ae0e4e25baa8eaa29f0e4a95a977336dc18e198848d123d99dd04
Jul 23 22:22:57.421706 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:57.421688    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 22:22:58.267100 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:58.267061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j" event={"ID":"42cf6e55-c91a-4d42-a858-a7e842e217ea","Type":"ContainerStarted","Data":"c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574"}
Jul 23 22:22:58.267550 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:58.267139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j" event={"ID":"42cf6e55-c91a-4d42-a858-a7e842e217ea","Type":"ContainerStarted","Data":"97df5218f23ae0e4e25baa8eaa29f0e4a95a977336dc18e198848d123d99dd04"}
Jul 23 22:22:58.267550 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:58.267170    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:22:58.287988 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:22:58.287947    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j" podStartSLOduration=1.9625062770000001 podStartE2EDuration="2.287932792s" totalImagesPullingTime="325.426515ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:22:58.286956393 +0000 UTC m=+1882.321663925" watchObservedRunningTime="2026-07-23 22:22:58.287932792 +0000 UTC m=+1882.322640331"
Jul 23 22:23:04.278701 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:23:04.278498    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:24:00.551103 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.551062    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"]
Jul 23 22:24:00.551752 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.551405    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j" podUID="42cf6e55-c91a-4d42-a858-a7e842e217ea" containerName="maas-api" containerID="cri-o://c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574" gracePeriod=30
Jul 23 22:24:00.795987 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.795955    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:24:00.884457 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.884352    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cf6e55-c91a-4d42-a858-a7e842e217ea-openshift-service-ca\") pod \"42cf6e55-c91a-4d42-a858-a7e842e217ea\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") "
Jul 23 22:24:00.884457 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.884411    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42cf6e55-c91a-4d42-a858-a7e842e217ea-maas-api-tls\") pod \"42cf6e55-c91a-4d42-a858-a7e842e217ea\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") "
Jul 23 22:24:00.884650 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.884481    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krcqg\" (UniqueName: \"kubernetes.io/projected/42cf6e55-c91a-4d42-a858-a7e842e217ea-kube-api-access-krcqg\") pod \"42cf6e55-c91a-4d42-a858-a7e842e217ea\" (UID: \"42cf6e55-c91a-4d42-a858-a7e842e217ea\") "
Jul 23 22:24:00.884760 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.884733    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42cf6e55-c91a-4d42-a858-a7e842e217ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "42cf6e55-c91a-4d42-a858-a7e842e217ea" (UID: "42cf6e55-c91a-4d42-a858-a7e842e217ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 22:24:00.886618 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.886585    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42cf6e55-c91a-4d42-a858-a7e842e217ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "42cf6e55-c91a-4d42-a858-a7e842e217ea" (UID: "42cf6e55-c91a-4d42-a858-a7e842e217ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:24:00.886737 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.886642    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42cf6e55-c91a-4d42-a858-a7e842e217ea-kube-api-access-krcqg" (OuterVolumeSpecName: "kube-api-access-krcqg") pod "42cf6e55-c91a-4d42-a858-a7e842e217ea" (UID: "42cf6e55-c91a-4d42-a858-a7e842e217ea"). InnerVolumeSpecName "kube-api-access-krcqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:24:00.985025 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.984984    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cf6e55-c91a-4d42-a858-a7e842e217ea-openshift-service-ca\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:24:00.985025 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.985018    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42cf6e55-c91a-4d42-a858-a7e842e217ea-maas-api-tls\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:24:00.985025 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:00.985028    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krcqg\" (UniqueName: \"kubernetes.io/projected/42cf6e55-c91a-4d42-a858-a7e842e217ea-kube-api-access-krcqg\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:24:01.527025 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:01.526988    2565 generic.go:356] "Generic (PLEG): container finished" podID="42cf6e55-c91a-4d42-a858-a7e842e217ea" containerID="c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574" exitCode=0
Jul 23 22:24:01.527210 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:01.527046    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"
Jul 23 22:24:01.527210 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:01.527071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j" event={"ID":"42cf6e55-c91a-4d42-a858-a7e842e217ea","Type":"ContainerDied","Data":"c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574"}
Jul 23 22:24:01.527210 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:01.527123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j" event={"ID":"42cf6e55-c91a-4d42-a858-a7e842e217ea","Type":"ContainerDied","Data":"97df5218f23ae0e4e25baa8eaa29f0e4a95a977336dc18e198848d123d99dd04"}
Jul 23 22:24:01.527210 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:01.527146    2565 scope.go:117] "RemoveContainer" containerID="c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574"
Jul 23 22:24:01.535567 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:01.535549    2565 scope.go:117] "RemoveContainer" containerID="c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574"
Jul 23 22:24:01.535812 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:24:01.535791    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574\": container with ID starting with c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574 not found: ID does not exist" containerID="c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574"
Jul 23 22:24:01.535872 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:01.535821    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574"} err="failed to get container status \"c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574\": rpc error: code = NotFound desc = could not find container \"c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574\": container with ID starting with c882409f9f28a22abfebeca6abbc90da87b5affd16e5f6ebb9ee8c3fd4687574 not found: ID does not exist"
Jul 23 22:24:01.550080 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:01.550051    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"]
Jul 23 22:24:01.557140 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:01.557111    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0578d301-869c84c8d7-vcx7j"]
Jul 23 22:24:02.481901 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:24:02.481869    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42cf6e55-c91a-4d42-a858-a7e842e217ea" path="/var/lib/kubelet/pods/42cf6e55-c91a-4d42-a858-a7e842e217ea/volumes"
Jul 23 22:26:04.827514 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:04.827427    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"]
Jul 23 22:26:04.828097 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:04.827785    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42cf6e55-c91a-4d42-a858-a7e842e217ea" containerName="maas-api"
Jul 23 22:26:04.828097 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:04.827796    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="42cf6e55-c91a-4d42-a858-a7e842e217ea" containerName="maas-api"
Jul 23 22:26:04.828097 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:04.827852    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="42cf6e55-c91a-4d42-a858-a7e842e217ea" containerName="maas-api"
Jul 23 22:26:04.830642 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:04.830626    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:04.833128 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:04.833107    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-071748-serving-cert\""
Jul 23 22:26:04.842480 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:04.842453    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"]
Jul 23 22:26:04.924559 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:04.924517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf9da778-9093-4081-84db-3ad995ef3413-maas-api-tls\") pod \"maas-api-e2e-inf-a-071748-5d7df96974-hzgjz\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:04.924559 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:04.924558    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9da778-9093-4081-84db-3ad995ef3413-openshift-service-ca\") pod \"maas-api-e2e-inf-a-071748-5d7df96974-hzgjz\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:04.924776 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:04.924638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqvsn\" (UniqueName: \"kubernetes.io/projected/bf9da778-9093-4081-84db-3ad995ef3413-kube-api-access-tqvsn\") pod \"maas-api-e2e-inf-a-071748-5d7df96974-hzgjz\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:05.025291 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:05.025250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9da778-9093-4081-84db-3ad995ef3413-openshift-service-ca\") pod \"maas-api-e2e-inf-a-071748-5d7df96974-hzgjz\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:05.025473 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:05.025330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqvsn\" (UniqueName: \"kubernetes.io/projected/bf9da778-9093-4081-84db-3ad995ef3413-kube-api-access-tqvsn\") pod \"maas-api-e2e-inf-a-071748-5d7df96974-hzgjz\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:05.025473 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:05.025420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf9da778-9093-4081-84db-3ad995ef3413-maas-api-tls\") pod \"maas-api-e2e-inf-a-071748-5d7df96974-hzgjz\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:05.025560 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:26:05.025539    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-serving-cert: secret "maas-api-e2e-inf-a-071748-serving-cert" not found
Jul 23 22:26:05.025617 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:26:05.025606    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9da778-9093-4081-84db-3ad995ef3413-maas-api-tls podName:bf9da778-9093-4081-84db-3ad995ef3413 nodeName:}" failed. No retries permitted until 2026-07-23 22:26:05.525586794 +0000 UTC m=+2069.560294323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bf9da778-9093-4081-84db-3ad995ef3413-maas-api-tls") pod "maas-api-e2e-inf-a-071748-5d7df96974-hzgjz" (UID: "bf9da778-9093-4081-84db-3ad995ef3413") : secret "maas-api-e2e-inf-a-071748-serving-cert" not found
Jul 23 22:26:05.025923 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:05.025901    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9da778-9093-4081-84db-3ad995ef3413-openshift-service-ca\") pod \"maas-api-e2e-inf-a-071748-5d7df96974-hzgjz\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:05.036979 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:05.036946    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqvsn\" (UniqueName: \"kubernetes.io/projected/bf9da778-9093-4081-84db-3ad995ef3413-kube-api-access-tqvsn\") pod \"maas-api-e2e-inf-a-071748-5d7df96974-hzgjz\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:05.529924 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:05.529888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf9da778-9093-4081-84db-3ad995ef3413-maas-api-tls\") pod \"maas-api-e2e-inf-a-071748-5d7df96974-hzgjz\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:05.532420 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:05.532397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf9da778-9093-4081-84db-3ad995ef3413-maas-api-tls\") pod \"maas-api-e2e-inf-a-071748-5d7df96974-hzgjz\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:05.740981 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:05.740946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:05.874613 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:05.874557    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"]
Jul 23 22:26:05.876794 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:26:05.876765    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9da778_9093_4081_84db_3ad995ef3413.slice/crio-5865bab6dd9529f77203c6374bc72794418555d7c21226a9f1756a39c8c7c055 WatchSource:0}: Error finding container 5865bab6dd9529f77203c6374bc72794418555d7c21226a9f1756a39c8c7c055: Status 404 returned error can't find the container with id 5865bab6dd9529f77203c6374bc72794418555d7c21226a9f1756a39c8c7c055
Jul 23 22:26:06.043388 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:06.043296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz" event={"ID":"bf9da778-9093-4081-84db-3ad995ef3413","Type":"ContainerStarted","Data":"5865bab6dd9529f77203c6374bc72794418555d7c21226a9f1756a39c8c7c055"}
Jul 23 22:26:07.048378 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:07.048343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz" event={"ID":"bf9da778-9093-4081-84db-3ad995ef3413","Type":"ContainerStarted","Data":"38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992"}
Jul 23 22:26:07.048774 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:07.048485    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:07.069443 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:07.069406    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz" podStartSLOduration=2.57188141 podStartE2EDuration="3.069392973s" totalImagesPullingTime="497.511563ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:26:07.068182413 +0000 UTC m=+2071.102889978" watchObservedRunningTime="2026-07-23 22:26:07.069392973 +0000 UTC m=+2071.104100513"
Jul 23 22:26:13.057989 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:13.057963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:26:25.487900 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.487863    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"]
Jul 23 22:26:25.491060 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.491044    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.495245 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.495198    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-071748\"/\"openshift-service-ca.crt\""
Jul 23 22:26:25.495409 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.495198    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-071748\"/\"default-dockercfg-zzj5m\""
Jul 23 22:26:25.495409 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.495202    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-071748\"/\"test-model-071748-kserve-self-signed-certs\""
Jul 23 22:26:25.495574 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.495207    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-071748\"/\"kube-root-ca.crt\""
Jul 23 22:26:25.499359 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.499338    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"]
Jul 23 22:26:25.600326 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.600287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-dshm\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.600520 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.600357    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-home\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.600520 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.600379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-model-cache\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.600520 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.600409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c34ea10-d700-4ad8-871f-daff6843b475-tls-certs\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.600520 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.600500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-tmp-dir\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.600732 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.600546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5tfm\" (UniqueName: \"kubernetes.io/projected/2c34ea10-d700-4ad8-871f-daff6843b475-kube-api-access-c5tfm\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.701972 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.701932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-dshm\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.702157 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.702002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-home\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.702157 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.702023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-model-cache\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.702157 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.702055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c34ea10-d700-4ad8-871f-daff6843b475-tls-certs\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.702157 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.702093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-tmp-dir\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.702157 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.702127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5tfm\" (UniqueName: \"kubernetes.io/projected/2c34ea10-d700-4ad8-871f-daff6843b475-kube-api-access-c5tfm\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.702490 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.702463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-home\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.702605 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.702472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-model-cache\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.702679 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.702653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-tmp-dir\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.704359 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.704341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-dshm\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.704863 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.704838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c34ea10-d700-4ad8-871f-daff6843b475-tls-certs\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.711040 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.711018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5tfm\" (UniqueName: \"kubernetes.io/projected/2c34ea10-d700-4ad8-871f-daff6843b475-kube-api-access-c5tfm\") pod \"test-model-071748-kserve-6fc5b74c95-fvkhk\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") " pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.800510 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.800472    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:25.937697 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:25.937667    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"]
Jul 23 22:26:25.940765 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:26:25.940742    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c34ea10_d700_4ad8_871f_daff6843b475.slice/crio-75cdca06abd24cc81b174d97bdbcf3c98904450eacd4daf4abd433ea5bbae3e6 WatchSource:0}: Error finding container 75cdca06abd24cc81b174d97bdbcf3c98904450eacd4daf4abd433ea5bbae3e6: Status 404 returned error can't find the container with id 75cdca06abd24cc81b174d97bdbcf3c98904450eacd4daf4abd433ea5bbae3e6
Jul 23 22:26:26.126926 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:26.126829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk" event={"ID":"2c34ea10-d700-4ad8-871f-daff6843b475","Type":"ContainerStarted","Data":"3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5"}
Jul 23 22:26:26.126926 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:26.126870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk" event={"ID":"2c34ea10-d700-4ad8-871f-daff6843b475","Type":"ContainerStarted","Data":"75cdca06abd24cc81b174d97bdbcf3c98904450eacd4daf4abd433ea5bbae3e6"}
Jul 23 22:26:26.145800 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:26.145750    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk" podStartSLOduration=1.145734979 podStartE2EDuration="1.145734979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:26:26.144475257 +0000 UTC m=+2090.179182809" watchObservedRunningTime="2026-07-23 22:26:26.145734979 +0000 UTC m=+2090.180442564"
Jul 23 22:26:35.801527 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:35.801499    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:35.802102 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:35.801546    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:35.813837 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:35.813814    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:36.178550 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:36.178468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:26:36.498183 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:36.498097    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:26:36.501482 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:26:36.501460    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:27:26.838450 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:26.838414    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"]
Jul 23 22:27:38.616334 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:38.616303    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"]
Jul 23 22:27:38.616785 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:38.616499    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz" podUID="bf9da778-9093-4081-84db-3ad995ef3413" containerName="maas-api" containerID="cri-o://38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992" gracePeriod=30
Jul 23 22:27:38.862788 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:38.862764    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:27:39.039842 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.039804    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9da778-9093-4081-84db-3ad995ef3413-openshift-service-ca\") pod \"bf9da778-9093-4081-84db-3ad995ef3413\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") "
Jul 23 22:27:39.040015 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.039875    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf9da778-9093-4081-84db-3ad995ef3413-maas-api-tls\") pod \"bf9da778-9093-4081-84db-3ad995ef3413\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") "
Jul 23 22:27:39.040015 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.039917    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqvsn\" (UniqueName: \"kubernetes.io/projected/bf9da778-9093-4081-84db-3ad995ef3413-kube-api-access-tqvsn\") pod \"bf9da778-9093-4081-84db-3ad995ef3413\" (UID: \"bf9da778-9093-4081-84db-3ad995ef3413\") "
Jul 23 22:27:39.040255 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.040206    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf9da778-9093-4081-84db-3ad995ef3413-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bf9da778-9093-4081-84db-3ad995ef3413" (UID: "bf9da778-9093-4081-84db-3ad995ef3413"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 22:27:39.041977 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.041944    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf9da778-9093-4081-84db-3ad995ef3413-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bf9da778-9093-4081-84db-3ad995ef3413" (UID: "bf9da778-9093-4081-84db-3ad995ef3413"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:27:39.042070 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.042030    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf9da778-9093-4081-84db-3ad995ef3413-kube-api-access-tqvsn" (OuterVolumeSpecName: "kube-api-access-tqvsn") pod "bf9da778-9093-4081-84db-3ad995ef3413" (UID: "bf9da778-9093-4081-84db-3ad995ef3413"). InnerVolumeSpecName "kube-api-access-tqvsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:27:39.141073 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.141036    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqvsn\" (UniqueName: \"kubernetes.io/projected/bf9da778-9093-4081-84db-3ad995ef3413-kube-api-access-tqvsn\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:27:39.141073 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.141066    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9da778-9093-4081-84db-3ad995ef3413-openshift-service-ca\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:27:39.141073 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.141075    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf9da778-9093-4081-84db-3ad995ef3413-maas-api-tls\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:27:39.432713 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.432619    2565 generic.go:356] "Generic (PLEG): container finished" podID="bf9da778-9093-4081-84db-3ad995ef3413" containerID="38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992" exitCode=0
Jul 23 22:27:39.432713 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.432667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz" event={"ID":"bf9da778-9093-4081-84db-3ad995ef3413","Type":"ContainerDied","Data":"38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992"}
Jul 23 22:27:39.432713 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.432670    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"
Jul 23 22:27:39.432979 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.432738    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz" event={"ID":"bf9da778-9093-4081-84db-3ad995ef3413","Type":"ContainerDied","Data":"5865bab6dd9529f77203c6374bc72794418555d7c21226a9f1756a39c8c7c055"}
Jul 23 22:27:39.432979 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.432762    2565 scope.go:117] "RemoveContainer" containerID="38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992"
Jul 23 22:27:39.442075 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.442057    2565 scope.go:117] "RemoveContainer" containerID="38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992"
Jul 23 22:27:39.442329 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:27:39.442310    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992\": container with ID starting with 38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992 not found: ID does not exist" containerID="38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992"
Jul 23 22:27:39.442377 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.442338    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992"} err="failed to get container status \"38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992\": rpc error: code = NotFound desc = could not find container \"38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992\": container with ID starting with 38f000e1a094c53a0c0b42bce44003e824f80fbc350264820c63c9c5dce3a992 not found: ID does not exist"
Jul 23 22:27:39.462039 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.462015    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"]
Jul 23 22:27:39.466886 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:39.466865    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-071748-5d7df96974-hzgjz"]
Jul 23 22:27:40.481299 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:40.481266    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf9da778-9093-4081-84db-3ad995ef3413" path="/var/lib/kubelet/pods/bf9da778-9093-4081-84db-3ad995ef3413/volumes"
Jul 23 22:27:41.857946 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:41.857914    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk" podUID="2c34ea10-d700-4ad8-871f-daff6843b475" containerName="main" containerID="cri-o://3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5" gracePeriod=45
Jul 23 22:27:42.106282 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.106260    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:27:42.164669 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.164591    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-model-cache\") pod \"2c34ea10-d700-4ad8-871f-daff6843b475\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") "
Jul 23 22:27:42.164669 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.164627    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-tmp-dir\") pod \"2c34ea10-d700-4ad8-871f-daff6843b475\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") "
Jul 23 22:27:42.164669 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.164652    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5tfm\" (UniqueName: \"kubernetes.io/projected/2c34ea10-d700-4ad8-871f-daff6843b475-kube-api-access-c5tfm\") pod \"2c34ea10-d700-4ad8-871f-daff6843b475\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") "
Jul 23 22:27:42.164923 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.164705    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c34ea10-d700-4ad8-871f-daff6843b475-tls-certs\") pod \"2c34ea10-d700-4ad8-871f-daff6843b475\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") "
Jul 23 22:27:42.164923 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.164749    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-dshm\") pod \"2c34ea10-d700-4ad8-871f-daff6843b475\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") "
Jul 23 22:27:42.164923 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.164784    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-home\") pod \"2c34ea10-d700-4ad8-871f-daff6843b475\" (UID: \"2c34ea10-d700-4ad8-871f-daff6843b475\") "
Jul 23 22:27:42.164923 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.164864    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c34ea10-d700-4ad8-871f-daff6843b475" (UID: "2c34ea10-d700-4ad8-871f-daff6843b475"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:27:42.164923 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.164874    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c34ea10-d700-4ad8-871f-daff6843b475" (UID: "2c34ea10-d700-4ad8-871f-daff6843b475"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:27:42.165118 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.165037    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-model-cache\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:27:42.165118 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.165054    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-tmp-dir\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:27:42.165118 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.165050    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-home" (OuterVolumeSpecName: "home") pod "2c34ea10-d700-4ad8-871f-daff6843b475" (UID: "2c34ea10-d700-4ad8-871f-daff6843b475"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:27:42.167002 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.166978    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c34ea10-d700-4ad8-871f-daff6843b475-kube-api-access-c5tfm" (OuterVolumeSpecName: "kube-api-access-c5tfm") pod "2c34ea10-d700-4ad8-871f-daff6843b475" (UID: "2c34ea10-d700-4ad8-871f-daff6843b475"). InnerVolumeSpecName "kube-api-access-c5tfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:27:42.167090 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.166985    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c34ea10-d700-4ad8-871f-daff6843b475-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c34ea10-d700-4ad8-871f-daff6843b475" (UID: "2c34ea10-d700-4ad8-871f-daff6843b475"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:27:42.167090 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.166995    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-dshm" (OuterVolumeSpecName: "dshm") pod "2c34ea10-d700-4ad8-871f-daff6843b475" (UID: "2c34ea10-d700-4ad8-871f-daff6843b475"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:27:42.265607 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.265571    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-dshm\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:27:42.265607 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.265605    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c34ea10-d700-4ad8-871f-daff6843b475-home\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:27:42.265805 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.265616    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5tfm\" (UniqueName: \"kubernetes.io/projected/2c34ea10-d700-4ad8-871f-daff6843b475-kube-api-access-c5tfm\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:27:42.265805 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.265631    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c34ea10-d700-4ad8-871f-daff6843b475-tls-certs\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:27:42.446846 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.446761    2565 generic.go:356] "Generic (PLEG): container finished" podID="2c34ea10-d700-4ad8-871f-daff6843b475" containerID="3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5" exitCode=0
Jul 23 22:27:42.446846 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.446806    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"
Jul 23 22:27:42.447101 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.446848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk" event={"ID":"2c34ea10-d700-4ad8-871f-daff6843b475","Type":"ContainerDied","Data":"3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5"}
Jul 23 22:27:42.447101 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.446895    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk" event={"ID":"2c34ea10-d700-4ad8-871f-daff6843b475","Type":"ContainerDied","Data":"75cdca06abd24cc81b174d97bdbcf3c98904450eacd4daf4abd433ea5bbae3e6"}
Jul 23 22:27:42.447101 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.446917    2565 scope.go:117] "RemoveContainer" containerID="3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5"
Jul 23 22:27:42.455084 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.455067    2565 scope.go:117] "RemoveContainer" containerID="3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5"
Jul 23 22:27:42.455358 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:27:42.455339    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5\": container with ID starting with 3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5 not found: ID does not exist" containerID="3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5"
Jul 23 22:27:42.455415 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.455368    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5"} err="failed to get container status \"3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5\": rpc error: code = NotFound desc = could not find container \"3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5\": container with ID starting with 3585cb0c0b87b6140710b7ad9383b81c520fc88548d48b899f37d1ac8c60b3d5 not found: ID does not exist"
Jul 23 22:27:42.482940 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.482912    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"]
Jul 23 22:27:42.490398 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:42.490372    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-071748/test-model-071748-kserve-6fc5b74c95-fvkhk"]
Jul 23 22:27:44.481785 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:27:44.481753    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c34ea10-d700-4ad8-871f-daff6843b475" path="/var/lib/kubelet/pods/2c34ea10-d700-4ad8-871f-daff6843b475/volumes"
Jul 23 22:28:16.470181 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.470149    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"]
Jul 23 22:28:16.470662 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.470504    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf9da778-9093-4081-84db-3ad995ef3413" containerName="maas-api"
Jul 23 22:28:16.470662 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.470517    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf9da778-9093-4081-84db-3ad995ef3413" containerName="maas-api"
Jul 23 22:28:16.470662 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.470537    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c34ea10-d700-4ad8-871f-daff6843b475" containerName="main"
Jul 23 22:28:16.470662 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.470543    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c34ea10-d700-4ad8-871f-daff6843b475" containerName="main"
Jul 23 22:28:16.470662 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.470592    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c34ea10-d700-4ad8-871f-daff6843b475" containerName="main"
Jul 23 22:28:16.470662 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.470603    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf9da778-9093-4081-84db-3ad995ef3413" containerName="maas-api"
Jul 23 22:28:16.473565 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.473549    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:16.476676 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.476652    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-83cd2f-serving-cert\""
Jul 23 22:28:16.485932 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.485910    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"]
Jul 23 22:28:16.575129 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.575096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb375c36-2824-4c2a-9877-10a540abf5f7-openshift-service-ca\") pod \"maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:16.575325 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.575160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pz44\" (UniqueName: \"kubernetes.io/projected/eb375c36-2824-4c2a-9877-10a540abf5f7-kube-api-access-5pz44\") pod \"maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:16.575325 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.575204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb375c36-2824-4c2a-9877-10a540abf5f7-maas-api-tls\") pod \"maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:16.675929 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.675891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb375c36-2824-4c2a-9877-10a540abf5f7-maas-api-tls\") pod \"maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:16.676102 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.675957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb375c36-2824-4c2a-9877-10a540abf5f7-openshift-service-ca\") pod \"maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:16.676102 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.675994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pz44\" (UniqueName: \"kubernetes.io/projected/eb375c36-2824-4c2a-9877-10a540abf5f7-kube-api-access-5pz44\") pod \"maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:16.676696 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.676671    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb375c36-2824-4c2a-9877-10a540abf5f7-openshift-service-ca\") pod \"maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:16.678424 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.678403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb375c36-2824-4c2a-9877-10a540abf5f7-maas-api-tls\") pod \"maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:16.685069 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.685040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pz44\" (UniqueName: \"kubernetes.io/projected/eb375c36-2824-4c2a-9877-10a540abf5f7-kube-api-access-5pz44\") pod \"maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:16.785756 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.785724    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:16.919165 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.919131    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"]
Jul 23 22:28:16.922870 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:28:16.922839    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb375c36_2824_4c2a_9877_10a540abf5f7.slice/crio-2fefef579a55aea9e4f302c82c18a66530481a0847b77571a03e3ca6f0b48a2c WatchSource:0}: Error finding container 2fefef579a55aea9e4f302c82c18a66530481a0847b77571a03e3ca6f0b48a2c: Status 404 returned error can't find the container with id 2fefef579a55aea9e4f302c82c18a66530481a0847b77571a03e3ca6f0b48a2c
Jul 23 22:28:16.924325 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:16.924306    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 22:28:17.600324 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:17.600286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk" event={"ID":"eb375c36-2824-4c2a-9877-10a540abf5f7","Type":"ContainerStarted","Data":"869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968"}
Jul 23 22:28:17.600730 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:17.600343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk" event={"ID":"eb375c36-2824-4c2a-9877-10a540abf5f7","Type":"ContainerStarted","Data":"2fefef579a55aea9e4f302c82c18a66530481a0847b77571a03e3ca6f0b48a2c"}
Jul 23 22:28:17.600730 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:17.600432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:17.617996 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:17.617904    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk" podStartSLOduration=1.178980536 podStartE2EDuration="1.617889436s" totalImagesPullingTime="438.9089ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:28:17.616528642 +0000 UTC m=+2201.651236191" watchObservedRunningTime="2026-07-23 22:28:17.617889436 +0000 UTC m=+2201.652596974"
Jul 23 22:28:23.609625 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:23.609597    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:52.913415 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:52.913377    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"]
Jul 23 22:28:52.913969 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:52.913606    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk" podUID="eb375c36-2824-4c2a-9877-10a540abf5f7" containerName="maas-api" containerID="cri-o://869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968" gracePeriod=30
Jul 23 22:28:53.157154 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.157126    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:53.275288 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.275262    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pz44\" (UniqueName: \"kubernetes.io/projected/eb375c36-2824-4c2a-9877-10a540abf5f7-kube-api-access-5pz44\") pod \"eb375c36-2824-4c2a-9877-10a540abf5f7\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") "
Jul 23 22:28:53.275464 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.275382    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb375c36-2824-4c2a-9877-10a540abf5f7-openshift-service-ca\") pod \"eb375c36-2824-4c2a-9877-10a540abf5f7\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") "
Jul 23 22:28:53.275464 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.275439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb375c36-2824-4c2a-9877-10a540abf5f7-maas-api-tls\") pod \"eb375c36-2824-4c2a-9877-10a540abf5f7\" (UID: \"eb375c36-2824-4c2a-9877-10a540abf5f7\") "
Jul 23 22:28:53.275699 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.275675    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb375c36-2824-4c2a-9877-10a540abf5f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eb375c36-2824-4c2a-9877-10a540abf5f7" (UID: "eb375c36-2824-4c2a-9877-10a540abf5f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 22:28:53.277441 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.277417    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb375c36-2824-4c2a-9877-10a540abf5f7-kube-api-access-5pz44" (OuterVolumeSpecName: "kube-api-access-5pz44") pod "eb375c36-2824-4c2a-9877-10a540abf5f7" (UID: "eb375c36-2824-4c2a-9877-10a540abf5f7"). InnerVolumeSpecName "kube-api-access-5pz44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:28:53.277544 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.277511    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb375c36-2824-4c2a-9877-10a540abf5f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eb375c36-2824-4c2a-9877-10a540abf5f7" (UID: "eb375c36-2824-4c2a-9877-10a540abf5f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:28:53.376048 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.376009    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb375c36-2824-4c2a-9877-10a540abf5f7-openshift-service-ca\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:28:53.376239 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.376042    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb375c36-2824-4c2a-9877-10a540abf5f7-maas-api-tls\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:28:53.376239 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.376071    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pz44\" (UniqueName: \"kubernetes.io/projected/eb375c36-2824-4c2a-9877-10a540abf5f7-kube-api-access-5pz44\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:28:53.754974 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.754883    2565 generic.go:356] "Generic (PLEG): container finished" podID="eb375c36-2824-4c2a-9877-10a540abf5f7" containerID="869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968" exitCode=0
Jul 23 22:28:53.754974 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.754932    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"
Jul 23 22:28:53.755167 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.754969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk" event={"ID":"eb375c36-2824-4c2a-9877-10a540abf5f7","Type":"ContainerDied","Data":"869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968"}
Jul 23 22:28:53.755167 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.755029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk" event={"ID":"eb375c36-2824-4c2a-9877-10a540abf5f7","Type":"ContainerDied","Data":"2fefef579a55aea9e4f302c82c18a66530481a0847b77571a03e3ca6f0b48a2c"}
Jul 23 22:28:53.755167 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.755051    2565 scope.go:117] "RemoveContainer" containerID="869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968"
Jul 23 22:28:53.763914 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.763896    2565 scope.go:117] "RemoveContainer" containerID="869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968"
Jul 23 22:28:53.764183 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:28:53.764166    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968\": container with ID starting with 869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968 not found: ID does not exist" containerID="869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968"
Jul 23 22:28:53.764251 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.764191    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968"} err="failed to get container status \"869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968\": rpc error: code = NotFound desc = could not find container \"869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968\": container with ID starting with 869350ea0a0f300e88f5b71e2db0742ffa5f9e871033cfb54d76e9c6ff5ef968 not found: ID does not exist"
Jul 23 22:28:53.775899 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.775879    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"]
Jul 23 22:28:53.777889 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:53.777867    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83cd2f-844c959db8-cf5qk"]
Jul 23 22:28:54.481660 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:28:54.481628    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb375c36-2824-4c2a-9877-10a540abf5f7" path="/var/lib/kubelet/pods/eb375c36-2824-4c2a-9877-10a540abf5f7/volumes"
Jul 23 22:29:34.849702 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:34.849668    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"]
Jul 23 22:29:34.850303 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:34.850161    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb375c36-2824-4c2a-9877-10a540abf5f7" containerName="maas-api"
Jul 23 22:29:34.850303 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:34.850180    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb375c36-2824-4c2a-9877-10a540abf5f7" containerName="maas-api"
Jul 23 22:29:34.850303 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:34.850296    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb375c36-2824-4c2a-9877-10a540abf5f7" containerName="maas-api"
Jul 23 22:29:34.853380 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:34.853357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:34.856399 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:34.856382    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-1c273d-serving-cert\""
Jul 23 22:29:34.868142 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:34.868118    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"]
Jul 23 22:29:34.913514 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:34.913478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:34.913692 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:34.913557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-maas-api-tls\") pod \"maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:34.913692 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:34.913600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zvqm\" (UniqueName: \"kubernetes.io/projected/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-kube-api-access-5zvqm\") pod \"maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:35.014651 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.014614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-maas-api-tls\") pod \"maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:35.014651 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.014657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zvqm\" (UniqueName: \"kubernetes.io/projected/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-kube-api-access-5zvqm\") pod \"maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:35.014912 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.014704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:35.015380 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.015359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:35.017166 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.017143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-maas-api-tls\") pod \"maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:35.023188 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.023141    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zvqm\" (UniqueName: \"kubernetes.io/projected/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-kube-api-access-5zvqm\") pod \"maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:35.163532 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.163437    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:35.296728 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.296706    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"]
Jul 23 22:29:35.298513 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:29:35.298488    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4001b1f3_2f66_4ba6_979b_c7c84ed50b35.slice/crio-9b7938793c8ef61d63c162cb9a0cebdd811b03cb83f9da9d280f9052891aece5 WatchSource:0}: Error finding container 9b7938793c8ef61d63c162cb9a0cebdd811b03cb83f9da9d280f9052891aece5: Status 404 returned error can't find the container with id 9b7938793c8ef61d63c162cb9a0cebdd811b03cb83f9da9d280f9052891aece5
Jul 23 22:29:35.921477 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.921439    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn" event={"ID":"4001b1f3-2f66-4ba6-979b-c7c84ed50b35","Type":"ContainerStarted","Data":"0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc"}
Jul 23 22:29:35.921885 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.921514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn" event={"ID":"4001b1f3-2f66-4ba6-979b-c7c84ed50b35","Type":"ContainerStarted","Data":"9b7938793c8ef61d63c162cb9a0cebdd811b03cb83f9da9d280f9052891aece5"}
Jul 23 22:29:35.921885 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.921643    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:29:35.940485 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:35.940442    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn" podStartSLOduration=1.465547852 podStartE2EDuration="1.94042988s" totalImagesPullingTime="474.882028ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:29:35.938934471 +0000 UTC m=+2279.973642017" watchObservedRunningTime="2026-07-23 22:29:35.94042988 +0000 UTC m=+2279.975137418"
Jul 23 22:29:41.930665 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:29:41.930638    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:30:30.983503 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:30.983427    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"]
Jul 23 22:30:30.986648 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:30.986633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:30.989351 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:30.989330    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6bf8de\"/\"kube-root-ca.crt\""
Jul 23 22:30:30.990383 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:30.990364    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6bf8de\"/\"openshift-service-ca.crt\""
Jul 23 22:30:30.990488 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:30.990412    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6bf8de\"/\"default-dockercfg-dgdl5\""
Jul 23 22:30:30.990547 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:30.990531    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6bf8de\"/\"auth-test-model-6bf8de-kserve-self-signed-certs\""
Jul 23 22:30:30.996640 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:30.996618    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"]
Jul 23 22:30:31.079446 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.079411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-dshm\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.079446 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.079449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc236ea3-b752-4117-8309-4bb9acdeaa71-tls-certs\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.079688 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.079528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-model-cache\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.079688 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.079624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-home\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.079688 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.079657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v27dh\" (UniqueName: \"kubernetes.io/projected/fc236ea3-b752-4117-8309-4bb9acdeaa71-kube-api-access-v27dh\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.079820 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.079699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-tmp-dir\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.181001 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.180963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-model-cache\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.181183 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.181029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-home\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.181183 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.181059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v27dh\" (UniqueName: \"kubernetes.io/projected/fc236ea3-b752-4117-8309-4bb9acdeaa71-kube-api-access-v27dh\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.181183 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.181113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-tmp-dir\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.181183 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.181143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-dshm\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.181183 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.181165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc236ea3-b752-4117-8309-4bb9acdeaa71-tls-certs\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.181492 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.181432    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-model-cache\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.181492 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.181442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-home\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.181603 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.181571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-tmp-dir\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.183427 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.183405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-dshm\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.183627 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.183609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc236ea3-b752-4117-8309-4bb9acdeaa71-tls-certs\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.189650 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.189628    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v27dh\" (UniqueName: \"kubernetes.io/projected/fc236ea3-b752-4117-8309-4bb9acdeaa71-kube-api-access-v27dh\") pod \"auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") " pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.296103 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.296080    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:31.423405 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:31.423378    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"]
Jul 23 22:30:31.425051 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:30:31.425024    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc236ea3_b752_4117_8309_4bb9acdeaa71.slice/crio-15d5bad11a212505f6a1796a3f6cfc03804ad06c012b50fabcb57cbba6b3b3aa WatchSource:0}: Error finding container 15d5bad11a212505f6a1796a3f6cfc03804ad06c012b50fabcb57cbba6b3b3aa: Status 404 returned error can't find the container with id 15d5bad11a212505f6a1796a3f6cfc03804ad06c012b50fabcb57cbba6b3b3aa
Jul 23 22:30:32.164822 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:32.164788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p" event={"ID":"fc236ea3-b752-4117-8309-4bb9acdeaa71","Type":"ContainerStarted","Data":"be3a8615620b0f18646047289b8a27ed990c389abf6a2688b282542481b773e3"}
Jul 23 22:30:32.165234 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:32.164829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p" event={"ID":"fc236ea3-b752-4117-8309-4bb9acdeaa71","Type":"ContainerStarted","Data":"15d5bad11a212505f6a1796a3f6cfc03804ad06c012b50fabcb57cbba6b3b3aa"}
Jul 23 22:30:32.190326 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:32.190275    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p" podStartSLOduration=2.190256404 podStartE2EDuration="2.190256404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:30:32.189572926 +0000 UTC m=+2336.224280466" watchObservedRunningTime="2026-07-23 22:30:32.190256404 +0000 UTC m=+2336.224963946"
Jul 23 22:30:41.296921 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:41.296886    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:41.296921 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:41.296929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:41.309367 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:41.309340    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:30:42.217780 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:30:42.217752    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:31:36.520897 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:31:36.520869    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:31:36.526776 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:31:36.526755    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:32:31.589510 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:31.589429    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"]
Jul 23 22:32:38.777388 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.777351    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"]
Jul 23 22:32:38.780991 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.780960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.787648 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.787627    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1c273d\"/\"kube-root-ca.crt\""
Jul 23 22:32:38.788917 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.788892    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1c273d\"/\"openshift-service-ca.crt\""
Jul 23 22:32:38.789027 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.788897    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1c273d\"/\"default-dockercfg-6nccm\""
Jul 23 22:32:38.789027 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.788962    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1c273d\"/\"sub-test-model-1c273d-kserve-self-signed-certs\""
Jul 23 22:32:38.799602 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.799578    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"]
Jul 23 22:32:38.889189 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.889155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-home\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.889359 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.889196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-model-cache\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.889359 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.889247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/063ef7b9-d569-4194-a4a5-aa9031851122-tls-certs\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.889359 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.889312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q4zx\" (UniqueName: \"kubernetes.io/projected/063ef7b9-d569-4194-a4a5-aa9031851122-kube-api-access-7q4zx\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.889467 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.889385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-dshm\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.889467 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.889406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-tmp-dir\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.990465 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.990433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-dshm\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.990465 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.990468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-tmp-dir\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.990660 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.990489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-home\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.990660 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.990514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-model-cache\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.990660 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.990547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/063ef7b9-d569-4194-a4a5-aa9031851122-tls-certs\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.990660 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.990586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q4zx\" (UniqueName: \"kubernetes.io/projected/063ef7b9-d569-4194-a4a5-aa9031851122-kube-api-access-7q4zx\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.990874 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.990848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-tmp-dir\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.991026 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.990948    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-home\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.991026 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.990982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-model-cache\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.992779 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.992760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-dshm\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.993099 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.993077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/063ef7b9-d569-4194-a4a5-aa9031851122-tls-certs\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:38.998406 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:38.998385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q4zx\" (UniqueName: \"kubernetes.io/projected/063ef7b9-d569-4194-a4a5-aa9031851122-kube-api-access-7q4zx\") pod \"sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") " pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:39.089995 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:39.089903    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:39.221182 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:39.221157    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"]
Jul 23 22:32:39.223355 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:32:39.223326    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod063ef7b9_d569_4194_a4a5_aa9031851122.slice/crio-e8327fd4bf8a937f1aa0c51767df467a6e75913a34dd1d47b17e740bdbc8af6d WatchSource:0}: Error finding container e8327fd4bf8a937f1aa0c51767df467a6e75913a34dd1d47b17e740bdbc8af6d: Status 404 returned error can't find the container with id e8327fd4bf8a937f1aa0c51767df467a6e75913a34dd1d47b17e740bdbc8af6d
Jul 23 22:32:39.698808 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:39.698770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc" event={"ID":"063ef7b9-d569-4194-a4a5-aa9031851122","Type":"ContainerStarted","Data":"2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41"}
Jul 23 22:32:39.699013 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:39.698820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc" event={"ID":"063ef7b9-d569-4194-a4a5-aa9031851122","Type":"ContainerStarted","Data":"e8327fd4bf8a937f1aa0c51767df467a6e75913a34dd1d47b17e740bdbc8af6d"}
Jul 23 22:32:39.718157 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:39.718107    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc" podStartSLOduration=1.718090938 podStartE2EDuration="1.718090938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:32:39.716974907 +0000 UTC m=+2463.751682459" watchObservedRunningTime="2026-07-23 22:32:39.718090938 +0000 UTC m=+2463.752798477"
Jul 23 22:32:46.609333 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.609288    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p" podUID="fc236ea3-b752-4117-8309-4bb9acdeaa71" containerName="main" containerID="cri-o://be3a8615620b0f18646047289b8a27ed990c389abf6a2688b282542481b773e3" gracePeriod=45
Jul 23 22:32:46.731489 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.731444    2565 generic.go:356] "Generic (PLEG): container finished" podID="fc236ea3-b752-4117-8309-4bb9acdeaa71" containerID="be3a8615620b0f18646047289b8a27ed990c389abf6a2688b282542481b773e3" exitCode=0
Jul 23 22:32:46.731489 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.731473    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p" event={"ID":"fc236ea3-b752-4117-8309-4bb9acdeaa71","Type":"ContainerDied","Data":"be3a8615620b0f18646047289b8a27ed990c389abf6a2688b282542481b773e3"}
Jul 23 22:32:46.860236 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.860160    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:32:46.956285 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.956242    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-home\") pod \"fc236ea3-b752-4117-8309-4bb9acdeaa71\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") "
Jul 23 22:32:46.956285 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.956286    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-tmp-dir\") pod \"fc236ea3-b752-4117-8309-4bb9acdeaa71\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") "
Jul 23 22:32:46.956544 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.956350    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v27dh\" (UniqueName: \"kubernetes.io/projected/fc236ea3-b752-4117-8309-4bb9acdeaa71-kube-api-access-v27dh\") pod \"fc236ea3-b752-4117-8309-4bb9acdeaa71\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") "
Jul 23 22:32:46.956544 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.956393    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc236ea3-b752-4117-8309-4bb9acdeaa71-tls-certs\") pod \"fc236ea3-b752-4117-8309-4bb9acdeaa71\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") "
Jul 23 22:32:46.956544 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.956436    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-model-cache\") pod \"fc236ea3-b752-4117-8309-4bb9acdeaa71\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") "
Jul 23 22:32:46.956544 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.956463    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-dshm\") pod \"fc236ea3-b752-4117-8309-4bb9acdeaa71\" (UID: \"fc236ea3-b752-4117-8309-4bb9acdeaa71\") "
Jul 23 22:32:46.956706 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.956555    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-home" (OuterVolumeSpecName: "home") pod "fc236ea3-b752-4117-8309-4bb9acdeaa71" (UID: "fc236ea3-b752-4117-8309-4bb9acdeaa71"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:32:46.956706 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.956577    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fc236ea3-b752-4117-8309-4bb9acdeaa71" (UID: "fc236ea3-b752-4117-8309-4bb9acdeaa71"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:32:46.956785 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.956723    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-home\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:32:46.956785 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.956738    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-tmp-dir\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:32:46.956785 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.956749    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc236ea3-b752-4117-8309-4bb9acdeaa71" (UID: "fc236ea3-b752-4117-8309-4bb9acdeaa71"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:32:46.958716 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.958683    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc236ea3-b752-4117-8309-4bb9acdeaa71-kube-api-access-v27dh" (OuterVolumeSpecName: "kube-api-access-v27dh") pod "fc236ea3-b752-4117-8309-4bb9acdeaa71" (UID: "fc236ea3-b752-4117-8309-4bb9acdeaa71"). InnerVolumeSpecName "kube-api-access-v27dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:32:46.958716 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.958685    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc236ea3-b752-4117-8309-4bb9acdeaa71-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fc236ea3-b752-4117-8309-4bb9acdeaa71" (UID: "fc236ea3-b752-4117-8309-4bb9acdeaa71"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:32:46.958856 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:46.958762    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-dshm" (OuterVolumeSpecName: "dshm") pod "fc236ea3-b752-4117-8309-4bb9acdeaa71" (UID: "fc236ea3-b752-4117-8309-4bb9acdeaa71"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:32:47.057122 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:47.057092    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc236ea3-b752-4117-8309-4bb9acdeaa71-tls-certs\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:32:47.057122 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:47.057121    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-model-cache\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:32:47.057122 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:47.057132    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc236ea3-b752-4117-8309-4bb9acdeaa71-dshm\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:32:47.057368 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:47.057144    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v27dh\" (UniqueName: \"kubernetes.io/projected/fc236ea3-b752-4117-8309-4bb9acdeaa71-kube-api-access-v27dh\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:32:47.736979 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:47.736949    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"
Jul 23 22:32:47.737491 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:47.736957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p" event={"ID":"fc236ea3-b752-4117-8309-4bb9acdeaa71","Type":"ContainerDied","Data":"15d5bad11a212505f6a1796a3f6cfc03804ad06c012b50fabcb57cbba6b3b3aa"}
Jul 23 22:32:47.737491 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:47.737061    2565 scope.go:117] "RemoveContainer" containerID="be3a8615620b0f18646047289b8a27ed990c389abf6a2688b282542481b773e3"
Jul 23 22:32:47.757948 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:47.757924    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"]
Jul 23 22:32:47.763237 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:47.763202    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6bf8de/auth-test-model-6bf8de-kserve-86bfbb6795-h2l2p"]
Jul 23 22:32:48.481796 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:48.481759    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc236ea3-b752-4117-8309-4bb9acdeaa71" path="/var/lib/kubelet/pods/fc236ea3-b752-4117-8309-4bb9acdeaa71/volumes"
Jul 23 22:32:49.090395 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:49.090350    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:49.090875 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:49.090421    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:49.103280 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:49.103250    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:32:49.757316 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:32:49.757288    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:34:07.362650 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:07.362618    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"]
Jul 23 22:34:11.388051 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.388011    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"]
Jul 23 22:34:11.388547 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.388525    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc236ea3-b752-4117-8309-4bb9acdeaa71" containerName="main"
Jul 23 22:34:11.388591 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.388552    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc236ea3-b752-4117-8309-4bb9acdeaa71" containerName="main"
Jul 23 22:34:11.388675 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.388659    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc236ea3-b752-4117-8309-4bb9acdeaa71" containerName="main"
Jul 23 22:34:11.391829 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.391810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.394538 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.394511    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1c273d\"/\"rate-test-model-1c273d-kserve-self-signed-certs\""
Jul 23 22:34:11.402142 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.402121    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"]
Jul 23 22:34:11.473730 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.473698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-dshm\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.473882 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.473745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tmp-dir\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.473882 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.473767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-model-cache\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.473882 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.473785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-home\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.473882 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.473801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2t8j\" (UniqueName: \"kubernetes.io/projected/f33f70dc-2ee0-4958-9704-405a95bd0a0c-kube-api-access-v2t8j\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.473882 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.473826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tls-certs\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.575334 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.575295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-dshm\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.575502 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.575347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tmp-dir\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.575502 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.575364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-model-cache\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.575502 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.575383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-home\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.575502 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.575402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2t8j\" (UniqueName: \"kubernetes.io/projected/f33f70dc-2ee0-4958-9704-405a95bd0a0c-kube-api-access-v2t8j\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.575502 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.575441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tls-certs\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.575772 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.575753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tmp-dir\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.575849 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.575823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-model-cache\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.575849 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.575849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-home\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.577702 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.577684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-dshm\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.578105 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.578085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tls-certs\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.584252 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.584206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2t8j\" (UniqueName: \"kubernetes.io/projected/f33f70dc-2ee0-4958-9704-405a95bd0a0c-kube-api-access-v2t8j\") pod \"rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") " pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.701476 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.701387    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:11.832053 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:11.832029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"]
Jul 23 22:34:11.834629 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:34:11.834600    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf33f70dc_2ee0_4958_9704_405a95bd0a0c.slice/crio-26d0d58fd0c972894b0e8472180423c17b954162def0b6f44f29ae0d37ebd3db WatchSource:0}: Error finding container 26d0d58fd0c972894b0e8472180423c17b954162def0b6f44f29ae0d37ebd3db: Status 404 returned error can't find the container with id 26d0d58fd0c972894b0e8472180423c17b954162def0b6f44f29ae0d37ebd3db
Jul 23 22:34:12.097693 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:12.097659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68" event={"ID":"f33f70dc-2ee0-4958-9704-405a95bd0a0c","Type":"ContainerStarted","Data":"e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74"}
Jul 23 22:34:12.097693 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:12.097705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68" event={"ID":"f33f70dc-2ee0-4958-9704-405a95bd0a0c","Type":"ContainerStarted","Data":"26d0d58fd0c972894b0e8472180423c17b954162def0b6f44f29ae0d37ebd3db"}
Jul 23 22:34:12.116007 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:12.115958    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68" podStartSLOduration=1.115944724 podStartE2EDuration="1.115944724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:34:12.115317617 +0000 UTC m=+2556.150025156" watchObservedRunningTime="2026-07-23 22:34:12.115944724 +0000 UTC m=+2556.150652264"
Jul 23 22:34:21.701684 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:21.701640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:21.701684 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:21.701691    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:21.714155 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:21.714126    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:22.156293 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.156259    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:34:22.382709 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.382659    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc" podUID="063ef7b9-d569-4194-a4a5-aa9031851122" containerName="main" containerID="cri-o://2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41" gracePeriod=45
Jul 23 22:34:22.636096 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.636074    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:34:22.770438 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.770410    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/063ef7b9-d569-4194-a4a5-aa9031851122-tls-certs\") pod \"063ef7b9-d569-4194-a4a5-aa9031851122\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") "
Jul 23 22:34:22.770870 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.770473    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-home\") pod \"063ef7b9-d569-4194-a4a5-aa9031851122\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") "
Jul 23 22:34:22.770870 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.770500    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-model-cache\") pod \"063ef7b9-d569-4194-a4a5-aa9031851122\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") "
Jul 23 22:34:22.770870 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.770551    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-dshm\") pod \"063ef7b9-d569-4194-a4a5-aa9031851122\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") "
Jul 23 22:34:22.770870 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.770623    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q4zx\" (UniqueName: \"kubernetes.io/projected/063ef7b9-d569-4194-a4a5-aa9031851122-kube-api-access-7q4zx\") pod \"063ef7b9-d569-4194-a4a5-aa9031851122\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") "
Jul 23 22:34:22.770870 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.770647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-tmp-dir\") pod \"063ef7b9-d569-4194-a4a5-aa9031851122\" (UID: \"063ef7b9-d569-4194-a4a5-aa9031851122\") "
Jul 23 22:34:22.770870 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.770795    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-home" (OuterVolumeSpecName: "home") pod "063ef7b9-d569-4194-a4a5-aa9031851122" (UID: "063ef7b9-d569-4194-a4a5-aa9031851122"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:34:22.770870 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.770814    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-model-cache" (OuterVolumeSpecName: "model-cache") pod "063ef7b9-d569-4194-a4a5-aa9031851122" (UID: "063ef7b9-d569-4194-a4a5-aa9031851122"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:34:22.771446 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.770958    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "063ef7b9-d569-4194-a4a5-aa9031851122" (UID: "063ef7b9-d569-4194-a4a5-aa9031851122"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:34:22.771446 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.770964    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-home\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:34:22.771446 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.770984    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-model-cache\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:34:22.772767 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.772733    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-dshm" (OuterVolumeSpecName: "dshm") pod "063ef7b9-d569-4194-a4a5-aa9031851122" (UID: "063ef7b9-d569-4194-a4a5-aa9031851122"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:34:22.773036 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.773007    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/063ef7b9-d569-4194-a4a5-aa9031851122-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "063ef7b9-d569-4194-a4a5-aa9031851122" (UID: "063ef7b9-d569-4194-a4a5-aa9031851122"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:34:22.773036 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.773018    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/063ef7b9-d569-4194-a4a5-aa9031851122-kube-api-access-7q4zx" (OuterVolumeSpecName: "kube-api-access-7q4zx") pod "063ef7b9-d569-4194-a4a5-aa9031851122" (UID: "063ef7b9-d569-4194-a4a5-aa9031851122"). InnerVolumeSpecName "kube-api-access-7q4zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:34:22.872426 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.872387    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q4zx\" (UniqueName: \"kubernetes.io/projected/063ef7b9-d569-4194-a4a5-aa9031851122-kube-api-access-7q4zx\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:34:22.872426 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.872421    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-tmp-dir\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:34:22.872426 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.872432    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/063ef7b9-d569-4194-a4a5-aa9031851122-tls-certs\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:34:22.872671 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:22.872441    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/063ef7b9-d569-4194-a4a5-aa9031851122-dshm\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:34:23.146025 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:23.145931    2565 generic.go:356] "Generic (PLEG): container finished" podID="063ef7b9-d569-4194-a4a5-aa9031851122" containerID="2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41" exitCode=0
Jul 23 22:34:23.146025 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:23.145979    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"
Jul 23 22:34:23.146295 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:23.146023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc" event={"ID":"063ef7b9-d569-4194-a4a5-aa9031851122","Type":"ContainerDied","Data":"2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41"}
Jul 23 22:34:23.146295 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:23.146073    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc" event={"ID":"063ef7b9-d569-4194-a4a5-aa9031851122","Type":"ContainerDied","Data":"e8327fd4bf8a937f1aa0c51767df467a6e75913a34dd1d47b17e740bdbc8af6d"}
Jul 23 22:34:23.146295 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:23.146095    2565 scope.go:117] "RemoveContainer" containerID="2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41"
Jul 23 22:34:23.155201 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:23.155176    2565 scope.go:117] "RemoveContainer" containerID="2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41"
Jul 23 22:34:23.155477 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:34:23.155458    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41\": container with ID starting with 2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41 not found: ID does not exist" containerID="2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41"
Jul 23 22:34:23.155540 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:23.155485    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41"} err="failed to get container status \"2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41\": rpc error: code = NotFound desc = could not find container \"2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41\": container with ID starting with 2fcd88974233c816649688fb5b96d0ba844606d29f3df0dee573ecab84b4fe41 not found: ID does not exist"
Jul 23 22:34:23.169003 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:23.168977    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"]
Jul 23 22:34:23.173207 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:23.173184    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/sub-test-model-1c273d-kserve-566c8bbcb7-lpwfc"]
Jul 23 22:34:24.481816 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:34:24.481779    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="063ef7b9-d569-4194-a4a5-aa9031851122" path="/var/lib/kubelet/pods/063ef7b9-d569-4194-a4a5-aa9031851122/volumes"
Jul 23 22:35:35.636677 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:35.636635    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"]
Jul 23 22:35:44.093733 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.093689    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7464-140371672127360"]
Jul 23 22:35:44.094192 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.094178    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="063ef7b9-d569-4194-a4a5-aa9031851122" containerName="main"
Jul 23 22:35:44.094320 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.094199    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="063ef7b9-d569-4194-a4a5-aa9031851122" containerName="main"
Jul 23 22:35:44.094378 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.094341    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="063ef7b9-d569-4194-a4a5-aa9031851122" containerName="main"
Jul 23 22:35:44.096957 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.096936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:44.099860 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.099835    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rmhjm\""
Jul 23 22:35:44.101838 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.101816    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7464-140371672127360"]
Jul 23 22:35:44.147495 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.147462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92vr7\" (UniqueName: \"kubernetes.io/projected/4a3533c5-aea3-4851-9516-ab7c2af4c85a-kube-api-access-92vr7\") pod \"test-curl-7464-140371672127360\" (UID: \"4a3533c5-aea3-4851-9516-ab7c2af4c85a\") " pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:44.248504 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.248471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92vr7\" (UniqueName: \"kubernetes.io/projected/4a3533c5-aea3-4851-9516-ab7c2af4c85a-kube-api-access-92vr7\") pod \"test-curl-7464-140371672127360\" (UID: \"4a3533c5-aea3-4851-9516-ab7c2af4c85a\") " pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:44.256574 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.256550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92vr7\" (UniqueName: \"kubernetes.io/projected/4a3533c5-aea3-4851-9516-ab7c2af4c85a-kube-api-access-92vr7\") pod \"test-curl-7464-140371672127360\" (UID: \"4a3533c5-aea3-4851-9516-ab7c2af4c85a\") " pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:44.407919 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.407846    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:44.537257 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.537230    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7464-140371672127360"]
Jul 23 22:35:44.539225 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:35:44.539189    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a3533c5_aea3_4851_9516_ab7c2af4c85a.slice/crio-26a0a9e6bafe3d4a8e891c0ff56fa4f7f4f00377c2a6f0750a95b57e86a6d9c2 WatchSource:0}: Error finding container 26a0a9e6bafe3d4a8e891c0ff56fa4f7f4f00377c2a6f0750a95b57e86a6d9c2: Status 404 returned error can't find the container with id 26a0a9e6bafe3d4a8e891c0ff56fa4f7f4f00377c2a6f0750a95b57e86a6d9c2
Jul 23 22:35:44.540559 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:44.540537    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 22:35:45.487876 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:45.487778    2565 generic.go:356] "Generic (PLEG): container finished" podID="4a3533c5-aea3-4851-9516-ab7c2af4c85a" containerID="7ef9ec9940497a4f2760ab59e03c69afa03d6a533395d79f6f55da6df218b0f9" exitCode=0
Jul 23 22:35:45.487876 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:45.487858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7464-140371672127360" event={"ID":"4a3533c5-aea3-4851-9516-ab7c2af4c85a","Type":"ContainerDied","Data":"7ef9ec9940497a4f2760ab59e03c69afa03d6a533395d79f6f55da6df218b0f9"}
Jul 23 22:35:45.488290 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:45.487905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7464-140371672127360" event={"ID":"4a3533c5-aea3-4851-9516-ab7c2af4c85a","Type":"ContainerStarted","Data":"26a0a9e6bafe3d4a8e891c0ff56fa4f7f4f00377c2a6f0750a95b57e86a6d9c2"}
Jul 23 22:35:46.619512 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.619486    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:46.654274 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.654246    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7464-140371672127360_4a3533c5-aea3-4851-9516-ab7c2af4c85a/test-curl-7464-140371672127360/0.log"
Jul 23 22:35:46.662485 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.662463    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92vr7\" (UniqueName: \"kubernetes.io/projected/4a3533c5-aea3-4851-9516-ab7c2af4c85a-kube-api-access-92vr7\") pod \"4a3533c5-aea3-4851-9516-ab7c2af4c85a\" (UID: \"4a3533c5-aea3-4851-9516-ab7c2af4c85a\") "
Jul 23 22:35:46.664530 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.664508    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a3533c5-aea3-4851-9516-ab7c2af4c85a-kube-api-access-92vr7" (OuterVolumeSpecName: "kube-api-access-92vr7") pod "4a3533c5-aea3-4851-9516-ab7c2af4c85a" (UID: "4a3533c5-aea3-4851-9516-ab7c2af4c85a"). InnerVolumeSpecName "kube-api-access-92vr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:35:46.674659 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.674635    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7464-140371672127360"]
Jul 23 22:35:46.676822 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.676802    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7464-140371672127360"]
Jul 23 22:35:46.763097 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.763018    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92vr7\" (UniqueName: \"kubernetes.io/projected/4a3533c5-aea3-4851-9516-ab7c2af4c85a-kube-api-access-92vr7\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:35:46.796385 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.796351    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7464-140371672127360"]
Jul 23 22:35:46.796706 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.796691    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3533c5-aea3-4851-9516-ab7c2af4c85a" containerName="test-curl-7464-140371672127360"
Jul 23 22:35:46.796751 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.796709    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3533c5-aea3-4851-9516-ab7c2af4c85a" containerName="test-curl-7464-140371672127360"
Jul 23 22:35:46.796791 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.796767    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a3533c5-aea3-4851-9516-ab7c2af4c85a" containerName="test-curl-7464-140371672127360"
Jul 23 22:35:46.799583 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.799567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:46.805939 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.805911    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7464-140371672127360"]
Jul 23 22:35:46.864163 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.864130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpr6s\" (UniqueName: \"kubernetes.io/projected/1ad6f21e-033d-407d-b003-026b1192ea98-kube-api-access-qpr6s\") pod \"test-curl-7464-140371672127360\" (UID: \"1ad6f21e-033d-407d-b003-026b1192ea98\") " pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:46.965619 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.965578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpr6s\" (UniqueName: \"kubernetes.io/projected/1ad6f21e-033d-407d-b003-026b1192ea98-kube-api-access-qpr6s\") pod \"test-curl-7464-140371672127360\" (UID: \"1ad6f21e-033d-407d-b003-026b1192ea98\") " pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:46.974786 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:46.974753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpr6s\" (UniqueName: \"kubernetes.io/projected/1ad6f21e-033d-407d-b003-026b1192ea98-kube-api-access-qpr6s\") pod \"test-curl-7464-140371672127360\" (UID: \"1ad6f21e-033d-407d-b003-026b1192ea98\") " pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:47.109505 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:47.109466    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:47.232111 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:47.232088    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7464-140371672127360"]
Jul 23 22:35:47.234095 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:35:47.234068    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ad6f21e_033d_407d_b003_026b1192ea98.slice/crio-fd152ef507494bb51513de14314f7cbbb27b8c0396df501ed888b2dd034e9056 WatchSource:0}: Error finding container fd152ef507494bb51513de14314f7cbbb27b8c0396df501ed888b2dd034e9056: Status 404 returned error can't find the container with id fd152ef507494bb51513de14314f7cbbb27b8c0396df501ed888b2dd034e9056
Jul 23 22:35:47.499997 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:47.499924    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:47.500165 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:47.499926    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26a0a9e6bafe3d4a8e891c0ff56fa4f7f4f00377c2a6f0750a95b57e86a6d9c2"
Jul 23 22:35:47.501071 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:47.501048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7464-140371672127360" event={"ID":"1ad6f21e-033d-407d-b003-026b1192ea98","Type":"ContainerStarted","Data":"fd152ef507494bb51513de14314f7cbbb27b8c0396df501ed888b2dd034e9056"}
Jul 23 22:35:47.511572 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:47.511543    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7464-140371672127360" oldPodUID="4a3533c5-aea3-4851-9516-ab7c2af4c85a" podUID="1ad6f21e-033d-407d-b003-026b1192ea98"
Jul 23 22:35:48.483411 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:48.483373    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a3533c5-aea3-4851-9516-ab7c2af4c85a" path="/var/lib/kubelet/pods/4a3533c5-aea3-4851-9516-ab7c2af4c85a/volumes"
Jul 23 22:35:48.507113 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:48.507084    2565 generic.go:356] "Generic (PLEG): container finished" podID="1ad6f21e-033d-407d-b003-026b1192ea98" containerID="9ee861b9b0a144ef7c2781901b0991d8567de6b6cb7e9f1f0e926dfbdee3c362" exitCode=0
Jul 23 22:35:48.507286 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:48.507167    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7464-140371672127360" event={"ID":"1ad6f21e-033d-407d-b003-026b1192ea98","Type":"ContainerDied","Data":"9ee861b9b0a144ef7c2781901b0991d8567de6b6cb7e9f1f0e926dfbdee3c362"}
Jul 23 22:35:49.636501 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.636472    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:49.657839 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.657811    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7464-140371672127360_1ad6f21e-033d-407d-b003-026b1192ea98/test-curl-7464-140371672127360/0.log"
Jul 23 22:35:49.684004 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.683974    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7464-140371672127360"]
Jul 23 22:35:49.685599 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.685573    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpr6s\" (UniqueName: \"kubernetes.io/projected/1ad6f21e-033d-407d-b003-026b1192ea98-kube-api-access-qpr6s\") pod \"1ad6f21e-033d-407d-b003-026b1192ea98\" (UID: \"1ad6f21e-033d-407d-b003-026b1192ea98\") "
Jul 23 22:35:49.687756 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.687727    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad6f21e-033d-407d-b003-026b1192ea98-kube-api-access-qpr6s" (OuterVolumeSpecName: "kube-api-access-qpr6s") pod "1ad6f21e-033d-407d-b003-026b1192ea98" (UID: "1ad6f21e-033d-407d-b003-026b1192ea98"). InnerVolumeSpecName "kube-api-access-qpr6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:35:49.687912 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.687894    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7464-140371672127360"]
Jul 23 22:35:49.786895 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.786860    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpr6s\" (UniqueName: \"kubernetes.io/projected/1ad6f21e-033d-407d-b003-026b1192ea98-kube-api-access-qpr6s\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:35:49.812447 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.812417    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7464-140371672127648"]
Jul 23 22:35:49.812728 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.812716    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad6f21e-033d-407d-b003-026b1192ea98" containerName="test-curl-7464-140371672127360"
Jul 23 22:35:49.812771 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.812730    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad6f21e-033d-407d-b003-026b1192ea98" containerName="test-curl-7464-140371672127360"
Jul 23 22:35:49.812811 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.812793    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad6f21e-033d-407d-b003-026b1192ea98" containerName="test-curl-7464-140371672127360"
Jul 23 22:35:49.815546 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.815528    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127648"
Jul 23 22:35:49.822905 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.822885    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7464-140371672127648"]
Jul 23 22:35:49.887662 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.887637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tfgb\" (UniqueName: \"kubernetes.io/projected/3f02e5bc-923f-4b36-ae64-e27b04bb7f53-kube-api-access-7tfgb\") pod \"test-curl-7464-140371672127648\" (UID: \"3f02e5bc-923f-4b36-ae64-e27b04bb7f53\") " pod="opendatahub/test-curl-7464-140371672127648"
Jul 23 22:35:49.988252 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.988198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfgb\" (UniqueName: \"kubernetes.io/projected/3f02e5bc-923f-4b36-ae64-e27b04bb7f53-kube-api-access-7tfgb\") pod \"test-curl-7464-140371672127648\" (UID: \"3f02e5bc-923f-4b36-ae64-e27b04bb7f53\") " pod="opendatahub/test-curl-7464-140371672127648"
Jul 23 22:35:49.997023 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:49.997002    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tfgb\" (UniqueName: \"kubernetes.io/projected/3f02e5bc-923f-4b36-ae64-e27b04bb7f53-kube-api-access-7tfgb\") pod \"test-curl-7464-140371672127648\" (UID: \"3f02e5bc-923f-4b36-ae64-e27b04bb7f53\") " pod="opendatahub/test-curl-7464-140371672127648"
Jul 23 22:35:50.125902 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.125841    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127648"
Jul 23 22:35:50.257650 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.257623    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7464-140371672127648"]
Jul 23 22:35:50.259301 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:35:50.259269    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f02e5bc_923f_4b36_ae64_e27b04bb7f53.slice/crio-85f3bcef3e9b6f957485959e0862552c6f041613540abf8ca13717511f7f6aa9 WatchSource:0}: Error finding container 85f3bcef3e9b6f957485959e0862552c6f041613540abf8ca13717511f7f6aa9: Status 404 returned error can't find the container with id 85f3bcef3e9b6f957485959e0862552c6f041613540abf8ca13717511f7f6aa9
Jul 23 22:35:50.482046 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.481975    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ad6f21e-033d-407d-b003-026b1192ea98" path="/var/lib/kubelet/pods/1ad6f21e-033d-407d-b003-026b1192ea98/volumes"
Jul 23 22:35:50.516193 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.516164    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127360"
Jul 23 22:35:50.516193 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.516174    2565 scope.go:117] "RemoveContainer" containerID="9ee861b9b0a144ef7c2781901b0991d8567de6b6cb7e9f1f0e926dfbdee3c362"
Jul 23 22:35:50.517537 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.517507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7464-140371672127648" event={"ID":"3f02e5bc-923f-4b36-ae64-e27b04bb7f53","Type":"ContainerStarted","Data":"85f3bcef3e9b6f957485959e0862552c6f041613540abf8ca13717511f7f6aa9"}
Jul 23 22:35:50.655772 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.655742    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68" podUID="f33f70dc-2ee0-4958-9704-405a95bd0a0c" containerName="main" containerID="cri-o://e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74" gracePeriod=45
Jul 23 22:35:50.900947 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.900922    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:35:50.996516 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.996482    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-model-cache\") pod \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") "
Jul 23 22:35:50.996516 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.996516    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tls-certs\") pod \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") "
Jul 23 22:35:50.996749 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.996535    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-home\") pod \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") "
Jul 23 22:35:50.996749 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.996572    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2t8j\" (UniqueName: \"kubernetes.io/projected/f33f70dc-2ee0-4958-9704-405a95bd0a0c-kube-api-access-v2t8j\") pod \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") "
Jul 23 22:35:50.996749 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.996621    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-dshm\") pod \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") "
Jul 23 22:35:50.996749 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.996662    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tmp-dir\") pod \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\" (UID: \"f33f70dc-2ee0-4958-9704-405a95bd0a0c\") "
Jul 23 22:35:50.996965 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.996775    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-home" (OuterVolumeSpecName: "home") pod "f33f70dc-2ee0-4958-9704-405a95bd0a0c" (UID: "f33f70dc-2ee0-4958-9704-405a95bd0a0c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:35:50.996965 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.996811    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-model-cache" (OuterVolumeSpecName: "model-cache") pod "f33f70dc-2ee0-4958-9704-405a95bd0a0c" (UID: "f33f70dc-2ee0-4958-9704-405a95bd0a0c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:35:50.996965 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.996952    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f33f70dc-2ee0-4958-9704-405a95bd0a0c" (UID: "f33f70dc-2ee0-4958-9704-405a95bd0a0c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:35:50.997079 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.997007    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-model-cache\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:35:50.997079 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.997022    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-home\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:35:50.998748 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.998725    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f33f70dc-2ee0-4958-9704-405a95bd0a0c" (UID: "f33f70dc-2ee0-4958-9704-405a95bd0a0c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:35:50.998847 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.998766    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-dshm" (OuterVolumeSpecName: "dshm") pod "f33f70dc-2ee0-4958-9704-405a95bd0a0c" (UID: "f33f70dc-2ee0-4958-9704-405a95bd0a0c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 22:35:50.998847 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:50.998776    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f33f70dc-2ee0-4958-9704-405a95bd0a0c-kube-api-access-v2t8j" (OuterVolumeSpecName: "kube-api-access-v2t8j") pod "f33f70dc-2ee0-4958-9704-405a95bd0a0c" (UID: "f33f70dc-2ee0-4958-9704-405a95bd0a0c"). InnerVolumeSpecName "kube-api-access-v2t8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:35:51.097680 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.097588    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tls-certs\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:35:51.097680 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.097618    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2t8j\" (UniqueName: \"kubernetes.io/projected/f33f70dc-2ee0-4958-9704-405a95bd0a0c-kube-api-access-v2t8j\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:35:51.097680 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.097628    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-dshm\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:35:51.097680 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.097639    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f33f70dc-2ee0-4958-9704-405a95bd0a0c-tmp-dir\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:35:51.523601 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.523561    2565 generic.go:356] "Generic (PLEG): container finished" podID="3f02e5bc-923f-4b36-ae64-e27b04bb7f53" containerID="501d72cad672f9d7f8fb45b1285b2292ff02fda06aa2281489dd807017500fac" exitCode=0
Jul 23 22:35:51.523791 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.523648    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7464-140371672127648" event={"ID":"3f02e5bc-923f-4b36-ae64-e27b04bb7f53","Type":"ContainerDied","Data":"501d72cad672f9d7f8fb45b1285b2292ff02fda06aa2281489dd807017500fac"}
Jul 23 22:35:51.525511 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.525488    2565 generic.go:356] "Generic (PLEG): container finished" podID="f33f70dc-2ee0-4958-9704-405a95bd0a0c" containerID="e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74" exitCode=0
Jul 23 22:35:51.525622 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.525524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68" event={"ID":"f33f70dc-2ee0-4958-9704-405a95bd0a0c","Type":"ContainerDied","Data":"e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74"}
Jul 23 22:35:51.525622 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.525529    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"
Jul 23 22:35:51.525622 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.525551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68" event={"ID":"f33f70dc-2ee0-4958-9704-405a95bd0a0c","Type":"ContainerDied","Data":"26d0d58fd0c972894b0e8472180423c17b954162def0b6f44f29ae0d37ebd3db"}
Jul 23 22:35:51.525622 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.525574    2565 scope.go:117] "RemoveContainer" containerID="e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74"
Jul 23 22:35:51.534067 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.534049    2565 scope.go:117] "RemoveContainer" containerID="e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74"
Jul 23 22:35:51.534339 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:35:51.534319    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74\": container with ID starting with e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74 not found: ID does not exist" containerID="e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74"
Jul 23 22:35:51.534423 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.534345    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74"} err="failed to get container status \"e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74\": rpc error: code = NotFound desc = could not find container \"e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74\": container with ID starting with e235b558e167c3fde7da18aeae3cc3a9aabf6cd57afb46b8141ab896d05b7b74 not found: ID does not exist"
Jul 23 22:35:51.551757 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.551733    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"]
Jul 23 22:35:51.554873 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:51.554852    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1c273d/rate-test-model-1c273d-kserve-6b8f6d4c9-m5j68"]
Jul 23 22:35:52.481752 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:52.481717    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f33f70dc-2ee0-4958-9704-405a95bd0a0c" path="/var/lib/kubelet/pods/f33f70dc-2ee0-4958-9704-405a95bd0a0c/volumes"
Jul 23 22:35:52.667967 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:52.667942    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127648"
Jul 23 22:35:52.689483 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:52.689460    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7464-140371672127648_3f02e5bc-923f-4b36-ae64-e27b04bb7f53/test-curl-7464-140371672127648/0.log"
Jul 23 22:35:52.710637 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:52.710605    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tfgb\" (UniqueName: \"kubernetes.io/projected/3f02e5bc-923f-4b36-ae64-e27b04bb7f53-kube-api-access-7tfgb\") pod \"3f02e5bc-923f-4b36-ae64-e27b04bb7f53\" (UID: \"3f02e5bc-923f-4b36-ae64-e27b04bb7f53\") "
Jul 23 22:35:52.712738 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:52.712715    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7464-140371672127648"]
Jul 23 22:35:52.712926 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:52.712908    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f02e5bc-923f-4b36-ae64-e27b04bb7f53-kube-api-access-7tfgb" (OuterVolumeSpecName: "kube-api-access-7tfgb") pod "3f02e5bc-923f-4b36-ae64-e27b04bb7f53" (UID: "3f02e5bc-923f-4b36-ae64-e27b04bb7f53"). InnerVolumeSpecName "kube-api-access-7tfgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:35:52.718385 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:52.718360    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7464-140371672127648"]
Jul 23 22:35:52.811362 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:52.811332    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tfgb\" (UniqueName: \"kubernetes.io/projected/3f02e5bc-923f-4b36-ae64-e27b04bb7f53-kube-api-access-7tfgb\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:35:53.535138 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:53.535105    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7464-140371672127648"
Jul 23 22:35:53.535622 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:53.535150    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85f3bcef3e9b6f957485959e0862552c6f041613540abf8ca13717511f7f6aa9"
Jul 23 22:35:53.545243 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:35:53.545197    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7464-140371672127648\" is forbidden: User \"system:node:ip-10-0-134-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-91.ec2.internal' and this object" podUID="3f02e5bc-923f-4b36-ae64-e27b04bb7f53" pod="opendatahub/test-curl-7464-140371672127648"
Jul 23 22:35:54.481752 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:35:54.481718    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f02e5bc-923f-4b36-ae64-e27b04bb7f53" path="/var/lib/kubelet/pods/3f02e5bc-923f-4b36-ae64-e27b04bb7f53/volumes"
Jul 23 22:36:05.751878 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:05.751843    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"]
Jul 23 22:36:05.752329 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:05.752090    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn" podUID="4001b1f3-2f66-4ba6-979b-c7c84ed50b35" containerName="maas-api" containerID="cri-o://0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc" gracePeriod=30
Jul 23 22:36:05.995849 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:05.995823    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:36:06.119721 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.119690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-openshift-service-ca\") pod \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") "
Jul 23 22:36:06.119721 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.119726    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zvqm\" (UniqueName: \"kubernetes.io/projected/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-kube-api-access-5zvqm\") pod \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") "
Jul 23 22:36:06.119925 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.119759    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-maas-api-tls\") pod \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\" (UID: \"4001b1f3-2f66-4ba6-979b-c7c84ed50b35\") "
Jul 23 22:36:06.120114 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.120094    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4001b1f3-2f66-4ba6-979b-c7c84ed50b35" (UID: "4001b1f3-2f66-4ba6-979b-c7c84ed50b35"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 22:36:06.121800 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.121763    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-kube-api-access-5zvqm" (OuterVolumeSpecName: "kube-api-access-5zvqm") pod "4001b1f3-2f66-4ba6-979b-c7c84ed50b35" (UID: "4001b1f3-2f66-4ba6-979b-c7c84ed50b35"). InnerVolumeSpecName "kube-api-access-5zvqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 22:36:06.121909 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.121840    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4001b1f3-2f66-4ba6-979b-c7c84ed50b35" (UID: "4001b1f3-2f66-4ba6-979b-c7c84ed50b35"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 22:36:06.221430 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.221376    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-openshift-service-ca\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:36:06.221430 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.221422    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zvqm\" (UniqueName: \"kubernetes.io/projected/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-kube-api-access-5zvqm\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:36:06.221430 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.221432    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4001b1f3-2f66-4ba6-979b-c7c84ed50b35-maas-api-tls\") on node \"ip-10-0-134-91.ec2.internal\" DevicePath \"\""
Jul 23 22:36:06.590348 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.590309    2565 generic.go:356] "Generic (PLEG): container finished" podID="4001b1f3-2f66-4ba6-979b-c7c84ed50b35" containerID="0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc" exitCode=0
Jul 23 22:36:06.590591 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.590357    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"
Jul 23 22:36:06.590591 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.590352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn" event={"ID":"4001b1f3-2f66-4ba6-979b-c7c84ed50b35","Type":"ContainerDied","Data":"0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc"}
Jul 23 22:36:06.590591 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.590479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn" event={"ID":"4001b1f3-2f66-4ba6-979b-c7c84ed50b35","Type":"ContainerDied","Data":"9b7938793c8ef61d63c162cb9a0cebdd811b03cb83f9da9d280f9052891aece5"}
Jul 23 22:36:06.590591 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.590502    2565 scope.go:117] "RemoveContainer" containerID="0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc"
Jul 23 22:36:06.598518 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.598490    2565 scope.go:117] "RemoveContainer" containerID="0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc"
Jul 23 22:36:06.598785 ip-10-0-134-91 kubenswrapper[2565]: E0723 22:36:06.598767    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc\": container with ID starting with 0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc not found: ID does not exist" containerID="0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc"
Jul 23 22:36:06.598835 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.598794    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc"} err="failed to get container status \"0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc\": rpc error: code = NotFound desc = could not find container \"0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc\": container with ID starting with 0fcc9c83ac1017c60a50ea5467075eabcd5a4fce92eecaabd9cf907da9f0a1cc not found: ID does not exist"
Jul 23 22:36:06.607695 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.607674    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"]
Jul 23 22:36:06.611581 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:06.611560    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1c273d-7dbf4bff59-lchsn"]
Jul 23 22:36:08.481656 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:08.481622    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4001b1f3-2f66-4ba6-979b-c7c84ed50b35" path="/var/lib/kubelet/pods/4001b1f3-2f66-4ba6-979b-c7c84ed50b35/volumes"
Jul 23 22:36:36.545362 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:36.545334    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:36:36.552865 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:36.552846    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdxmw_f95ebfd9-d9ab-4600-8242-a9afb437e348/ovn-acl-logging/0.log"
Jul 23 22:36:39.834889 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:39.834857    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68c5d857ff-xprjc_bef6f1a2-4117-4614-a641-12ca5c633f26/authorino/0.log"
Jul 23 22:36:45.762415 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:45.762387    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5764b54ddf-57njt_3668072c-8691-4b1c-b7a2-5b3aa4ba667f/manager/0.log"
Jul 23 22:36:45.998100 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:45.998071    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-brvfj_65646dc6-bbb8-44ec-8b5c-297e8372aa69/manager/0.log"
Jul 23 22:36:46.389866 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:46.389834    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c_1093003f-9d80-4fc7-bc8f-a85ee38573f2/copy-manifests/0.log"
Jul 23 22:36:46.402876 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:46.402845    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c_1093003f-9d80-4fc7-bc8f-a85ee38573f2/manager/0.log"
Jul 23 22:36:46.770098 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:46.770068    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-79b7dbcf5c-tqwrh_b8b98248-50ec-4f97-9a70-f58454d60305/maas-api/0.log"
Jul 23 22:36:48.537293 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:48.537265    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68c5d857ff-xprjc_bef6f1a2-4117-4614-a641-12ca5c633f26/authorino/0.log"
Jul 23 22:36:50.123066 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:50.123034    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc6f65d97-w7985_6e09906a-82fe-4223-9b67-9c6f71b54e86/kube-auth-proxy/0.log"
Jul 23 22:36:50.378740 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:50.378660    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zrgwh_429a86ce-fca9-4355-97dd-a424234d2937/payload-pre-processing/0.log"
Jul 23 22:36:51.121962 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:51.121930    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-xpl55_9b93e476-c46b-479a-87f8-5f7a06ca18a8/main/0.log"
Jul 23 22:36:51.368628 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:51.368562    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fz8hvw_225e065b-18b9-4546-9040-e7fcd25d4b23/main/0.log"
Jul 23 22:36:51.500735 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:36:51.500644    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-qp689_1a0d75ce-a111-4698-8350-67380a97f089/main/0.log"
Jul 23 22:37:00.931122 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:00.931094    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c56hs_494f1e0c-becb-4576-87d6-c79ae2f4c8e0/global-pull-secret-syncer/0.log"
Jul 23 22:37:01.062777 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:01.062736    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rjtvh_7f46f96e-e91d-40ba-aba5-6e2531cabc56/konnectivity-agent/0.log"
Jul 23 22:37:01.083473 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:01.083448    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-91.ec2.internal_23b00daf35cdc991e4ab2a8e97ad8f2c/haproxy/0.log"
Jul 23 22:37:06.626359 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:06.626325    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68c5d857ff-xprjc_bef6f1a2-4117-4614-a641-12ca5c633f26/authorino/0.log"
Jul 23 22:37:09.311266 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:09.311234    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m579m_7a900a9f-b631-467e-a7c2-51f90e9583d1/node-exporter/0.log"
Jul 23 22:37:09.344747 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:09.344721    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m579m_7a900a9f-b631-467e-a7c2-51f90e9583d1/kube-rbac-proxy/0.log"
Jul 23 22:37:09.367723 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:09.367697    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m579m_7a900a9f-b631-467e-a7c2-51f90e9583d1/init-textfile/0.log"
Jul 23 22:37:10.692074 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.692039    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"]
Jul 23 22:37:10.692451 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.692362    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33f70dc-2ee0-4958-9704-405a95bd0a0c" containerName="main"
Jul 23 22:37:10.692451 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.692374    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33f70dc-2ee0-4958-9704-405a95bd0a0c" containerName="main"
Jul 23 22:37:10.692451 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.692386    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4001b1f3-2f66-4ba6-979b-c7c84ed50b35" containerName="maas-api"
Jul 23 22:37:10.692451 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.692391    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4001b1f3-2f66-4ba6-979b-c7c84ed50b35" containerName="maas-api"
Jul 23 22:37:10.692451 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.692405    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f02e5bc-923f-4b36-ae64-e27b04bb7f53" containerName="test-curl-7464-140371672127648"
Jul 23 22:37:10.692451 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.692412    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f02e5bc-923f-4b36-ae64-e27b04bb7f53" containerName="test-curl-7464-140371672127648"
Jul 23 22:37:10.692737 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.692458    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f02e5bc-923f-4b36-ae64-e27b04bb7f53" containerName="test-curl-7464-140371672127648"
Jul 23 22:37:10.692737 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.692468    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f33f70dc-2ee0-4958-9704-405a95bd0a0c" containerName="main"
Jul 23 22:37:10.692737 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.692476    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4001b1f3-2f66-4ba6-979b-c7c84ed50b35" containerName="maas-api"
Jul 23 22:37:10.695646 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.695630    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.697871 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.697850    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wczc\"/\"kube-root-ca.crt\""
Jul 23 22:37:10.698983 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.698964    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wczc\"/\"openshift-service-ca.crt\""
Jul 23 22:37:10.699082 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.698971    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4wczc\"/\"default-dockercfg-bxs7g\""
Jul 23 22:37:10.704316 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.704296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"]
Jul 23 22:37:10.751494 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.751461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scfmz\" (UniqueName: \"kubernetes.io/projected/4be3d06d-fceb-42d5-a228-08fb36d70b54-kube-api-access-scfmz\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.751636 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.751506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-sys\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.751636 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.751528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-lib-modules\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.751636 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.751604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-podres\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.751636 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.751632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-proc\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.852940 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.852907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-podres\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.852940 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.852945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-proc\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.853150 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.853003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scfmz\" (UniqueName: \"kubernetes.io/projected/4be3d06d-fceb-42d5-a228-08fb36d70b54-kube-api-access-scfmz\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.853150 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.853031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-sys\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.853150 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.853059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-lib-modules\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.853150 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.853080    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-podres\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.853150 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.853108    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-proc\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.853150 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.853127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-sys\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.853416 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.853191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4be3d06d-fceb-42d5-a228-08fb36d70b54-lib-modules\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:10.861696 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:10.861672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scfmz\" (UniqueName: \"kubernetes.io/projected/4be3d06d-fceb-42d5-a228-08fb36d70b54-kube-api-access-scfmz\") pod \"perf-node-gather-daemonset-frcdp\" (UID: \"4be3d06d-fceb-42d5-a228-08fb36d70b54\") " pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:11.005824 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:11.005735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:11.135568 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:11.135542    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"]
Jul 23 22:37:11.137689 ip-10-0-134-91 kubenswrapper[2565]: W0723 22:37:11.137664    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4be3d06d_fceb_42d5_a228_08fb36d70b54.slice/crio-9f23cf4560f8f7b32534fac28cfe9c305dd77ba631b257e36d2f9309e00127b0 WatchSource:0}: Error finding container 9f23cf4560f8f7b32534fac28cfe9c305dd77ba631b257e36d2f9309e00127b0: Status 404 returned error can't find the container with id 9f23cf4560f8f7b32534fac28cfe9c305dd77ba631b257e36d2f9309e00127b0
Jul 23 22:37:11.164028 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:11.164009    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-sjvhr_a5af52a0-b63e-4100-90c0-40f077b7de7a/networking-console-plugin/0.log"
Jul 23 22:37:11.865917 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:11.865881    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp" event={"ID":"4be3d06d-fceb-42d5-a228-08fb36d70b54","Type":"ContainerStarted","Data":"a00688fd6d07f96aec498d2583d512ef44e5183b3017a4159220c7c6990c2bb4"}
Jul 23 22:37:11.866378 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:11.865931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp" event={"ID":"4be3d06d-fceb-42d5-a228-08fb36d70b54","Type":"ContainerStarted","Data":"9f23cf4560f8f7b32534fac28cfe9c305dd77ba631b257e36d2f9309e00127b0"}
Jul 23 22:37:11.866378 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:11.865969    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:11.882677 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:11.882635    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp" podStartSLOduration=1.882620749 podStartE2EDuration="1.882620749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:37:11.882353847 +0000 UTC m=+2735.917061389" watchObservedRunningTime="2026-07-23 22:37:11.882620749 +0000 UTC m=+2735.917328287"
Jul 23 22:37:13.820854 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:13.820824    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ldwf6_26a3edf1-777d-4953-a47c-88670d366937/dns/0.log"
Jul 23 22:37:13.840877 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:13.840856    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ldwf6_26a3edf1-777d-4953-a47c-88670d366937/kube-rbac-proxy/0.log"
Jul 23 22:37:13.971229 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:13.971179    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hfjw8_e3f1eeec-867b-4366-bfd9-0676e9f55877/dns-node-resolver/0.log"
Jul 23 22:37:14.537731 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:14.537703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-768bf9c6cf-2tsfw_171807f4-d64c-4480-aab9-932bf7b11f0d/registry/0.log"
Jul 23 22:37:14.558772 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:14.558748    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5g6bl_a385c2fd-eb31-4b7b-bb8d-d8d0c42816b4/node-ca/0.log"
Jul 23 22:37:15.788322 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:15.788299    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc6f65d97-w7985_6e09906a-82fe-4223-9b67-9c6f71b54e86/kube-auth-proxy/0.log"
Jul 23 22:37:15.904618 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:15.904591    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zrgwh_429a86ce-fca9-4355-97dd-a424234d2937/payload-pre-processing/0.log"
Jul 23 22:37:16.680066 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:16.680035    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mc9c7_7a40c75d-40c3-4247-a2a1-ee4ee39b84bc/serve-healthcheck-canary/0.log"
Jul 23 22:37:17.304926 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:17.304898    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9hdj_743f6aa9-b1d3-42de-8019-2905221ebbf5/kube-rbac-proxy/0.log"
Jul 23 22:37:17.324814 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:17.324789    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9hdj_743f6aa9-b1d3-42de-8019-2905221ebbf5/exporter/0.log"
Jul 23 22:37:17.345106 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:17.345076    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9hdj_743f6aa9-b1d3-42de-8019-2905221ebbf5/extractor/0.log"
Jul 23 22:37:17.879711 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:17.879679    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4wczc/perf-node-gather-daemonset-frcdp"
Jul 23 22:37:19.999084 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:19.999055    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5764b54ddf-57njt_3668072c-8691-4b1c-b7a2-5b3aa4ba667f/manager/0.log"
Jul 23 22:37:20.090255 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:20.090202    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-brvfj_65646dc6-bbb8-44ec-8b5c-297e8372aa69/manager/0.log"
Jul 23 22:37:20.267784 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:20.267761    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c_1093003f-9d80-4fc7-bc8f-a85ee38573f2/manager/0.log"
Jul 23 22:37:20.285237 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:20.285197    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7bc97c8c-zvf8c_1093003f-9d80-4fc7-bc8f-a85ee38573f2/copy-manifests/0.log"
Jul 23 22:37:21.538934 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:21.538905    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66b46854f4-sxbbg_fb5475d5-7d42-491b-881c-8019b85155ef/manager/0.log"
Jul 23 22:37:22.248532 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:22.248503    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc6f65d97-w7985_6e09906a-82fe-4223-9b67-9c6f71b54e86/kube-auth-proxy/0.log"
Jul 23 22:37:22.348360 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:22.348334    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zrgwh_429a86ce-fca9-4355-97dd-a424234d2937/payload-pre-processing/0.log"
Jul 23 22:37:23.781623 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:23.781596    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc6f65d97-w7985_6e09906a-82fe-4223-9b67-9c6f71b54e86/kube-auth-proxy/0.log"
Jul 23 22:37:23.872744 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:23.872718    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-zrgwh_429a86ce-fca9-4355-97dd-a424234d2937/payload-pre-processing/0.log"
Jul 23 22:37:27.957291 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:27.957263    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl7vn_ae6cee96-e6ab-4525-bbe9-572ef18332b4/kube-multus-additional-cni-plugins/0.log"
Jul 23 22:37:27.977315 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:27.977290    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl7vn_ae6cee96-e6ab-4525-bbe9-572ef18332b4/egress-router-binary-copy/0.log"
Jul 23 22:37:27.997723 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:27.997705    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl7vn_ae6cee96-e6ab-4525-bbe9-572ef18332b4/cni-plugins/0.log"
Jul 23 22:37:28.016302 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:28.016280    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl7vn_ae6cee96-e6ab-4525-bbe9-572ef18332b4/bond-cni-plugin/0.log"
Jul 23 22:37:28.036692 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:28.036677    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl7vn_ae6cee96-e6ab-4525-bbe9-572ef18332b4/routeoverride-cni/0.log"
Jul 23 22:37:28.056633 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:28.056610    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl7vn_ae6cee96-e6ab-4525-bbe9-572ef18332b4/whereabouts-cni-bincopy/0.log"
Jul 23 22:37:28.079240 ip-10-0-134-91 kubenswrapper[2565]: I0723 22:37:28.079205    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fl7vn_ae6cee96-e6ab-4525-bbe9-572ef18332b4/whereabouts-cni/0.log"