Jul 14 19:49:38.268472 ip-10-0-142-56 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 14 19:49:38.268482 ip-10-0-142-56 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 14 19:49:38.268506 ip-10-0-142-56 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 14 19:49:38.268773 ip-10-0-142-56 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 14 19:49:48.301483 ip-10-0-142-56 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 14 19:49:48.301500 ip-10-0-142-56 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 48a4c7f8d367491ab181e9f06ae889d3 --
Jul 14 19:51:44.113486 ip-10-0-142-56 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 19:51:44.483753 ip-10-0-142-56 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:51:44.483753 ip-10-0-142-56 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 19:51:44.483753 ip-10-0-142-56 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:51:44.483753 ip-10-0-142-56 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 19:51:44.483753 ip-10-0-142-56 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:51:44.484732 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.484641    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 19:51:44.490839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490818    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:44.490839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490837    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:44.490839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490842    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490846    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490849    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490852    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490855    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490858    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490871    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490874    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490877    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490879    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490882    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490884    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490887    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490892    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490896    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490899    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490902    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490906    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490909    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:44.490945 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490912    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490915    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490918    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490921    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490923    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490926    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490929    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490931    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490934    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490936    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490939    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490941    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490944    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490947    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490950    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490952    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490955    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490958    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490960    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490963    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:44.491439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490966    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490968    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490971    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490973    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490976    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490979    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490983    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490986    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490989    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490991    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490994    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490996    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.490998    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491001    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491004    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491006    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491009    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491012    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491014    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:44.491911 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491017    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491020    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491023    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491025    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491028    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491030    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491033    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491035    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491038    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491042    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491045    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491047    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491050    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491052    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491057    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491059    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491062    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491064    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491067    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491069    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:44.492378 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491072    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491074    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491077    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491079    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491082    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491084    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491087    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491090    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491093    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491095    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491098    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491100    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491103    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491105    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491108    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491110    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491113    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491116    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491119    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491823    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:44.492867 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491830    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491832    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491836    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491838    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491841    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491843    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491846    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491849    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491852    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491855    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491857    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491860    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491863    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491865    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491868    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491871    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491873    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491875    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491878    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491881    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:44.493365 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491884    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491886    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491889    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491891    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491894    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491896    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491899    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491901    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491904    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491907    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491909    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491912    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491914    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491917    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491920    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491922    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491925    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491927    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491929    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:44.493881 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491931    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491934    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491937    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491939    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491942    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491946    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491949    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491952    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491956    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491958    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491961    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491964    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491967    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491969    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491972    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491974    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491976    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491979    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491981    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:44.494355 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491983    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491987    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491991    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491994    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491997    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.491999    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492002    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492004    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492006    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492009    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492011    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492013    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492016    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492018    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492021    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492025    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492028    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492030    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492033    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492035    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:44.494823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492038    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492040    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492043    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492045    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492048    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492050    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492052    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492055    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492057    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492060    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492064    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492067    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492069    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492072    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492074    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492077    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492080    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492083    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492085    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:44.495313 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492088    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492471    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492476    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492479    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492481    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492484    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492486    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492489    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492492    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492495    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492497    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492500    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492502    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492505    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492508    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492510    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492513    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492515    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492518    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492520    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:44.495774 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492522    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492525    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492527    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492530    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492532    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492535    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492539    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492542    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492546    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492549    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492551    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492554    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492556    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492559    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492561    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492564    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492566    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492569    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492571    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:44.496282 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492574    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492576    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492579    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492581    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492584    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492586    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492588    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492592    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492594    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492596    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492599    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492601    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492604    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492607    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492609    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492612    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492614    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492617    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492619    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:44.496726 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492621    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492624    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492627    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492629    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492632    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492634    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492636    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492639    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492642    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492644    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492646    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492649    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492651    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492654    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492656    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492658    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492662    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492664    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492666    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492669    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:44.497333 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492671    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492673    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492676    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492679    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492682    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492684    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492686    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492689    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492692    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492695    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492698    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492700    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492702    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492705    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492708    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492710    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492712    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492716    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492719    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:44.497823 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492722    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492725    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.492728    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492806    2584 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492817    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492826    2584 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492833    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492839    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492842    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492846    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492851    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492854    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492857    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492861    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492864    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492867    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492870    2584 flags.go:64] FLAG: --cgroup-root=""
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492873    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492876    2584 flags.go:64] FLAG: --client-ca-file=""
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492879    2584 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492882    2584 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492887    2584 flags.go:64] FLAG: --cluster-domain=""
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492889    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 19:51:44.498305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492892    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492895    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492899    2584 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492902    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492905    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492915    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492919    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492922    2584 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492925    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492927    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492934    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492937    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492941    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492944    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492947    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492950    2584 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492953    2584 flags.go:64] FLAG: --enable-server="true"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492956    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492960    2584 flags.go:64] FLAG: --event-burst="100"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492963    2584 flags.go:64] FLAG: --event-qps="50"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492970    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492974    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492977    2584 flags.go:64] FLAG: --eviction-hard=""
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492985    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 19:51:44.498861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492987    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492990    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492993    2584 flags.go:64] FLAG: --eviction-soft=""
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492996    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.492999    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493001    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493004    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493007    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493010    2584 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493012    2584 flags.go:64] FLAG: --feature-gates=""
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493016    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493020    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493023    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493026    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493030    2584 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493033    2584 flags.go:64] FLAG: --help="false"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493036    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493038    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493042    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493045    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493048    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493052    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493054    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 19:51:44.499479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493057    2584 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493059    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493062    2584 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493065    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493068    2584 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493070    2584 flags.go:64] FLAG: --kube-reserved=""
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493074    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493076    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493079    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493082    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493085    2584 flags.go:64] FLAG: --lock-file=""
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493087    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493090    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493093    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493098    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493101    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493103    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493106    2584 flags.go:64] FLAG: --logging-format="text"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493109    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493112    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493116    2584 flags.go:64] FLAG: --manifest-url=""
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493118    2584 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493123    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493126    2584 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493130    2584 flags.go:64] FLAG: --max-pods="110"
Jul 14 19:51:44.500074 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493133    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493136    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493139    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493143    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493146    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493166    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493169    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493185    2584 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493188    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493191    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493195    2584 flags.go:64] FLAG: --pod-cidr=""
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493197    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493203    2584 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493205    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493209    2584 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493212    2584 flags.go:64] FLAG: --port="10250"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493215    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493217    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b9ca4465c47a5c45"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493220    2584 flags.go:64] FLAG: --qos-reserved=""
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493223    2584 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493226    2584 flags.go:64] FLAG: --register-node="true"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493228    2584 flags.go:64] FLAG: --register-with-taints=""
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493232    2584 flags.go:64] FLAG: --registry-burst="10"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493235    2584 flags.go:64] FLAG: --registry-qps="5"
Jul 14 19:51:44.500702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493237    2584 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493241    2584 flags.go:64] FLAG: --reserved-memory=""
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493245    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493247    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493252    2584 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493254    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493257    2584 flags.go:64] FLAG: --runonce="false"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493260    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493263    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493266    2584 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493269    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493273    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493276    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493279    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493282    2584 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493284    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493287    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493290    2584 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493293    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493295    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493298    2584 flags.go:64] FLAG: --system-cgroups=""
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493301    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493306    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493309    2584 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493312    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 19:51:44.501622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493317    2584 flags.go:64] FLAG: --tls-min-version=""
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493320    2584 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493322    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493325    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493328    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493331    2584 flags.go:64] FLAG: --v="2"
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493335    2584 flags.go:64] FLAG: --version="false"
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493339    2584 flags.go:64] FLAG: --vmodule=""
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493343    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493346    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493482    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493489    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493493    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493495    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493498    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493501    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493503    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493506    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493509    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493512    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493515    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:44.502323 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493517    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493520    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493522    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493525    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493527    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493530    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493532    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493535    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493537    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493540    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493543    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493545    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493548    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493550    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493553    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493555    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493558    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493561    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493563    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493565    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:44.502839 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493568    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493570    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493574    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493576    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493579    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493581    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493584    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493586    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493588    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493592    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493595    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493597    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493599    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493602    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493605    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493607    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493609    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493612    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493614    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493617    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:44.503387 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493619    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493621    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493624    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493629    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493632    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493634    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493636    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493639    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493641    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493644    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493647    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493651    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493653    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493657    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493662    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493665    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493667    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493670    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493673    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:44.503864 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493675    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493678    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493681    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493684    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493686    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493689    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493691    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493694    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493696    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493699    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493701    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493704    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493706    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493709    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493711    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493714    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493716    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493719    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493721    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493724    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:44.504345 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493726    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493728    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493731    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493733    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493735    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493738    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493740    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493743    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.493746    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.493751    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.502163    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.502181    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.502196    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.502205    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502265    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:44.504824 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502270    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502273    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502276    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502280    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502283    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502286    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502288    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502291    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502294    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502296    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502299    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502301    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502304    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502307    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502311    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502315    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502319    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502322    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:44.505270 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502326    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502330    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502332    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502335    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502338    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502340    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502343    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502346    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502348    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502351    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502354    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502356    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502360    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502362    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502365    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502367    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502370    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502372    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502375    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502377    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:44.505697 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502380    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502382    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502385    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502387    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502390    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502392    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502395    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502398    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502401    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502403    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502405    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502408    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502410    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502413    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502415    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502418    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502420    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502422    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502425    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502427    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:44.506214 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502429    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502432    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502436    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502439    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502443    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502446    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502449    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502451    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502454    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502456    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502459    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502461    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502464    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502466    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502469    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502471    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502473    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502476    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502478    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:44.506740 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502481    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502485    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502487    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502489    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502492    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502494    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502497    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502499    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502501    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502504    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502506    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502508    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502511    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502513    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502516    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502518    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502521    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502523    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502526    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502528    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:44.507222 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502531    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.502536    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502659    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502664    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502667    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502670    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502674    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502678    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502681    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502684    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502687    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502689    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502692    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502695    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:51:44.507704 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502698    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502701    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502703    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502707    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502710    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502712    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502715    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502718    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502720    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502723    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502726    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502728    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502730    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502734    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502736    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502738    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502741    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502744    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502747    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:51:44.508042 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502749    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502751    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502754    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502756    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502758    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502761    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502763    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502766    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502768    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502770    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502773    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502775    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502778    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502780    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502783    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502786    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502788    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502790    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502793    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502795    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:51:44.508512 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502798    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502800    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502802    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502805    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502807    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502809    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502812    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502814    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502817    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502819    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502822    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502824    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502827    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502829    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502831    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502834    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502836    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502838    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502841    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502844    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:51:44.508989 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502846    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502849    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502851    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502854    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502857    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502859    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502862    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502865    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502867    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502870    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502872    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502875    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502877    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502879    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502881    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502884    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502886    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502888    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502891    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502893    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:51:44.509634 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502896    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502898    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502900    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502903    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502905    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502908    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502910    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:44.502912    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.502917    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.503029    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.506758    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.508232    2584 server.go:1019] "Starting client certificate rotation"
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.508328    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 19:51:44.510121 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.508363    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 19:51:44.511513 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.511498    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 19:51:44.512841 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.512827    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 19:51:44.523987 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.523966    2584 log.go:25] "Validated CRI v1 runtime API"
Jul 14 19:51:44.529437 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.529417    2584 log.go:25] "Validated CRI v1 image API"
Jul 14 19:51:44.530251 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.530235    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 19:51:44.532532 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.532514    2584 fs.go:135] Filesystem UUIDs: map[15ef8ee9-73f3-411c-88ad-1a8c582d79df:/dev/nvme0n1p3 301b8065-0688-4d21-968e-2e0aeda12471:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 14 19:51:44.532578 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.532533    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 19:51:44.539437 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.539411    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 19:51:44.540066 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.539581    2584 manager.go:216] Machine: {Timestamp:2026-07-14 19:51:44.538278346 +0000 UTC m=+0.311971660 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103667 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c51a167d2af9b23d4806b8aa6a026 SystemUUID:ec2c51a1-67d2-af9b-23d4-806b8aa6a026 BootID:48a4c7f8-d367-491a-b181-e9f06ae889d3 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:90:0a:dd:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:90:0a:dd:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:55:e9:00:92:97 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 19:51:44.540143 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.540068    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 19:51:44.540207 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.540180    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 19:51:44.543454 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.543426    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 19:51:44.543590 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.543456    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-56.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 19:51:44.544443 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.544432    2584 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 19:51:44.544480 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.544445    2584 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 19:51:44.544480 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.544459    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 19:51:44.545021 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.545011    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 19:51:44.546870 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.546854    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 19:51:44.550194 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.550181    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 19:51:44.550330 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.550320    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 19:51:44.550371 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.550350    2584 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 19:51:44.550371 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.550360    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 19:51:44.550438 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.550373    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 19:51:44.550438 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.550385    2584 kubelet.go:398] "Adding apiserver pod source"
Jul 14 19:51:44.550438 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.550393    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 19:51:44.550826 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.550814    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 19:51:44.550885 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.550840    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 19:51:44.554698 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.554676    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 19:51:44.557023 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557004    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 19:51:44.557083 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557044    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 19:51:44.557242 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557231    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 19:51:44.557274 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557264    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 19:51:44.557300 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557275    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 19:51:44.557300 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557283    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 19:51:44.557300 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557294    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 19:51:44.557300 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557300    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 19:51:44.557642 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557634    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 19:51:44.557671 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557643    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 19:51:44.557671 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557650    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 19:51:44.557671 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557655    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 19:51:44.557671 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557664    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 19:51:44.557671 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.557672    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 19:51:44.558556 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.558546    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 19:51:44.558556 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.558555    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 19:51:44.560909 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.560890    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-56.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 19:51:44.561139 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.561119    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 19:51:44.561212 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.561190    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-56.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 19:51:44.561914 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.561903    2584 server.go:1268] "Started kubelet"
Jul 14 19:51:44.562020 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.561993    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 19:51:44.562090 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.562034    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 19:51:44.562133 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.562121    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 19:51:44.563049 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.563018    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gcs2c"
Jul 14 19:51:44.563417 ip-10-0-142-56 systemd[1]: Started Kubernetes Kubelet.
Jul 14 19:51:44.563697 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.563680    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 19:51:44.564460 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.564445    2584 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 19:51:44.566802 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.566784    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 19:51:44.569936 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.569017    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-56.ec2.internal.18c23ff07fdaa894  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-56.ec2.internal,UID:ip-10-0-142-56.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-56.ec2.internal,},FirstTimestamp:2026-07-14 19:51:44.561875092 +0000 UTC m=+0.335568406,LastTimestamp:2026-07-14 19:51:44.561875092 +0000 UTC m=+0.335568406,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-56.ec2.internal,}"
Jul 14 19:51:44.571250 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.571232    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 19:51:44.571301 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.571248    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 19:51:44.571676 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.571632    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:44.571979 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.571921    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 19:51:44.571979 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.571896    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 19:51:44.571979 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.571976    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 19:51:44.572124 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.572118    2584 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 19:51:44.572218 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.572128    2584 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 19:51:44.572218 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.572163    2584 factory.go:55] Registering systemd factory
Jul 14 19:51:44.572218 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.572180    2584 factory.go:223] Registration of the systemd container factory successfully
Jul 14 19:51:44.572218 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.572189    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gcs2c"
Jul 14 19:51:44.572793 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.572776    2584 factory.go:153] Registering CRI-O factory
Jul 14 19:51:44.572872 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.572797    2584 factory.go:223] Registration of the crio container factory successfully
Jul 14 19:51:44.572921 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.572864    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 19:51:44.572921 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.572898    2584 factory.go:103] Registering Raw factory
Jul 14 19:51:44.572921 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.572913    2584 manager.go:1196] Started watching for new ooms in manager
Jul 14 19:51:44.573277 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.573246    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-56.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 19:51:44.573451 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.573424    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 19:51:44.573539 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.573529    2584 manager.go:349] Starting recovery of all containers
Jul 14 19:51:44.585516 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.585354    2584 manager.go:354] Recovery completed
Jul 14 19:51:44.590354 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.590325    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:44.592848 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.592829    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:44.592936 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.592863    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:44.592936 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.592876    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:44.593499 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.593481    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 19:51:44.593499 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.593498    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 19:51:44.593598 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.593516    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 19:51:44.593598 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.593483    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:44.594246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.594232    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:44.594294 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.594257    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:44.594294 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.594271    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:44.594743 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.594730    2584 policy_none.go:49] "None policy: Start"
Jul 14 19:51:44.594785 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.594747    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 19:51:44.594785 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.594756    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 19:51:44.595770 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.595760    2584 policy_none.go:47] "Start"
Jul 14 19:51:44.635767 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.635740    2584 manager.go:337] "Starting Device Plugin manager"
Jul 14 19:51:44.635886 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.635777    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 19:51:44.635886 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.635787    2584 server.go:87] "Starting device plugin registration server"
Jul 14 19:51:44.636061 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.636049    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 19:51:44.636119 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.636071    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 19:51:44.636200 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.636176    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 19:51:44.636266 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.636254    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 19:51:44.636266 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.636266    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 19:51:44.636859 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.636836    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 19:51:44.636945 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.636888    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:44.711856 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.711807    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 19:51:44.713433 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.713412    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 19:51:44.713535 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.713452    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 19:51:44.713535 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.713478    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 19:51:44.713535 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.713523    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 19:51:44.716127 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.716105    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:44.737003 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.736955    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:44.738672 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.738651    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:44.738755 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.738687    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:44.738755 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.738699    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:44.738755 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.738721    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.746841 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.746824    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.746885 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.746847    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-56.ec2.internal\": node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:44.760901 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.760879    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:44.814310 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.814268    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"]
Jul 14 19:51:44.814417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.814353    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:44.816009 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.815993    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:44.816084 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.816028    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:44.816084 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.816038    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:44.817396 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.817384    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:44.817506 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.817491    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.817550 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.817520    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:44.818104 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.818089    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:44.818195 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.818113    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:44.818195 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.818126    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:44.818195 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.818138    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:44.818195 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.818180    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:44.818195 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.818193    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:44.819183 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.819141    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.819183 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.819185    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:51:44.819829 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.819813    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:51:44.819904 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.819840    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:51:44.819904 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.819852    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:51:44.836709 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.836689    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-56.ec2.internal\" not found" node="ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.840694 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.840675    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-56.ec2.internal\" not found" node="ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.861794 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.861764    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:44.873508 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.873477    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f5c3c9fa324c8535ea8803ceb4a7bd1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-56.ec2.internal\" (UID: \"3f5c3c9fa324c8535ea8803ceb4a7bd1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.873508 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.873510    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b17f62fd4afef7bce9af608b5d372c79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"b17f62fd4afef7bce9af608b5d372c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.873678 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.873542    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17f62fd4afef7bce9af608b5d372c79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"b17f62fd4afef7bce9af608b5d372c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.962824 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:44.962797    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:44.974464 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.974438    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f5c3c9fa324c8535ea8803ceb4a7bd1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-56.ec2.internal\" (UID: \"3f5c3c9fa324c8535ea8803ceb4a7bd1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.974531 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.974470    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b17f62fd4afef7bce9af608b5d372c79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"b17f62fd4afef7bce9af608b5d372c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.974531 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.974485    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17f62fd4afef7bce9af608b5d372c79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"b17f62fd4afef7bce9af608b5d372c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.974614 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.974541    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f5c3c9fa324c8535ea8803ceb4a7bd1-config\") pod \"kube-apiserver-proxy-ip-10-0-142-56.ec2.internal\" (UID: \"3f5c3c9fa324c8535ea8803ceb4a7bd1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.974614 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.974566    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b17f62fd4afef7bce9af608b5d372c79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"b17f62fd4afef7bce9af608b5d372c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:44.974686 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:44.974625    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b17f62fd4afef7bce9af608b5d372c79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal\" (UID: \"b17f62fd4afef7bce9af608b5d372c79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:45.063171 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:45.063079    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:45.139623 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:45.139582    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:45.144406 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:45.143958    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:45.164022 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:45.163995    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:46.904254 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:46.904214    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:47.004832 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:47.004751    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:47.105421 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:47.105391    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:47.110661 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.110640    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:47.147480 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.147439    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 19:51:47.148036 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.147647    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 19:51:47.148036 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.147656    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 19:51:47.205881 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:47.205850    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:47.215991 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.215942    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 19:46:46 +0000 UTC" deadline="2028-03-02 11:01:47.069744713 +0000 UTC"
Jul 14 19:51:47.216078 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.215999    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14319h9m59.853763955s"
Jul 14 19:51:47.306380 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:47.306289    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:47.406851 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:47.406809    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-56.ec2.internal\" not found"
Jul 14 19:51:47.442030 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.442001    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:47.506143 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:47.506109    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17f62fd4afef7bce9af608b5d372c79.slice/crio-8ae4a63d414815dca801b8021f69dd4274c1898806300ed4e62306fb8479e927 WatchSource:0}: Error finding container 8ae4a63d414815dca801b8021f69dd4274c1898806300ed4e62306fb8479e927: Status 404 returned error can't find the container with id 8ae4a63d414815dca801b8021f69dd4274c1898806300ed4e62306fb8479e927
Jul 14 19:51:47.510294 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.510276    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:51:47.512384 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.512369    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:47.535551 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.535523    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 19:51:47.536610 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.536596    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"
Jul 14 19:51:47.548042 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.548019    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 19:51:47.624832 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:47.624754    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:47.682783 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:47.682751    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5c3c9fa324c8535ea8803ceb4a7bd1.slice/crio-be452742f7dc6d6815bac2d182d00924fee68a7a0b3be69b5afadd6b196be715 WatchSource:0}: Error finding container be452742f7dc6d6815bac2d182d00924fee68a7a0b3be69b5afadd6b196be715: Status 404 returned error can't find the container with id be452742f7dc6d6815bac2d182d00924fee68a7a0b3be69b5afadd6b196be715
Jul 14 19:51:48.191295 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.191258    2584 apiserver.go:52] "Watching apiserver"
Jul 14 19:51:48.201780 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.201751    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 19:51:48.202681 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.202652    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk","openshift-cluster-node-tuning-operator/tuned-xzfx6","openshift-dns/node-resolver-mhgfv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal","openshift-multus/multus-m228l","openshift-network-operator/iptables-alerter-b4trt","kube-system/konnectivity-agent-248mb","openshift-image-registry/node-ca-5pd6v","openshift-multus/multus-additional-cni-plugins-nqbkl","openshift-multus/network-metrics-daemon-2ksr7","openshift-network-diagnostics/network-check-target-v4k6s","openshift-ovn-kubernetes/ovnkube-node-nzhmm","kube-system/global-pull-secret-syncer-2zwms","kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal"]
Jul 14 19:51:48.204740 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.204718    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:48.204849 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.204807    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:51:48.206321 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.206291    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:48.206419 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.206394    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:51:48.207578 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.207559    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mhgfv"
Jul 14 19:51:48.209001 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.208723    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5pd6v"
Jul 14 19:51:48.209853 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.209830    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.210942 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.210926    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8bk8j\""
Jul 14 19:51:48.211152 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.211139    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 19:51:48.211307 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.211293    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 19:51:48.211677 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.211663    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b4trt"
Jul 14 19:51:48.212188 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.212150    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 19:51:48.214559 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.214543    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.215251 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.215220    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-flzlz\""
Jul 14 19:51:48.215323 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.215308    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 19:51:48.215535 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.215495    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-84864\""
Jul 14 19:51:48.215535 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.215519    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 19:51:48.215644 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.215608    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 19:51:48.215693 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.215231    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 19:51:48.215741 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.215716    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 19:51:48.215906 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.215886    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:51:48.215975 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.215941    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 19:51:48.216045 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.215891    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d7cqw\""
Jul 14 19:51:48.216094 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.216056    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 19:51:48.216142 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.216097    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 19:51:48.216198 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.216135    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 19:51:48.217133 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.217115    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:51:48.217791 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.217773    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 19:51:48.217861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.217792    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z8cng\""
Jul 14 19:51:48.218714 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.218581    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.219188 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.219174    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 19:51:48.219799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.219778    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.221281 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.221261    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:48.221367 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.221321    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:51:48.223582 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223557    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqmnd\" (UniqueName: \"kubernetes.io/projected/c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba-kube-api-access-gqmnd\") pod \"iptables-alerter-b4trt\" (UID: \"c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba\") " pod="openshift-network-operator/iptables-alerter-b4trt"
Jul 14 19:51:48.223675 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223612    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-cnibin\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.223675 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223642    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63c3ab45-2ab8-47ba-9445-8aff47b1c703-dbus\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:48.223675 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223666    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-multus-socket-dir-parent\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.223804 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223689    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-run-k8s-cni-cncf-io\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.223804 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223715    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-system-cni-dir\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.223804 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223737    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkclh\" (UniqueName: \"kubernetes.io/projected/8f6bd874-6e12-4be3-a48c-995f066603b9-kube-api-access-lkclh\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.223804 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223761    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:48.223804 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223796    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24q9g\" (UniqueName: \"kubernetes.io/projected/8c0fca7e-9658-43b2-8208-4edce8612b34-kube-api-access-24q9g\") pod \"node-ca-5pd6v\" (UID: \"8c0fca7e-9658-43b2-8208-4edce8612b34\") " pod="openshift-image-registry/node-ca-5pd6v"
Jul 14 19:51:48.224048 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vzhx\" (UniqueName: \"kubernetes.io/projected/29243480-09bb-4c97-9d5a-4a2d4623c3a9-kube-api-access-2vzhx\") pod \"node-resolver-mhgfv\" (UID: \"29243480-09bb-4c97-9d5a-4a2d4623c3a9\") " pod="openshift-dns/node-resolver-mhgfv"
Jul 14 19:51:48.224048 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223841    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba-iptables-alerter-script\") pod \"iptables-alerter-b4trt\" (UID: \"c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba\") " pod="openshift-network-operator/iptables-alerter-b4trt"
Jul 14 19:51:48.224048 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223862    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba-host-slash\") pod \"iptables-alerter-b4trt\" (UID: \"c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba\") " pod="openshift-network-operator/iptables-alerter-b4trt"
Jul 14 19:51:48.224048 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223921    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-os-release\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.224048 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223945    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgclw\" (UniqueName: \"kubernetes.io/projected/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-kube-api-access-qgclw\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:48.224048 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.223976    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c0fca7e-9658-43b2-8208-4edce8612b34-serviceca\") pod \"node-ca-5pd6v\" (UID: \"8c0fca7e-9658-43b2-8208-4edce8612b34\") " pod="openshift-image-registry/node-ca-5pd6v"
Jul 14 19:51:48.224048 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224002    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-system-cni-dir\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.224048 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224024    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-os-release\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224050    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f6bd874-6e12-4be3-a48c-995f066603b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224080    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63c3ab45-2ab8-47ba-9445-8aff47b1c703-kubelet-config\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224103    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-cnibin\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-var-lib-cni-multus\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224155    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-multus-conf-dir\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224194    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-run-multus-certs\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224216    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-etc-kubernetes\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224238    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzp5s\" (UniqueName: \"kubernetes.io/projected/13695271-c6a3-444d-87e1-9fa550bb100d-kube-api-access-wzp5s\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224261    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29243480-09bb-4c97-9d5a-4a2d4623c3a9-hosts-file\") pod \"node-resolver-mhgfv\" (UID: \"29243480-09bb-4c97-9d5a-4a2d4623c3a9\") " pod="openshift-dns/node-resolver-mhgfv"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224297    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-var-lib-kubelet\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224317    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29243480-09bb-4c97-9d5a-4a2d4623c3a9-tmp-dir\") pod \"node-resolver-mhgfv\" (UID: \"29243480-09bb-4c97-9d5a-4a2d4623c3a9\") " pod="openshift-dns/node-resolver-mhgfv"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224338    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:48.224409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c0fca7e-9658-43b2-8208-4edce8612b34-host\") pod \"node-ca-5pd6v\" (UID: \"8c0fca7e-9658-43b2-8208-4edce8612b34\") " pod="openshift-image-registry/node-ca-5pd6v"
Jul 14 19:51:48.225019 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224415    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-hostroot\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.225019 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224438    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13695271-c6a3-444d-87e1-9fa550bb100d-multus-daemon-config\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.225019 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224462    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.225019 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224485    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f6bd874-6e12-4be3-a48c-995f066603b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.225019 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224510    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13695271-c6a3-444d-87e1-9fa550bb100d-cni-binary-copy\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.225019 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224550    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-run-netns\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.225019 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224572    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f6bd874-6e12-4be3-a48c-995f066603b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.225019 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224597    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-multus-cni-dir\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.225019 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.224622    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-var-lib-cni-bin\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.225396 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.225213    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 19:51:48.225396 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.225247    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gkdmp\""
Jul 14 19:51:48.225594 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.225480    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 19:51:48.225594 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.225543    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f7m2c\""
Jul 14 19:51:48.225676 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.225662    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-58ltv\""
Jul 14 19:51:48.226258 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.226241    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 19:51:48.226434 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.226420    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 19:51:48.226496 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.226443    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.226496 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.226449    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:51:48.226586 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.226534    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 19:51:48.226726 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.226707    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 19:51:48.228968 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.228916    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 19:51:48.229170 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.229151    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 19:51:48.229282 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.229259    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 19:51:48.230124 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.230098    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 19:51:48.230206 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.230105    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bd22j\""
Jul 14 19:51:48.230346 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.230328    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 19:51:48.230917 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.230852    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 19:51:48.232394 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.232375    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 19:51:48.249630 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.249607    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-crngd"
Jul 14 19:51:48.259274 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.259254    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-crngd"
Jul 14 19:51:48.312719 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.312693    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 19:51:48.325452 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325421    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-cnibin\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.325635 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325462    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-run\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.325635 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325489    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfp6k\" (UniqueName: \"kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k\") pod \"network-check-target-v4k6s\" (UID: \"a7d23547-a538-48b0-951f-ae616a9573af\") " pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:48.325635 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325511    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.325635 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325537    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-device-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.325635 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-system-cni-dir\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.325635 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325584    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:48.325635 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325606    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjfzw\" (UniqueName: \"kubernetes.io/projected/a8150b5c-3142-4df8-a362-7a04a41d2ec0-kube-api-access-rjfzw\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.325635 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325630    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-log-socket\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325654    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-cni-netd\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325681    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vzhx\" (UniqueName: \"kubernetes.io/projected/29243480-09bb-4c97-9d5a-4a2d4623c3a9-kube-api-access-2vzhx\") pod \"node-resolver-mhgfv\" (UID: \"29243480-09bb-4c97-9d5a-4a2d4623c3a9\") " pod="openshift-dns/node-resolver-mhgfv"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325708    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba-iptables-alerter-script\") pod \"iptables-alerter-b4trt\" (UID: \"c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba\") " pod="openshift-network-operator/iptables-alerter-b4trt"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325733    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgclw\" (UniqueName: \"kubernetes.io/projected/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-kube-api-access-qgclw\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325751    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-system-cni-dir\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325757    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-system-cni-dir\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325802    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-run-multus-certs\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325819    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-system-cni-dir\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325822    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-sys\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325853    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-cnibin\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325883    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-etc-openvswitch\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325914    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-cnibin\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.325974    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-run-multus-certs\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326006    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-etc-kubernetes\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326032    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-lib-modules\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.326035    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:48.328564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326056    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d52b149-467b-48ce-b1eb-d1f3933d3931-ovnkube-config\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.326104    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret podName:63c3ab45-2ab8-47ba-9445-8aff47b1c703 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:48.826081504 +0000 UTC m=+2.960057564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret") pod "global-pull-secret-syncer-2zwms" (UID: "63c3ab45-2ab8-47ba-9445-8aff47b1c703") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326160    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-cnibin\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326243    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29243480-09bb-4c97-9d5a-4a2d4623c3a9-hosts-file\") pod \"node-resolver-mhgfv\" (UID: \"29243480-09bb-4c97-9d5a-4a2d4623c3a9\") " pod="openshift-dns/node-resolver-mhgfv"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326275    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-sysconfig\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326321    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8150b5c-3142-4df8-a362-7a04a41d2ec0-tmp\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326331    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29243480-09bb-4c97-9d5a-4a2d4623c3a9-hosts-file\") pod \"node-resolver-mhgfv\" (UID: \"29243480-09bb-4c97-9d5a-4a2d4623c3a9\") " pod="openshift-dns/node-resolver-mhgfv"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326345    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29243480-09bb-4c97-9d5a-4a2d4623c3a9-tmp-dir\") pod \"node-resolver-mhgfv\" (UID: \"29243480-09bb-4c97-9d5a-4a2d4623c3a9\") " pod="openshift-dns/node-resolver-mhgfv"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326369    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326381    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-etc-kubernetes\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326417    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c0fca7e-9658-43b2-8208-4edce8612b34-host\") pod \"node-ca-5pd6v\" (UID: \"8c0fca7e-9658-43b2-8208-4edce8612b34\") " pod="openshift-image-registry/node-ca-5pd6v"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-hostroot\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.326454    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c0fca7e-9658-43b2-8208-4edce8612b34-host\") pod \"node-ca-5pd6v\" (UID: \"8c0fca7e-9658-43b2-8208-4edce8612b34\") " pod="openshift-image-registry/node-ca-5pd6v"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326490    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13695271-c6a3-444d-87e1-9fa550bb100d-multus-daemon-config\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.326501    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs podName:05bbb5d7-bb7c-407f-aca1-7dab01b15aa6 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:48.826485657 +0000 UTC m=+2.960461717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs") pod "network-metrics-daemon-2ksr7" (UID: "05bbb5d7-bb7c-407f-aca1-7dab01b15aa6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326534    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbs4w\" (UniqueName: \"kubernetes.io/projected/5d52b149-467b-48ce-b1eb-d1f3933d3931-kube-api-access-bbs4w\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.329276 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326557    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-hostroot\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326562    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326599    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326627    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f6bd874-6e12-4be3-a48c-995f066603b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326669    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13695271-c6a3-444d-87e1-9fa550bb100d-cni-binary-copy\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326682    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba-iptables-alerter-script\") pod \"iptables-alerter-b4trt\" (UID: \"c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba\") " pod="openshift-network-operator/iptables-alerter-b4trt"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326692    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-kubernetes\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326719    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-var-lib-openvswitch\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326753    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29243480-09bb-4c97-9d5a-4a2d4623c3a9-tmp-dir\") pod \"node-resolver-mhgfv\" (UID: \"29243480-09bb-4c97-9d5a-4a2d4623c3a9\") " pod="openshift-dns/node-resolver-mhgfv"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326823    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-run-ovn-kubernetes\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326855    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f6bd874-6e12-4be3-a48c-995f066603b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326904    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-multus-cni-dir\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326929    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-systemd\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.326953    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-run-netns\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327018    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d52b149-467b-48ce-b1eb-d1f3933d3931-ovn-node-metrics-cert\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqmnd\" (UniqueName: \"kubernetes.io/projected/c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba-kube-api-access-gqmnd\") pod \"iptables-alerter-b4trt\" (UID: \"c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba\") " pod="openshift-network-operator/iptables-alerter-b4trt"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327072    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63c3ab45-2ab8-47ba-9445-8aff47b1c703-dbus\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:48.329810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327094    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-multus-socket-dir-parent\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327120    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-run-k8s-cni-cncf-io\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327145    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d52b149-467b-48ce-b1eb-d1f3933d3931-env-overrides\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327172    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327181    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13695271-c6a3-444d-87e1-9fa550bb100d-multus-daemon-config\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkclh\" (UniqueName: \"kubernetes.io/projected/8f6bd874-6e12-4be3-a48c-995f066603b9-kube-api-access-lkclh\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327256    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24q9g\" (UniqueName: \"kubernetes.io/projected/8c0fca7e-9658-43b2-8208-4edce8612b34-kube-api-access-24q9g\") pod \"node-ca-5pd6v\" (UID: \"8c0fca7e-9658-43b2-8208-4edce8612b34\") " pod="openshift-image-registry/node-ca-5pd6v"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327261    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f6bd874-6e12-4be3-a48c-995f066603b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327280    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-sysctl-conf\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327298    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13695271-c6a3-444d-87e1-9fa550bb100d-cni-binary-copy\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327320    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-run-k8s-cni-cncf-io\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327369    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-multus-socket-dir-parent\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327393    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-systemd-units\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327419    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa216295-dac1-426e-b86e-3f5245643aa5-konnectivity-ca\") pod \"konnectivity-agent-248mb\" (UID: \"aa216295-dac1-426e-b86e-3f5245643aa5\") " pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327444    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-registration-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327480    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327489    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba-host-slash\") pod \"iptables-alerter-b4trt\" (UID: \"c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba\") " pod="openshift-network-operator/iptables-alerter-b4trt"
Jul 14 19:51:48.330417 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327515    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-os-release\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327569    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba-host-slash\") pod \"iptables-alerter-b4trt\" (UID: \"c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba\") " pod="openshift-network-operator/iptables-alerter-b4trt"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327586    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f6bd874-6e12-4be3-a48c-995f066603b9-os-release\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327606    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c0fca7e-9658-43b2-8208-4edce8612b34-serviceca\") pod \"node-ca-5pd6v\" (UID: \"8c0fca7e-9658-43b2-8208-4edce8612b34\") " pod="openshift-image-registry/node-ca-5pd6v"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327634    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f6bd874-6e12-4be3-a48c-995f066603b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327632    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-os-release\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327650    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-multus-cni-dir\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327680    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-var-lib-cni-multus\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327719    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-var-lib-cni-multus\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327732    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-os-release\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327755    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-host\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327776    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-tuned\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327777    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63c3ab45-2ab8-47ba-9445-8aff47b1c703-dbus\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327798    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-slash\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327818    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f6bd874-6e12-4be3-a48c-995f066603b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63c3ab45-2ab8-47ba-9445-8aff47b1c703-kubelet-config\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327923    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-multus-conf-dir\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327948    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzp5s\" (UniqueName: \"kubernetes.io/projected/13695271-c6a3-444d-87e1-9fa550bb100d-kube-api-access-wzp5s\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.331107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.327998    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63c3ab45-2ab8-47ba-9445-8aff47b1c703-kubelet-config\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328022    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-modprobe-d\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328038    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-node-log\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328057    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c0fca7e-9658-43b2-8208-4edce8612b34-serviceca\") pod \"node-ca-5pd6v\" (UID: \"8c0fca7e-9658-43b2-8208-4edce8612b34\") " pod="openshift-image-registry/node-ca-5pd6v"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328062    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa216295-dac1-426e-b86e-3f5245643aa5-agent-certs\") pod \"konnectivity-agent-248mb\" (UID: \"aa216295-dac1-426e-b86e-3f5245643aa5\") " pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328086    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-socket-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328112    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-var-lib-kubelet\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328136    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-sysctl-d\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328143    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-multus-conf-dir\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328181    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-var-lib-kubelet\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328178    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-var-lib-kubelet\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328221    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-kubelet\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328225    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f6bd874-6e12-4be3-a48c-995f066603b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328252    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-run-systemd\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328302    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d52b149-467b-48ce-b1eb-d1f3933d3931-ovnkube-script-lib\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-sys-fs\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n87ct\" (UniqueName: \"kubernetes.io/projected/d9a7475c-a219-436b-9443-9f727de7fe1b-kube-api-access-n87ct\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.331720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328396    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-run-openvswitch\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.332253 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328431    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-run-netns\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.332253 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328476    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-run-ovn\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.332253 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328513    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-var-lib-cni-bin\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.332253 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328553    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-run-netns\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.332253 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328587    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-cni-bin\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.332253 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.328603    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13695271-c6a3-444d-87e1-9fa550bb100d-host-var-lib-cni-bin\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.339347 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.339317    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 19:51:48.343280 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.343255    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vzhx\" (UniqueName: \"kubernetes.io/projected/29243480-09bb-4c97-9d5a-4a2d4623c3a9-kube-api-access-2vzhx\") pod \"node-resolver-mhgfv\" (UID: \"29243480-09bb-4c97-9d5a-4a2d4623c3a9\") " pod="openshift-dns/node-resolver-mhgfv"
Jul 14 19:51:48.344312 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.344279    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzp5s\" (UniqueName: \"kubernetes.io/projected/13695271-c6a3-444d-87e1-9fa550bb100d-kube-api-access-wzp5s\") pod \"multus-m228l\" (UID: \"13695271-c6a3-444d-87e1-9fa550bb100d\") " pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.345347 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.345323    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqmnd\" (UniqueName: \"kubernetes.io/projected/c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba-kube-api-access-gqmnd\") pod \"iptables-alerter-b4trt\" (UID: \"c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba\") " pod="openshift-network-operator/iptables-alerter-b4trt"
Jul 14 19:51:48.346180 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.346156    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkclh\" (UniqueName: \"kubernetes.io/projected/8f6bd874-6e12-4be3-a48c-995f066603b9-kube-api-access-lkclh\") pod \"multus-additional-cni-plugins-nqbkl\" (UID: \"8f6bd874-6e12-4be3-a48c-995f066603b9\") " pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.347566 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.347536    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgclw\" (UniqueName: \"kubernetes.io/projected/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-kube-api-access-qgclw\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:48.347807 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.347785    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24q9g\" (UniqueName: \"kubernetes.io/projected/8c0fca7e-9658-43b2-8208-4edce8612b34-kube-api-access-24q9g\") pod \"node-ca-5pd6v\" (UID: \"8c0fca7e-9658-43b2-8208-4edce8612b34\") " pod="openshift-image-registry/node-ca-5pd6v"
Jul 14 19:51:48.359926 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.359855    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal" event={"ID":"3f5c3c9fa324c8535ea8803ceb4a7bd1","Type":"ContainerStarted","Data":"be452742f7dc6d6815bac2d182d00924fee68a7a0b3be69b5afadd6b196be715"}
Jul 14 19:51:48.361712 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.361687    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal" event={"ID":"b17f62fd4afef7bce9af608b5d372c79","Type":"ContainerStarted","Data":"8ae4a63d414815dca801b8021f69dd4274c1898806300ed4e62306fb8479e927"}
Jul 14 19:51:48.429304 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429276    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-run-ovn\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.429465 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429310    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-cni-bin\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.429465 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429336    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-run\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.429465 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429359    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfp6k\" (UniqueName: \"kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k\") pod \"network-check-target-v4k6s\" (UID: \"a7d23547-a538-48b0-951f-ae616a9573af\") " pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:48.429465 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429383    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.429465 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429398    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-cni-bin\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.429465 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429408    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-device-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.429465 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429400    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-run-ovn\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.429465 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429443    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjfzw\" (UniqueName: \"kubernetes.io/projected/a8150b5c-3142-4df8-a362-7a04a41d2ec0-kube-api-access-rjfzw\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429467    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-log-socket\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-cni-netd\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429489    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-run\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429523    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-sys\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429547    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-etc-openvswitch\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429570    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-lib-modules\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429595    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d52b149-467b-48ce-b1eb-d1f3933d3931-ovnkube-config\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429619    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-sysconfig\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429642    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8150b5c-3142-4df8-a362-7a04a41d2ec0-tmp\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429671    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429724    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-log-socket\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429764    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-device-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.429799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429797    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-cni-netd\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429678    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbs4w\" (UniqueName: \"kubernetes.io/projected/5d52b149-467b-48ce-b1eb-d1f3933d3931-kube-api-access-bbs4w\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429889    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429918    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-lib-modules\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429927    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-kubernetes\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429953    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-var-lib-openvswitch\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429964    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-sys\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.429976    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-run-ovn-kubernetes\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430002    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-systemd\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430004    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-etc-openvswitch\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430025    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-run-netns\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430050    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-kubernetes\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430051    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d52b149-467b-48ce-b1eb-d1f3933d3931-ovn-node-metrics-cert\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430097    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d52b149-467b-48ce-b1eb-d1f3933d3931-env-overrides\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430121    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430159    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-sysctl-conf\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430182    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-systemd-units\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.430246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa216295-dac1-426e-b86e-3f5245643aa5-konnectivity-ca\") pod \"konnectivity-agent-248mb\" (UID: \"aa216295-dac1-426e-b86e-3f5245643aa5\") " pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430230    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-registration-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430259    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-host\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430282    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-tuned\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430313    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-slash\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430339    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-modprobe-d\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430362    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-node-log\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430377    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-run-ovn-kubernetes\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430388    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa216295-dac1-426e-b86e-3f5245643aa5-agent-certs\") pod \"konnectivity-agent-248mb\" (UID: \"aa216295-dac1-426e-b86e-3f5245643aa5\") " pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430419    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d52b149-467b-48ce-b1eb-d1f3933d3931-ovnkube-config\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430441    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-socket-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430469    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-sysctl-d\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430482    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-sysconfig\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430493    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-var-lib-kubelet\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430523    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-kubelet\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430547    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-run-systemd\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d52b149-467b-48ce-b1eb-d1f3933d3931-ovnkube-script-lib\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430599    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-sys-fs\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430624    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n87ct\" (UniqueName: \"kubernetes.io/projected/d9a7475c-a219-436b-9443-9f727de7fe1b-kube-api-access-n87ct\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430651    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-run-openvswitch\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430725    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-run-openvswitch\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430768    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-var-lib-openvswitch\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.430890    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-socket-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431007    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-sysctl-d\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-var-lib-kubelet\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431093    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-kubelet\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431127    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-run-systemd\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431163    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa216295-dac1-426e-b86e-3f5245643aa5-konnectivity-ca\") pod \"konnectivity-agent-248mb\" (UID: \"aa216295-dac1-426e-b86e-3f5245643aa5\") " pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431284    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431635    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d52b149-467b-48ce-b1eb-d1f3933d3931-env-overrides\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431713    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-sys-fs\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.431861 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431755    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.432690 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431892    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-sysctl-conf\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.432690 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431911    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-systemd\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.432690 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431639    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d52b149-467b-48ce-b1eb-d1f3933d3931-ovnkube-script-lib\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.432690 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431931    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-systemd-units\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.432690 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.431979    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9a7475c-a219-436b-9443-9f727de7fe1b-registration-dir\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.432690 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.432013    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-host\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.432690 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.432045    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-run-netns\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.432690 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.432120    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-modprobe-d\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.432690 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.432144    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-host-slash\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.432690 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.432176    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d52b149-467b-48ce-b1eb-d1f3933d3931-node-log\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.433629 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.433607    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8150b5c-3142-4df8-a362-7a04a41d2ec0-tmp\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.434427 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.434395    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa216295-dac1-426e-b86e-3f5245643aa5-agent-certs\") pod \"konnectivity-agent-248mb\" (UID: \"aa216295-dac1-426e-b86e-3f5245643aa5\") " pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:51:48.434534 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.434445    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d52b149-467b-48ce-b1eb-d1f3933d3931-ovn-node-metrics-cert\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.434974 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.434951    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a8150b5c-3142-4df8-a362-7a04a41d2ec0-etc-tuned\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.443810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.443735    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjfzw\" (UniqueName: \"kubernetes.io/projected/a8150b5c-3142-4df8-a362-7a04a41d2ec0-kube-api-access-rjfzw\") pod \"tuned-xzfx6\" (UID: \"a8150b5c-3142-4df8-a362-7a04a41d2ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.444268 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.444244    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n87ct\" (UniqueName: \"kubernetes.io/projected/d9a7475c-a219-436b-9443-9f727de7fe1b-kube-api-access-n87ct\") pod \"aws-ebs-csi-driver-node-gw5lk\" (UID: \"d9a7475c-a219-436b-9443-9f727de7fe1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.447737 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.447712    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:48.447835 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.447748    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:48.447835 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.447769    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jfp6k for pod openshift-network-diagnostics/network-check-target-v4k6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:48.447951 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.447841    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k podName:a7d23547-a538-48b0-951f-ae616a9573af nodeName:}" failed. No retries permitted until 2026-07-14 19:51:48.947822563 +0000 UTC m=+3.081798641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jfp6k" (UniqueName: "kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k") pod "network-check-target-v4k6s" (UID: "a7d23547-a538-48b0-951f-ae616a9573af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:48.449207 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.449183    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbs4w\" (UniqueName: \"kubernetes.io/projected/5d52b149-467b-48ce-b1eb-d1f3933d3931-kube-api-access-bbs4w\") pod \"ovnkube-node-nzhmm\" (UID: \"5d52b149-467b-48ce-b1eb-d1f3933d3931\") " pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.521701 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.521658    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mhgfv"
Jul 14 19:51:48.530597 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.530565    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5pd6v"
Jul 14 19:51:48.540107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.540075    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m228l"
Jul 14 19:51:48.549789 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.549760    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b4trt"
Jul 14 19:51:48.558567 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.558545    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nqbkl"
Jul 14 19:51:48.567340 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.567315    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:51:48.576012 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.575988    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xzfx6"
Jul 14 19:51:48.583806 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.583787    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk"
Jul 14 19:51:48.589466 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.589443    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:51:48.644788 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.644763    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:48.834238 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.834166    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:48.834377 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:48.834234    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:48.834377 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.834331    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:48.834448 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.834384    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs podName:05bbb5d7-bb7c-407f-aca1-7dab01b15aa6 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:49.834371032 +0000 UTC m=+3.968347091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs") pod "network-metrics-daemon-2ksr7" (UID: "05bbb5d7-bb7c-407f-aca1-7dab01b15aa6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:48.834448 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.834331    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:48.834525 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:48.834451    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret podName:63c3ab45-2ab8-47ba-9445-8aff47b1c703 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:49.834437412 +0000 UTC m=+3.968413471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret") pod "global-pull-secret-syncer-2zwms" (UID: "63c3ab45-2ab8-47ba-9445-8aff47b1c703") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:49.036754 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:49.036720    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfp6k\" (UniqueName: \"kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k\") pod \"network-check-target-v4k6s\" (UID: \"a7d23547-a538-48b0-951f-ae616a9573af\") " pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:49.036933 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:49.036908    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:49.036933 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:49.036927    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:49.037032 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:49.036940    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jfp6k for pod openshift-network-diagnostics/network-check-target-v4k6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:49.037032 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:49.037000    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k podName:a7d23547-a538-48b0-951f-ae616a9573af nodeName:}" failed. No retries permitted until 2026-07-14 19:51:50.036983246 +0000 UTC m=+4.170959316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfp6k" (UniqueName: "kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k") pod "network-check-target-v4k6s" (UID: "a7d23547-a538-48b0-951f-ae616a9573af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:49.261887 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:49.261835    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 19:46:48 +0000 UTC" deadline="2028-02-11 08:33:39.786847358 +0000 UTC"
Jul 14 19:51:49.261887 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:49.261888    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13836h41m50.524968288s"
Jul 14 19:51:49.353444 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:49.353414    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:49.353618 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:49.353569    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:51:49.518660 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:49.518617    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2cd35ef_b0b1_407f_8ed9_ca633c13f0ba.slice/crio-a26063a5894386539d5b3e5ad5e6fd267e4e52e6e278e92f42b330d8baea5124 WatchSource:0}: Error finding container a26063a5894386539d5b3e5ad5e6fd267e4e52e6e278e92f42b330d8baea5124: Status 404 returned error can't find the container with id a26063a5894386539d5b3e5ad5e6fd267e4e52e6e278e92f42b330d8baea5124
Jul 14 19:51:49.521628 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:49.521546    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa216295_dac1_426e_b86e_3f5245643aa5.slice/crio-16d2bd7eef2e64be488d26f7f64e843b73e3b70f3b4c34a29235ba7b7f11d683 WatchSource:0}: Error finding container 16d2bd7eef2e64be488d26f7f64e843b73e3b70f3b4c34a29235ba7b7f11d683: Status 404 returned error can't find the container with id 16d2bd7eef2e64be488d26f7f64e843b73e3b70f3b4c34a29235ba7b7f11d683
Jul 14 19:51:49.523272 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:49.523190    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0fca7e_9658_43b2_8208_4edce8612b34.slice/crio-a6f13476bd8e855d24a5fbef826678c636df78de1576bc83eae7c967dd11a2d1 WatchSource:0}: Error finding container a6f13476bd8e855d24a5fbef826678c636df78de1576bc83eae7c967dd11a2d1: Status 404 returned error can't find the container with id a6f13476bd8e855d24a5fbef826678c636df78de1576bc83eae7c967dd11a2d1
Jul 14 19:51:49.526063 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:49.526041    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29243480_09bb_4c97_9d5a_4a2d4623c3a9.slice/crio-1c375f75c960e0490a89ee7ad9e2620f4927f7c1f272bcba673c53083bb57158 WatchSource:0}: Error finding container 1c375f75c960e0490a89ee7ad9e2620f4927f7c1f272bcba673c53083bb57158: Status 404 returned error can't find the container with id 1c375f75c960e0490a89ee7ad9e2620f4927f7c1f272bcba673c53083bb57158
Jul 14 19:51:49.527749 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:51:49.527615    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a7475c_a219_436b_9443_9f727de7fe1b.slice/crio-3fee6d6567bddd27702546fe155647301c4e80501405a1dcf293e4392be5b8ed WatchSource:0}: Error finding container 3fee6d6567bddd27702546fe155647301c4e80501405a1dcf293e4392be5b8ed: Status 404 returned error can't find the container with id 3fee6d6567bddd27702546fe155647301c4e80501405a1dcf293e4392be5b8ed
Jul 14 19:51:49.843300 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:49.842980    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:49.843461 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:49.843340    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:49.843461 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:49.843139    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:49.843461 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:49.843429    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret podName:63c3ab45-2ab8-47ba-9445-8aff47b1c703 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:51.843415094 +0000 UTC m=+5.977391151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret") pod "global-pull-secret-syncer-2zwms" (UID: "63c3ab45-2ab8-47ba-9445-8aff47b1c703") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:49.843576 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:49.843489    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:49.843576 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:49.843531    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs podName:05bbb5d7-bb7c-407f-aca1-7dab01b15aa6 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:51.843517028 +0000 UTC m=+5.977493104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs") pod "network-metrics-daemon-2ksr7" (UID: "05bbb5d7-bb7c-407f-aca1-7dab01b15aa6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:50.047394 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.047274    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfp6k\" (UniqueName: \"kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k\") pod \"network-check-target-v4k6s\" (UID: \"a7d23547-a538-48b0-951f-ae616a9573af\") " pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:50.060798 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:50.060012    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:50.060798 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:50.060051    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:50.060798 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:50.060076    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jfp6k for pod openshift-network-diagnostics/network-check-target-v4k6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:50.060798 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:50.060180    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k podName:a7d23547-a538-48b0-951f-ae616a9573af nodeName:}" failed. No retries permitted until 2026-07-14 19:51:52.060127394 +0000 UTC m=+6.194103454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfp6k" (UniqueName: "kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k") pod "network-check-target-v4k6s" (UID: "a7d23547-a538-48b0-951f-ae616a9573af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:50.239608 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.239300    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:51:50.262168 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.262022    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 19:46:48 +0000 UTC" deadline="2028-03-13 07:42:49.163976672 +0000 UTC"
Jul 14 19:51:50.262168 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.262130    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14579h50m58.901898104s"
Jul 14 19:51:50.356632 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.356238    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:50.356632 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:50.356373    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:51:50.356890 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.356781    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:50.356956 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:50.356905    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:51:50.369942 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.369817    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm" event={"ID":"5d52b149-467b-48ce-b1eb-d1f3933d3931","Type":"ContainerStarted","Data":"82234da08ee46b959c7b0b84291d71293e23a3535651af7de26eaf6d11b34a42"}
Jul 14 19:51:50.374109 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.374085    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xzfx6" event={"ID":"a8150b5c-3142-4df8-a362-7a04a41d2ec0","Type":"ContainerStarted","Data":"4d5b88e3969111321c21bde5443d9c4747d5c7f0f4687dac9b0904f9527d731c"}
Jul 14 19:51:50.376150 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.376113    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk" event={"ID":"d9a7475c-a219-436b-9443-9f727de7fe1b","Type":"ContainerStarted","Data":"3fee6d6567bddd27702546fe155647301c4e80501405a1dcf293e4392be5b8ed"}
Jul 14 19:51:50.378557 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.378534    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5pd6v" event={"ID":"8c0fca7e-9658-43b2-8208-4edce8612b34","Type":"ContainerStarted","Data":"a6f13476bd8e855d24a5fbef826678c636df78de1576bc83eae7c967dd11a2d1"}
Jul 14 19:51:50.380382 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.380358    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b4trt" event={"ID":"c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba","Type":"ContainerStarted","Data":"a26063a5894386539d5b3e5ad5e6fd267e4e52e6e278e92f42b330d8baea5124"}
Jul 14 19:51:50.385102 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.385077    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal" event={"ID":"3f5c3c9fa324c8535ea8803ceb4a7bd1","Type":"ContainerStarted","Data":"6ef1dbe44b07b2ed68d72fa2ca2f2ef8bc52fba94d2de6f19a8f91163175aff0"}
Jul 14 19:51:50.388271 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.388245    2584 generic.go:356] "Generic (PLEG): container finished" podID="b17f62fd4afef7bce9af608b5d372c79" containerID="34420fe8c8aadf45b0c3ca60a4adfc30b033e3d454552b1c886c728fb5f520fe" exitCode=0
Jul 14 19:51:50.388371 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.388319    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal" event={"ID":"b17f62fd4afef7bce9af608b5d372c79","Type":"ContainerDied","Data":"34420fe8c8aadf45b0c3ca60a4adfc30b033e3d454552b1c886c728fb5f520fe"}
Jul 14 19:51:50.405468 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.405438    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m228l" event={"ID":"13695271-c6a3-444d-87e1-9fa550bb100d","Type":"ContainerStarted","Data":"64c44cf697e1d3c9c51bcee923a5eb7fceb0443c725e52618deb94986a39f5ae"}
Jul 14 19:51:50.416075 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.415990    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqbkl" event={"ID":"8f6bd874-6e12-4be3-a48c-995f066603b9","Type":"ContainerStarted","Data":"b75ec2d9002cfdf1e718c05da2e4722d437379940deac94ad8ccc4d5eca50abf"}
Jul 14 19:51:50.427655 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.427567    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mhgfv" event={"ID":"29243480-09bb-4c97-9d5a-4a2d4623c3a9","Type":"ContainerStarted","Data":"1c375f75c960e0490a89ee7ad9e2620f4927f7c1f272bcba673c53083bb57158"}
Jul 14 19:51:50.438795 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.438764    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-248mb" event={"ID":"aa216295-dac1-426e-b86e-3f5245643aa5","Type":"ContainerStarted","Data":"16d2bd7eef2e64be488d26f7f64e843b73e3b70f3b4c34a29235ba7b7f11d683"}
Jul 14 19:51:50.441329 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:50.441279    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-56.ec2.internal" podStartSLOduration=3.44126166 podStartE2EDuration="3.44126166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:51:50.414635835 +0000 UTC m=+4.548611916" watchObservedRunningTime="2026-07-14 19:51:50.44126166 +0000 UTC m=+4.575237742"
Jul 14 19:51:51.354034 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:51.353998    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:51.354528 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:51.354150    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:51:51.451380 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:51.450958    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal" event={"ID":"b17f62fd4afef7bce9af608b5d372c79","Type":"ContainerStarted","Data":"df0562e3e88553e8cf712dfd5b0f9bb14a256ee89408ae5fcc53708c192675d4"}
Jul 14 19:51:51.862619 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:51.862580    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:51.862796 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:51.862640    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:51.862796 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:51.862769    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:51.862947 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:51.862831    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs podName:05bbb5d7-bb7c-407f-aca1-7dab01b15aa6 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:55.862811777 +0000 UTC m=+9.996787850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs") pod "network-metrics-daemon-2ksr7" (UID: "05bbb5d7-bb7c-407f-aca1-7dab01b15aa6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:51.863453 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:51.863290    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:51.863453 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:51.863358    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret podName:63c3ab45-2ab8-47ba-9445-8aff47b1c703 nodeName:}" failed. No retries permitted until 2026-07-14 19:51:55.863334503 +0000 UTC m=+9.997310577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret") pod "global-pull-secret-syncer-2zwms" (UID: "63c3ab45-2ab8-47ba-9445-8aff47b1c703") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:52.064983 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:52.064315    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfp6k\" (UniqueName: \"kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k\") pod \"network-check-target-v4k6s\" (UID: \"a7d23547-a538-48b0-951f-ae616a9573af\") " pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:52.064983 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:52.064507    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:52.064983 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:52.064526    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:52.064983 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:52.064538    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jfp6k for pod openshift-network-diagnostics/network-check-target-v4k6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:52.064983 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:52.064589    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k podName:a7d23547-a538-48b0-951f-ae616a9573af nodeName:}" failed. No retries permitted until 2026-07-14 19:51:56.064572574 +0000 UTC m=+10.198548647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfp6k" (UniqueName: "kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k") pod "network-check-target-v4k6s" (UID: "a7d23547-a538-48b0-951f-ae616a9573af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:52.354421 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:52.354016    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:52.354421 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:52.354127    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:51:52.354421 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:52.354213    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:52.354421 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:52.354344    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:51:53.353709 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:53.353676    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:53.353934 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:53.353804    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:51:54.357862 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:54.357785    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:54.358313 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:54.357924    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:51:54.358313 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:54.358307    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:54.358469 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:54.358412    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:51:55.354111 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:55.354074    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:55.354282 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:55.354201    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:51:55.898702 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:55.898645    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:55.899175 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:55.898717    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:55.899175 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:55.898824    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:55.899175 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:55.898850    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:55.899175 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:55.898924    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret podName:63c3ab45-2ab8-47ba-9445-8aff47b1c703 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:03.898902989 +0000 UTC m=+18.032879068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret") pod "global-pull-secret-syncer-2zwms" (UID: "63c3ab45-2ab8-47ba-9445-8aff47b1c703") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:51:55.899175 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:55.898946    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs podName:05bbb5d7-bb7c-407f-aca1-7dab01b15aa6 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:03.898936075 +0000 UTC m=+18.032912134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs") pod "network-metrics-daemon-2ksr7" (UID: "05bbb5d7-bb7c-407f-aca1-7dab01b15aa6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:51:56.101196 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:56.101153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfp6k\" (UniqueName: \"kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k\") pod \"network-check-target-v4k6s\" (UID: \"a7d23547-a538-48b0-951f-ae616a9573af\") " pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:56.101356 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:56.101329    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:51:56.101356 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:56.101349    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:51:56.101356 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:56.101358    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jfp6k for pod openshift-network-diagnostics/network-check-target-v4k6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:56.101520 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:56.101410    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k podName:a7d23547-a538-48b0-951f-ae616a9573af nodeName:}" failed. No retries permitted until 2026-07-14 19:52:04.101391835 +0000 UTC m=+18.235367893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfp6k" (UniqueName: "kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k") pod "network-check-target-v4k6s" (UID: "a7d23547-a538-48b0-951f-ae616a9573af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:51:56.354509 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:56.354473    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:56.354686 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:56.354604    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:51:56.354686 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:56.354641    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:56.354817 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:56.354766    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:51:57.353805 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:57.353765    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:57.354384 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:57.353907    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:51:58.356368 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:58.356328    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:51:58.356829 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:58.356484    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:51:58.356908 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:58.356895    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:51:58.357025 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:58.357000    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:51:59.354314 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:51:59.353851    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:51:59.354314 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:51:59.353983    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:00.354052 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:00.354014    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:00.354530 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:00.354167    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:00.354530 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:00.354228    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:00.354530 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:00.354360    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:01.353537 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:01.353499    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:01.353694 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:01.353632    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:02.353820 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:02.353779    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:02.353820 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:02.353811    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:02.354361 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:02.353937    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:02.354361 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:02.354048    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:03.354356 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:03.354321    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:03.354821 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:03.354445    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:03.961434 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:03.961396    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:03.961647 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:03.961467    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:03.961647 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:03.961576    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:52:03.961647 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:03.961580    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:52:03.961647 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:03.961630    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret podName:63c3ab45-2ab8-47ba-9445-8aff47b1c703 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:19.961616175 +0000 UTC m=+34.095592235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret") pod "global-pull-secret-syncer-2zwms" (UID: "63c3ab45-2ab8-47ba-9445-8aff47b1c703") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:52:03.961647 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:03.961644    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs podName:05bbb5d7-bb7c-407f-aca1-7dab01b15aa6 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:19.961637067 +0000 UTC m=+34.095613124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs") pod "network-metrics-daemon-2ksr7" (UID: "05bbb5d7-bb7c-407f-aca1-7dab01b15aa6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:52:04.163271 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:04.163234    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfp6k\" (UniqueName: \"kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k\") pod \"network-check-target-v4k6s\" (UID: \"a7d23547-a538-48b0-951f-ae616a9573af\") " pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:04.163468 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:04.163423    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:52:04.163468 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:04.163446    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:52:04.163468 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:04.163455    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jfp6k for pod openshift-network-diagnostics/network-check-target-v4k6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:52:04.163630 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:04.163507    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k podName:a7d23547-a538-48b0-951f-ae616a9573af nodeName:}" failed. No retries permitted until 2026-07-14 19:52:20.163493589 +0000 UTC m=+34.297469647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfp6k" (UniqueName: "kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k") pod "network-check-target-v4k6s" (UID: "a7d23547-a538-48b0-951f-ae616a9573af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:52:04.356957 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:04.356879    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:04.357385 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:04.356887    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:04.357385 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:04.357005    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:04.357385 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:04.357090    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:05.353652 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:05.353619    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:05.353831 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:05.353736    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:06.357127 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:06.357096    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:06.357506 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:06.357230    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:06.357506 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:06.357273    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:06.357506 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:06.357377    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:07.353773 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:07.353741    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:07.353948 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:07.353841    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:08.354030 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.353999    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:08.354447 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.354018    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:08.354447 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:08.354160    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:08.354447 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:08.354250    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:08.486487 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.486160    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xzfx6" event={"ID":"a8150b5c-3142-4df8-a362-7a04a41d2ec0","Type":"ContainerStarted","Data":"420df8d20aaf9c615aac48f21812839fcd785d02a32bce1c0db9e89a7a97c35c"}
Jul 14 19:52:08.487900 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.487846    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5pd6v" event={"ID":"8c0fca7e-9658-43b2-8208-4edce8612b34","Type":"ContainerStarted","Data":"c60e07493dc77125b2db8699a549b74a56e93bfa93ed1fe370ecd10e9ed5781f"}
Jul 14 19:52:08.489466 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.489362    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m228l" event={"ID":"13695271-c6a3-444d-87e1-9fa550bb100d","Type":"ContainerStarted","Data":"fa169ea46a553ecb88907b9b281aa47ea9b8b388daa8ff566800f7a7cc1f3d7e"}
Jul 14 19:52:08.491131 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.491110    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqbkl" event={"ID":"8f6bd874-6e12-4be3-a48c-995f066603b9","Type":"ContainerStarted","Data":"a7cf6c490dec16ba8f8add595878c49486a2c477e7123f4ea8b0f7a1367dbad9"}
Jul 14 19:52:08.492625 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.492446    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mhgfv" event={"ID":"29243480-09bb-4c97-9d5a-4a2d4623c3a9","Type":"ContainerStarted","Data":"3afff56d0d21bbecc0acde70a389aa510a1f81167811336e54744c55dd1011a6"}
Jul 14 19:52:08.497218 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.496564    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-248mb" event={"ID":"aa216295-dac1-426e-b86e-3f5245643aa5","Type":"ContainerStarted","Data":"0044b76000a4fece0dfa86ffaa0045069fe27ae9cab1b9c7492f4216c83dfb02"}
Jul 14 19:52:08.508410 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.508354    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xzfx6" podStartSLOduration=3.781401147 podStartE2EDuration="22.508334572s" totalImagesPullingTime="18.726933425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:08.507417245 +0000 UTC m=+22.641393325" watchObservedRunningTime="2026-07-14 19:52:08.508334572 +0000 UTC m=+22.642310653"
Jul 14 19:52:08.508582 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.508555    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-56.ec2.internal" podStartSLOduration=21.508544441 podStartE2EDuration="21.508544441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:51:51.477519378 +0000 UTC m=+5.611495460" watchObservedRunningTime="2026-07-14 19:52:08.508544441 +0000 UTC m=+22.642520522"
Jul 14 19:52:08.550504 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.550454    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-248mb" podStartSLOduration=12.787458486 podStartE2EDuration="22.550432798s" totalImagesPullingTime="9.762974312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:08.549810472 +0000 UTC m=+22.683786552" watchObservedRunningTime="2026-07-14 19:52:08.550432798 +0000 UTC m=+22.684408882"
Jul 14 19:52:08.584683 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.584641    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mhgfv" podStartSLOduration=3.956808399 podStartE2EDuration="22.584625972s" totalImagesPullingTime="18.627817573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:08.565577078 +0000 UTC m=+22.699553158" watchObservedRunningTime="2026-07-14 19:52:08.584625972 +0000 UTC m=+22.718602052"
Jul 14 19:52:08.584805 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.584743    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m228l" podStartSLOduration=3.854523383 podStartE2EDuration="22.584737682s" totalImagesPullingTime="18.730214299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:08.584227997 +0000 UTC m=+22.718204100" watchObservedRunningTime="2026-07-14 19:52:08.584737682 +0000 UTC m=+22.718713787"
Jul 14 19:52:08.735436 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.735400    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:08.810840 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:08.810695    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:09.069471 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.069443    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:52:09.069989 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.069969    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:52:09.224941 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.224911    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:09.298834 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.298801    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:09.353727 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.353698    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:09.353848 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:09.353796    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:09.502983 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.502902    2584 generic.go:356] "Generic (PLEG): container finished" podID="8f6bd874-6e12-4be3-a48c-995f066603b9" containerID="a7cf6c490dec16ba8f8add595878c49486a2c477e7123f4ea8b0f7a1367dbad9" exitCode=0
Jul 14 19:52:09.503743 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.502990    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqbkl" event={"ID":"8f6bd874-6e12-4be3-a48c-995f066603b9","Type":"ContainerDied","Data":"a7cf6c490dec16ba8f8add595878c49486a2c477e7123f4ea8b0f7a1367dbad9"}
Jul 14 19:52:09.508942 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.508921    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 19:52:09.509288 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.509268    2584 generic.go:356] "Generic (PLEG): container finished" podID="5d52b149-467b-48ce-b1eb-d1f3933d3931" containerID="bf72bd586e293ce557b4a22f7100c453814c9bdd5e03ba5a92c7737720cb073a" exitCode=1
Jul 14 19:52:09.509359 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.509339    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm" event={"ID":"5d52b149-467b-48ce-b1eb-d1f3933d3931","Type":"ContainerStarted","Data":"de7947610be743657b99d8955d697e91434ff03a77a5598275e591484874f05d"}
Jul 14 19:52:09.509434 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.509424    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm" event={"ID":"5d52b149-467b-48ce-b1eb-d1f3933d3931","Type":"ContainerStarted","Data":"151194d65503be2f5724efef39b9a9a5bd4c389445b61962075db016e9881b66"}
Jul 14 19:52:09.509468 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.509459    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm" event={"ID":"5d52b149-467b-48ce-b1eb-d1f3933d3931","Type":"ContainerStarted","Data":"ee7b8bca9da6c2c11b4e9b8b55c4a1cd71637fbfa7670e7dda65e37b9946b07e"}
Jul 14 19:52:09.509515 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.509487    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm" event={"ID":"5d52b149-467b-48ce-b1eb-d1f3933d3931","Type":"ContainerStarted","Data":"3de70b5cebe1a314c5a459970648bfd3ffe57756b145e63fa5d928770e354930"}
Jul 14 19:52:09.509567 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.509525    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm" event={"ID":"5d52b149-467b-48ce-b1eb-d1f3933d3931","Type":"ContainerStarted","Data":"de0295409db2403ab109672c918a104390f1e50dbd5d438ee06ce1a10076aad3"}
Jul 14 19:52:09.509567 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.509555    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm" event={"ID":"5d52b149-467b-48ce-b1eb-d1f3933d3931","Type":"ContainerDied","Data":"bf72bd586e293ce557b4a22f7100c453814c9bdd5e03ba5a92c7737720cb073a"}
Jul 14 19:52:09.512287 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.512267    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk" event={"ID":"d9a7475c-a219-436b-9443-9f727de7fe1b","Type":"ContainerStarted","Data":"16073e4f2ad903eb57f85ea35da272f0dbf04e8b28c9cd0260f1ad4a2d857adc"}
Jul 14 19:52:09.513699 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.513676    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b4trt" event={"ID":"c2cd35ef-b0b1-407f-8ed9-ca633c13f0ba","Type":"ContainerStarted","Data":"cd33597f323e687d9c058650869217ed497923c427ea193d458b594e9918cdb5"}
Jul 14 19:52:09.514014 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.514000    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:52:09.514562 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.514546    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-248mb"
Jul 14 19:52:09.545045 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.544999    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5pd6v" podStartSLOduration=4.917259144 podStartE2EDuration="23.544984197s" totalImagesPullingTime="18.627725053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:09.544544318 +0000 UTC m=+23.678520399" watchObservedRunningTime="2026-07-14 19:52:09.544984197 +0000 UTC m=+23.678960304"
Jul 14 19:52:09.561804 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.561758    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b4trt" podStartSLOduration=4.926994056 podStartE2EDuration="23.561743272s" totalImagesPullingTime="18.634749216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:09.561423031 +0000 UTC m=+23.695399122" watchObservedRunningTime="2026-07-14 19:52:09.561743272 +0000 UTC m=+23.695719351"
Jul 14 19:52:09.618251 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.618221    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:09.719989 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:09.719958    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:10.008545 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:10.008508    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:10.108824 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:10.108794    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:10.354383 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:10.354299    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:10.354383 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:10.354357    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:10.354586 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:10.354448    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:10.354625 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:10.354585    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:11.353676 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:11.353586    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:11.354192 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:11.353717    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:11.523814 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:11.523785    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 19:52:11.524242 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:11.524210    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm" event={"ID":"5d52b149-467b-48ce-b1eb-d1f3933d3931","Type":"ContainerStarted","Data":"75cb066a54ab583f65806a4edd96ddb8c27e25cffa7a15903f40fdbd0c3236ec"}
Jul 14 19:52:11.609028 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:11.609000    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 19:52:11.783832 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:11.783793    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:12.294379 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:12.294018    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T19:52:11.609024183Z","UUID":"9e159f2d-46ff-4a6e-9da9-422cada0cf8e","Handler":null,"Name":"","Endpoint":""}
Jul 14 19:52:12.295752 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:12.295730    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 19:52:12.295918 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:12.295773    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 19:52:12.354326 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:12.354290    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:12.354731 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:12.354289    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:12.354731 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:12.354412    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:12.354731 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:12.354511    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:12.529294 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:12.529258    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk" event={"ID":"d9a7475c-a219-436b-9443-9f727de7fe1b","Type":"ContainerStarted","Data":"820ab553045f6b97afd0b8788c7c3624e42bc735153433ab10e9cfd97e50bd30"}
Jul 14 19:52:13.353986 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:13.353953    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:13.354154 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:13.354071    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:14.353661 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.353629    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:14.354393 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:14.353764    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:14.354393 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.353823    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:14.354393 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:14.353958    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:14.537641 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.537612    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 19:52:14.538083 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.538056    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm" event={"ID":"5d52b149-467b-48ce-b1eb-d1f3933d3931","Type":"ContainerStarted","Data":"79717bc2ddb91201f6ca3ac857ffeba9990c48ddd00db2e42a6ecc7c9746ee61"}
Jul 14 19:52:14.538395 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.538352    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:52:14.538492 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.538422    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:52:14.538492 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.538453    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:52:14.538618 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.538497    2584 scope.go:117] "RemoveContainer" containerID="bf72bd586e293ce557b4a22f7100c453814c9bdd5e03ba5a92c7737720cb073a"
Jul 14 19:52:14.541230 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.541178    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk" event={"ID":"d9a7475c-a219-436b-9443-9f727de7fe1b","Type":"ContainerStarted","Data":"ca8c0780ff8e1541472775aff1de549eaebdc03f20c4bf9645b1f11bee7909ba"}
Jul 14 19:52:14.543118 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.543090    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqbkl" event={"ID":"8f6bd874-6e12-4be3-a48c-995f066603b9","Type":"ContainerStarted","Data":"da4784d4e3af0e2cb24617e96798cdfbc4354a0c63f9dd4b00ca10e3ede353fc"}
Jul 14 19:52:14.557328 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.557232    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:52:14.557541 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.557526    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:52:14.635850 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:14.635650    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw5lk" podStartSLOduration=4.170110419 podStartE2EDuration="28.635632626s" totalImagesPullingTime="24.465522207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:14.635057036 +0000 UTC m=+28.769033117" watchObservedRunningTime="2026-07-14 19:52:14.635632626 +0000 UTC m=+28.769608705"
Jul 14 19:52:15.353530 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:15.353495    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:15.353634 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:15.353601    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:15.547036 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:15.547001    2584 generic.go:356] "Generic (PLEG): container finished" podID="8f6bd874-6e12-4be3-a48c-995f066603b9" containerID="da4784d4e3af0e2cb24617e96798cdfbc4354a0c63f9dd4b00ca10e3ede353fc" exitCode=0
Jul 14 19:52:15.547587 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:15.547061    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqbkl" event={"ID":"8f6bd874-6e12-4be3-a48c-995f066603b9","Type":"ContainerDied","Data":"da4784d4e3af0e2cb24617e96798cdfbc4354a0c63f9dd4b00ca10e3ede353fc"}
Jul 14 19:52:15.553163 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:15.553146    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 19:52:15.553640 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:15.553612    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm" event={"ID":"5d52b149-467b-48ce-b1eb-d1f3933d3931","Type":"ContainerStarted","Data":"c2d6aaddfa12067328a53a0896fc4de9c8ea319b98a3a55741d66f6779c7e925"}
Jul 14 19:52:15.593724 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:15.593625    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm" podStartSLOduration=10.79810279 podStartE2EDuration="29.593609704s" totalImagesPullingTime="18.795506914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:15.592332365 +0000 UTC m=+29.726308445" watchObservedRunningTime="2026-07-14 19:52:15.593609704 +0000 UTC m=+29.727585810"
Jul 14 19:52:16.354221 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:16.354187    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:16.354385 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:16.354300    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:16.354385 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:16.354342    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:16.354465 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:16.354443    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:16.449991 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:16.449946    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v4k6s"]
Jul 14 19:52:16.450151 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:16.450087    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:16.450240 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:16.450204    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:16.452798 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:16.452771    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2zwms"]
Jul 14 19:52:16.453499 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:16.453476    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2ksr7"]
Jul 14 19:52:16.556065 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:16.555989    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:16.556510 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:16.556134    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:16.556510 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:16.555989    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:16.556723 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:16.556691    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:16.838469 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:16.838236    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:16.939956 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:16.939918    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:17.560229 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:17.560151    2584 generic.go:356] "Generic (PLEG): container finished" podID="8f6bd874-6e12-4be3-a48c-995f066603b9" containerID="0efbbe02b1e7b574ed1b70f51794cae74e13ffc945f414b893c00b08c9305e2f" exitCode=0
Jul 14 19:52:17.560229 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:17.560197    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqbkl" event={"ID":"8f6bd874-6e12-4be3-a48c-995f066603b9","Type":"ContainerDied","Data":"0efbbe02b1e7b574ed1b70f51794cae74e13ffc945f414b893c00b08c9305e2f"}
Jul 14 19:52:18.357116 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:18.357088    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:18.357245 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:18.357127    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:18.357245 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:18.357207    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:18.357313 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:18.357236    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:18.357313 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:18.357298    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:18.357415 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:18.357396    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:18.438476 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:18.438445    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:18.510778 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:18.510671    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:18.564516 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:18.564486    2584 generic.go:356] "Generic (PLEG): container finished" podID="8f6bd874-6e12-4be3-a48c-995f066603b9" containerID="2d1febb57c6c1ea105308117cf56e4ff572db9552a4a7eeb4adaa07c3afa6043" exitCode=0
Jul 14 19:52:18.565090 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:18.564549    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqbkl" event={"ID":"8f6bd874-6e12-4be3-a48c-995f066603b9","Type":"ContainerDied","Data":"2d1febb57c6c1ea105308117cf56e4ff572db9552a4a7eeb4adaa07c3afa6043"}
Jul 14 19:52:19.982054 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:19.982016    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:19.982599 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:19.982070    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:19.982599 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:19.982173    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:52:19.982599 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:19.982180    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:52:19.982599 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:19.982253    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret podName:63c3ab45-2ab8-47ba-9445-8aff47b1c703 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:51.982232516 +0000 UTC m=+66.116208589 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret") pod "global-pull-secret-syncer-2zwms" (UID: "63c3ab45-2ab8-47ba-9445-8aff47b1c703") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:52:19.982599 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:19.982284    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs podName:05bbb5d7-bb7c-407f-aca1-7dab01b15aa6 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:51.98226272 +0000 UTC m=+66.116238778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs") pod "network-metrics-daemon-2ksr7" (UID: "05bbb5d7-bb7c-407f-aca1-7dab01b15aa6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:52:20.183055 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:20.183019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfp6k\" (UniqueName: \"kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k\") pod \"network-check-target-v4k6s\" (UID: \"a7d23547-a538-48b0-951f-ae616a9573af\") " pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:20.183237 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:20.183181    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:52:20.183237 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:20.183198    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:52:20.183237 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:20.183206    2584 projected.go:196] Error preparing data for projected volume kube-api-access-jfp6k for pod openshift-network-diagnostics/network-check-target-v4k6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:52:20.183359 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:20.183259    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k podName:a7d23547-a538-48b0-951f-ae616a9573af nodeName:}" failed. No retries permitted until 2026-07-14 19:52:52.183242905 +0000 UTC m=+66.317218979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jfp6k" (UniqueName: "kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k") pod "network-check-target-v4k6s" (UID: "a7d23547-a538-48b0-951f-ae616a9573af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:52:20.214097 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:20.214060    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:20.272915 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:20.272799    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:20.354227 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:20.354197    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:20.354227 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:20.354218    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:20.354553 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:20.354333    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:20.354553 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:20.354328    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v4k6s" podUID="a7d23547-a538-48b0-951f-ae616a9573af"
Jul 14 19:52:20.354553 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:20.354441    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2ksr7" podUID="05bbb5d7-bb7c-407f-aca1-7dab01b15aa6"
Jul 14 19:52:20.354553 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:20.354510    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2zwms" podUID="63c3ab45-2ab8-47ba-9445-8aff47b1c703"
Jul 14 19:52:21.171953 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.171854    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-56.ec2.internal" event="NodeReady"
Jul 14 19:52:21.172496 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.172030    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 19:52:21.214395 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.214360    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5x95s"]
Jul 14 19:52:21.240684 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.240651    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-59msp"]
Jul 14 19:52:21.240852 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.240797    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.243033 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.243006    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 19:52:21.243163 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.243069    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wc26t\""
Jul 14 19:52:21.243163 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.243074    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 19:52:21.266575 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.266549    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5x95s"]
Jul 14 19:52:21.266718 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.266594    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-59msp"]
Jul 14 19:52:21.266718 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.266701    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-59msp"
Jul 14 19:52:21.269077 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.269053    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 19:52:21.269210 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.269162    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 19:52:21.269492 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.269471    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 19:52:21.269612 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.269574    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gm85k\""
Jul 14 19:52:21.345729 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.345690    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:21.391396 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.391359    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgkmx\" (UniqueName: \"kubernetes.io/projected/5475f6af-72c5-4ef5-8dde-4e5cc5840a9f-kube-api-access-zgkmx\") pod \"ingress-canary-59msp\" (UID: \"5475f6af-72c5-4ef5-8dde-4e5cc5840a9f\") " pod="openshift-ingress-canary/ingress-canary-59msp"
Jul 14 19:52:21.391596 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.391404    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5475f6af-72c5-4ef5-8dde-4e5cc5840a9f-cert\") pod \"ingress-canary-59msp\" (UID: \"5475f6af-72c5-4ef5-8dde-4e5cc5840a9f\") " pod="openshift-ingress-canary/ingress-canary-59msp"
Jul 14 19:52:21.391596 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.391512    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8331d2d1-30c1-41d2-b28c-60d91153001c-config-volume\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.391596 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.391551    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8331d2d1-30c1-41d2-b28c-60d91153001c-tmp-dir\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.391596 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.391580    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgv64\" (UniqueName: \"kubernetes.io/projected/8331d2d1-30c1-41d2-b28c-60d91153001c-kube-api-access-rgv64\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.391787 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.391616    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.409524 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.409489    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:21.492235 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.492203    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.492418 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.492307    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgkmx\" (UniqueName: \"kubernetes.io/projected/5475f6af-72c5-4ef5-8dde-4e5cc5840a9f-kube-api-access-zgkmx\") pod \"ingress-canary-59msp\" (UID: \"5475f6af-72c5-4ef5-8dde-4e5cc5840a9f\") " pod="openshift-ingress-canary/ingress-canary-59msp"
Jul 14 19:52:21.492418 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.492345    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5475f6af-72c5-4ef5-8dde-4e5cc5840a9f-cert\") pod \"ingress-canary-59msp\" (UID: \"5475f6af-72c5-4ef5-8dde-4e5cc5840a9f\") " pod="openshift-ingress-canary/ingress-canary-59msp"
Jul 14 19:52:21.492418 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.492388    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8331d2d1-30c1-41d2-b28c-60d91153001c-config-volume\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.492418 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.492416    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8331d2d1-30c1-41d2-b28c-60d91153001c-tmp-dir\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.492616 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.492440    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgv64\" (UniqueName: \"kubernetes.io/projected/8331d2d1-30c1-41d2-b28c-60d91153001c-kube-api-access-rgv64\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.492616 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:21.492386    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:21.492707 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:21.492677    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls podName:8331d2d1-30c1-41d2-b28c-60d91153001c nodeName:}" failed. No retries permitted until 2026-07-14 19:52:21.992655452 +0000 UTC m=+36.126631524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls") pod "dns-default-5x95s" (UID: "8331d2d1-30c1-41d2-b28c-60d91153001c") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:21.492783 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.492758    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8331d2d1-30c1-41d2-b28c-60d91153001c-tmp-dir\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.493042 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.493018    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8331d2d1-30c1-41d2-b28c-60d91153001c-config-volume\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.497386 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.497360    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5475f6af-72c5-4ef5-8dde-4e5cc5840a9f-cert\") pod \"ingress-canary-59msp\" (UID: \"5475f6af-72c5-4ef5-8dde-4e5cc5840a9f\") " pod="openshift-ingress-canary/ingress-canary-59msp"
Jul 14 19:52:21.501575 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.501549    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgv64\" (UniqueName: \"kubernetes.io/projected/8331d2d1-30c1-41d2-b28c-60d91153001c-kube-api-access-rgv64\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.501746 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.501717    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgkmx\" (UniqueName: \"kubernetes.io/projected/5475f6af-72c5-4ef5-8dde-4e5cc5840a9f-kube-api-access-zgkmx\") pod \"ingress-canary-59msp\" (UID: \"5475f6af-72c5-4ef5-8dde-4e5cc5840a9f\") " pod="openshift-ingress-canary/ingress-canary-59msp"
Jul 14 19:52:21.578790 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.578756    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-59msp"
Jul 14 19:52:21.943563 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.943471    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:21.996440 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.996402    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:21.996602 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:21.996518    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:21.996602 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:21.996587    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls podName:8331d2d1-30c1-41d2-b28c-60d91153001c nodeName:}" failed. No retries permitted until 2026-07-14 19:52:22.996567607 +0000 UTC m=+37.130543688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls") pod "dns-default-5x95s" (UID: "8331d2d1-30c1-41d2-b28c-60d91153001c") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:21.999385 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:21.999347    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:22.353555 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:22.353519    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:22.353555 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:22.353560    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:22.354222 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:22.353533    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:22.357362 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:22.357338    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 19:52:22.357526 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:22.357379    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 19:52:22.357526 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:22.357414    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-78ljl\""
Jul 14 19:52:22.357526 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:22.357488    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 19:52:22.357698 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:22.357633    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fkvzh\""
Jul 14 19:52:22.357698 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:22.357649    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 19:52:22.742759 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:22.742570    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-59msp"]
Jul 14 19:52:22.818166 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:52:22.818136    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5475f6af_72c5_4ef5_8dde_4e5cc5840a9f.slice/crio-b12862735258b8a86f4b8e8032df2d375634496aae4a7f6df9f4522060ffdff4 WatchSource:0}: Error finding container b12862735258b8a86f4b8e8032df2d375634496aae4a7f6df9f4522060ffdff4: Status 404 returned error can't find the container with id b12862735258b8a86f4b8e8032df2d375634496aae4a7f6df9f4522060ffdff4
Jul 14 19:52:23.005228 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:23.005190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:23.005370 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:23.005311    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:23.005370 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:23.005363    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls podName:8331d2d1-30c1-41d2-b28c-60d91153001c nodeName:}" failed. No retries permitted until 2026-07-14 19:52:25.005349361 +0000 UTC m=+39.139325418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls") pod "dns-default-5x95s" (UID: "8331d2d1-30c1-41d2-b28c-60d91153001c") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:23.581284 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:23.580682    2584 generic.go:356] "Generic (PLEG): container finished" podID="8f6bd874-6e12-4be3-a48c-995f066603b9" containerID="4fdd00f903e83a6223eaf7c848806274d2941ce0bcbe48e09120a19ace333e11" exitCode=0
Jul 14 19:52:23.581284 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:23.580722    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqbkl" event={"ID":"8f6bd874-6e12-4be3-a48c-995f066603b9","Type":"ContainerDied","Data":"4fdd00f903e83a6223eaf7c848806274d2941ce0bcbe48e09120a19ace333e11"}
Jul 14 19:52:23.582101 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:23.582073    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-59msp" event={"ID":"5475f6af-72c5-4ef5-8dde-4e5cc5840a9f","Type":"ContainerStarted","Data":"b12862735258b8a86f4b8e8032df2d375634496aae4a7f6df9f4522060ffdff4"}
Jul 14 19:52:24.591412 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:24.591371    2584 generic.go:356] "Generic (PLEG): container finished" podID="8f6bd874-6e12-4be3-a48c-995f066603b9" containerID="a16610726cd9b90d4105259071ffe4337d27b4a7e1704beaccb392d281a53a1c" exitCode=0
Jul 14 19:52:24.591923 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:24.591424    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqbkl" event={"ID":"8f6bd874-6e12-4be3-a48c-995f066603b9","Type":"ContainerDied","Data":"a16610726cd9b90d4105259071ffe4337d27b4a7e1704beaccb392d281a53a1c"}
Jul 14 19:52:25.020728 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:25.020684    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:25.020957 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:25.020887    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:25.021032 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:25.020968    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls podName:8331d2d1-30c1-41d2-b28c-60d91153001c nodeName:}" failed. No retries permitted until 2026-07-14 19:52:29.02095161 +0000 UTC m=+43.154927668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls") pod "dns-default-5x95s" (UID: "8331d2d1-30c1-41d2-b28c-60d91153001c") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:25.595636 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:25.595396    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-59msp" event={"ID":"5475f6af-72c5-4ef5-8dde-4e5cc5840a9f","Type":"ContainerStarted","Data":"bce974f523bb1959940955f30283f53dd0d3f6033ce822ad6db1edfcd162afeb"}
Jul 14 19:52:25.598900 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:25.598839    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nqbkl" event={"ID":"8f6bd874-6e12-4be3-a48c-995f066603b9","Type":"ContainerStarted","Data":"d2b93d208f56f0602fc698f8a244e616fe5b359a0852105d7f273f547ca2b3fe"}
Jul 14 19:52:25.612564 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:25.612516    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-59msp" podStartSLOduration=2.228921226 podStartE2EDuration="4.612503365s" totalImagesPullingTime="2.383582139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:25.611714127 +0000 UTC m=+39.745690221" watchObservedRunningTime="2026-07-14 19:52:25.612503365 +0000 UTC m=+39.746479435"
Jul 14 19:52:25.634703 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:25.634644    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nqbkl" podStartSLOduration=10.160131254 podStartE2EDuration="39.634623592s" totalImagesPullingTime="29.474492338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:25.633042145 +0000 UTC m=+39.767018244" watchObservedRunningTime="2026-07-14 19:52:25.634623592 +0000 UTC m=+39.768599672"
Jul 14 19:52:25.770002 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:25.769966    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:25.835452 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:25.835416    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:27.881647 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:27.881602    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:27.937948 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:27.937912    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:29.051997 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:29.051957    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:29.052467 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:29.052134    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:29.052467 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:29.052219    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls podName:8331d2d1-30c1-41d2-b28c-60d91153001c nodeName:}" failed. No retries permitted until 2026-07-14 19:52:37.052197284 +0000 UTC m=+51.186173361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls") pod "dns-default-5x95s" (UID: "8331d2d1-30c1-41d2-b28c-60d91153001c") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:30.575934 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.575898    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-k8qvv"]
Jul 14 19:52:30.611569 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.611540    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-k8qvv"]
Jul 14 19:52:30.611723 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.611616    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-k8qvv"
Jul 14 19:52:30.614641 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.614621    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hs647\""
Jul 14 19:52:30.764773 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.764706    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4q4h\" (UniqueName: \"kubernetes.io/projected/326b59c2-5561-4de0-bbe7-6e5aa58b4367-kube-api-access-z4q4h\") pod \"network-check-source-869dcfcdcd-k8qvv\" (UID: \"326b59c2-5561-4de0-bbe7-6e5aa58b4367\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-k8qvv"
Jul 14 19:52:30.781859 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.781830    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"]
Jul 14 19:52:30.803437 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.803411    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79969f9494-rw7n6"]
Jul 14 19:52:30.803582 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.803554    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"
Jul 14 19:52:30.812469 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.812448    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 14 19:52:30.812560 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.812513    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 14 19:52:30.812714 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.812701    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:52:30.813135 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.813123    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xttrx\""
Jul 14 19:52:30.818580 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.818562    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 14 19:52:30.827235 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.827184    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"]
Jul 14 19:52:30.827315 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.827270    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:30.834329 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.834312    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 19:52:30.835111 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.835095    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 14 19:52:30.835193 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.835177    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 19:52:30.837777 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.837765    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 14 19:52:30.838124 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.838112    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p4mm6\""
Jul 14 19:52:30.840517 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.840504    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 14 19:52:30.840625 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.840608    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 14 19:52:30.852565 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.852540    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79969f9494-rw7n6"]
Jul 14 19:52:30.866041 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.866018    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4q4h\" (UniqueName: \"kubernetes.io/projected/326b59c2-5561-4de0-bbe7-6e5aa58b4367-kube-api-access-z4q4h\") pod \"network-check-source-869dcfcdcd-k8qvv\" (UID: \"326b59c2-5561-4de0-bbe7-6e5aa58b4367\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-k8qvv"
Jul 14 19:52:30.902543 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.902508    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4q4h\" (UniqueName: \"kubernetes.io/projected/326b59c2-5561-4de0-bbe7-6e5aa58b4367-kube-api-access-z4q4h\") pod \"network-check-source-869dcfcdcd-k8qvv\" (UID: \"326b59c2-5561-4de0-bbe7-6e5aa58b4367\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-k8qvv"
Jul 14 19:52:30.920681 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.920652    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-k8qvv"
Jul 14 19:52:30.966486 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.966454    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e7a9bcc-5144-42c6-9aac-afa5b8f06abc-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xjjtr\" (UID: \"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"
Jul 14 19:52:30.966638 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.966508    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-default-certificate\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:30.966638 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.966586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e7a9bcc-5144-42c6-9aac-afa5b8f06abc-config\") pod \"service-ca-operator-7695fc6c8c-xjjtr\" (UID: \"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"
Jul 14 19:52:30.966770 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.966685    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:30.966770 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.966729    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z4ns\" (UniqueName: \"kubernetes.io/projected/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-kube-api-access-8z4ns\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:30.966895 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.966781    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:30.966895 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.966823    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsx54\" (UniqueName: \"kubernetes.io/projected/0e7a9bcc-5144-42c6-9aac-afa5b8f06abc-kube-api-access-bsx54\") pod \"service-ca-operator-7695fc6c8c-xjjtr\" (UID: \"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"
Jul 14 19:52:30.966895 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:30.966850    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-stats-auth\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:31.064893 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.064840    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-k8qvv"]
Jul 14 19:52:31.067992 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.067963    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e7a9bcc-5144-42c6-9aac-afa5b8f06abc-config\") pod \"service-ca-operator-7695fc6c8c-xjjtr\" (UID: \"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"
Jul 14 19:52:31.068123 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.068020    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:31.068123 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.068048    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z4ns\" (UniqueName: \"kubernetes.io/projected/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-kube-api-access-8z4ns\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:31.068123 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.068087    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:31.068307 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.068151    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsx54\" (UniqueName: \"kubernetes.io/projected/0e7a9bcc-5144-42c6-9aac-afa5b8f06abc-kube-api-access-bsx54\") pod \"service-ca-operator-7695fc6c8c-xjjtr\" (UID: \"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"
Jul 14 19:52:31.068307 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:31.068197    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 19:52:31.068307 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.068209    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-stats-auth\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:31.068307 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.068249    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e7a9bcc-5144-42c6-9aac-afa5b8f06abc-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xjjtr\" (UID: \"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"
Jul 14 19:52:31.068307 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:31.068263    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:31.568244306 +0000 UTC m=+45.702220366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : secret "router-metrics-certs-default" not found
Jul 14 19:52:31.068307 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:31.068294    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:31.568284757 +0000 UTC m=+45.702260815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : configmap references non-existent config key: service-ca.crt
Jul 14 19:52:31.068620 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.068340    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-default-certificate\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:31.068689 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.068652    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e7a9bcc-5144-42c6-9aac-afa5b8f06abc-config\") pod \"service-ca-operator-7695fc6c8c-xjjtr\" (UID: \"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"
Jul 14 19:52:31.069526 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:52:31.069461    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod326b59c2_5561_4de0_bbe7_6e5aa58b4367.slice/crio-6bcde94e788f55310e3ffda927f27bfc68ed3cb6fc352e1c15f62b8212a480c7 WatchSource:0}: Error finding container 6bcde94e788f55310e3ffda927f27bfc68ed3cb6fc352e1c15f62b8212a480c7: Status 404 returned error can't find the container with id 6bcde94e788f55310e3ffda927f27bfc68ed3cb6fc352e1c15f62b8212a480c7
Jul 14 19:52:31.070391 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.070366    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:31.071191 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.071165    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e7a9bcc-5144-42c6-9aac-afa5b8f06abc-serving-cert\") pod \"service-ca-operator-7695fc6c8c-xjjtr\" (UID: \"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"
Jul 14 19:52:31.071443 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.071424    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-default-certificate\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:31.071534 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.071516    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-stats-auth\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:31.076488 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.076467    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsx54\" (UniqueName: \"kubernetes.io/projected/0e7a9bcc-5144-42c6-9aac-afa5b8f06abc-kube-api-access-bsx54\") pod \"service-ca-operator-7695fc6c8c-xjjtr\" (UID: \"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"
Jul 14 19:52:31.076854 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.076827    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z4ns\" (UniqueName: \"kubernetes.io/projected/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-kube-api-access-8z4ns\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:31.113075 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.113014    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"
Jul 14 19:52:31.140174 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.140150    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:31.265750 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.265717    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr"]
Jul 14 19:52:31.268434 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:52:31.268410    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7a9bcc_5144_42c6_9aac_afa5b8f06abc.slice/crio-32f24bd37773b0fee6463478bf32fa2ba2e648d5c6c5cfcc896e0e83f6044ae6 WatchSource:0}: Error finding container 32f24bd37773b0fee6463478bf32fa2ba2e648d5c6c5cfcc896e0e83f6044ae6: Status 404 returned error can't find the container with id 32f24bd37773b0fee6463478bf32fa2ba2e648d5c6c5cfcc896e0e83f6044ae6
Jul 14 19:52:31.572272 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.572232    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:31.572435 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.572298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:31.572435 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:31.572409    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 19:52:31.572562 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:31.572482    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:32.572460842 +0000 UTC m=+46.706436924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : configmap references non-existent config key: service-ca.crt
Jul 14 19:52:31.572562 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:31.572504    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:32.57249273 +0000 UTC m=+46.706468791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : secret "router-metrics-certs-default" not found
Jul 14 19:52:31.614181 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.614147    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr" event={"ID":"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc","Type":"ContainerStarted","Data":"32f24bd37773b0fee6463478bf32fa2ba2e648d5c6c5cfcc896e0e83f6044ae6"}
Jul 14 19:52:31.615421 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:31.615391    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-k8qvv" event={"ID":"326b59c2-5561-4de0-bbe7-6e5aa58b4367","Type":"ContainerStarted","Data":"6bcde94e788f55310e3ffda927f27bfc68ed3cb6fc352e1c15f62b8212a480c7"}
Jul 14 19:52:32.212284 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:32.212236    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:32.293752 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:32.293700    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:32.581901 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:32.581791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:32.581901 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:32.581845    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:32.582129 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:32.581979    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:34.581959959 +0000 UTC m=+48.715936030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : configmap references non-existent config key: service-ca.crt
Jul 14 19:52:32.582129 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:32.582054    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 19:52:32.582233 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:32.582129    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:34.58210859 +0000 UTC m=+48.716084662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : secret "router-metrics-certs-default" not found
Jul 14 19:52:34.279791 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:34.279749    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:34.379621 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:34.379582    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:34.596771 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:34.596741    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:34.596942 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:34.596817    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:34.596983 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:34.596928    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.596910143 +0000 UTC m=+52.730886223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : configmap references non-existent config key: service-ca.crt
Jul 14 19:52:34.596983 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:34.596931    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 19:52:34.596983 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:34.596983    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.596972726 +0000 UTC m=+52.730948801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : secret "router-metrics-certs-default" not found
Jul 14 19:52:35.054005 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.053968    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6vqc4"]
Jul 14 19:52:35.071671 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.071641    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.074127 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.074103    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 19:52:35.074773 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.074490    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 19:52:35.074773 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.074492    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 19:52:35.074773 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.074573    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mlhmv\""
Jul 14 19:52:35.074773 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.074515    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 19:52:35.074773 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.074655    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6vqc4"]
Jul 14 19:52:35.087077 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.087050    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:35.099791 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.099768    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6a7866b-ab51-4474-a131-cb252860f008-data-volume\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.099904 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.099807    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.099904 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.099830    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bccsg\" (UniqueName: \"kubernetes.io/projected/e6a7866b-ab51-4474-a131-cb252860f008-kube-api-access-bccsg\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.099981 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.099956    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.100034 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.100017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6a7866b-ab51-4474-a131-cb252860f008-crio-socket\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.151157 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.151107    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:35.201313 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.201273    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.201483 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.201333    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bccsg\" (UniqueName: \"kubernetes.io/projected/e6a7866b-ab51-4474-a131-cb252860f008-kube-api-access-bccsg\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.201483 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:35.201391    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:35.201483 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.201405    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.201483 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:35.201470    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls podName:e6a7866b-ab51-4474-a131-cb252860f008 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:35.701448957 +0000 UTC m=+49.835425027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vqc4" (UID: "e6a7866b-ab51-4474-a131-cb252860f008") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:35.201642 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.201495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6a7866b-ab51-4474-a131-cb252860f008-crio-socket\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.201642 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:35.201519    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.201642 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.201554    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6a7866b-ab51-4474-a131-cb252860f008-data-volume\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.201642 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:35.201582    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm podName:e6a7866b-ab51-4474-a131-cb252860f008 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:35.701564555 +0000 UTC m=+49.835540629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6vqc4" (UID: "e6a7866b-ab51-4474-a131-cb252860f008") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.201817 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.201800    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6a7866b-ab51-4474-a131-cb252860f008-crio-socket\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.204456 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.204438    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6a7866b-ab51-4474-a131-cb252860f008-data-volume\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.213376 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.213350    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bccsg\" (UniqueName: \"kubernetes.io/projected/e6a7866b-ab51-4474-a131-cb252860f008-kube-api-access-bccsg\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.254174 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.254142    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:35.352297 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.352219    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:35.628013 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.627917    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr" event={"ID":"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc","Type":"ContainerStarted","Data":"73954c35f82a2a1cac15ebfb1f62eea2ac3d4f68fef9cae8e2955df88b7f742d"}
Jul 14 19:52:35.629422 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.629400    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-k8qvv" event={"ID":"326b59c2-5561-4de0-bbe7-6e5aa58b4367","Type":"ContainerStarted","Data":"143bc34ba12a71599468f37859605d36716b455f29658794e3d87596462d9923"}
Jul 14 19:52:35.646788 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.646743    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr" podStartSLOduration=2.245644377 podStartE2EDuration="5.646729997s" totalImagesPullingTime="3.40108562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:35.64628102 +0000 UTC m=+49.780257103" watchObservedRunningTime="2026-07-14 19:52:35.646729997 +0000 UTC m=+49.780706077"
Jul 14 19:52:35.665449 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.665397    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-k8qvv" podStartSLOduration=2.05575977 podStartE2EDuration="5.665384352s" totalImagesPullingTime="3.609624582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:35.664705531 +0000 UTC m=+49.798681636" watchObservedRunningTime="2026-07-14 19:52:35.665384352 +0000 UTC m=+49.799360433"
Jul 14 19:52:35.706674 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.706630    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.706834 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.706721    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:35.706834 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:35.706790    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:35.706971 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:35.706893    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls podName:e6a7866b-ab51-4474-a131-cb252860f008 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:36.706857888 +0000 UTC m=+50.840833953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vqc4" (UID: "e6a7866b-ab51-4474-a131-cb252860f008") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:35.706971 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:35.706900    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.707069 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:35.706972    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm podName:e6a7866b-ab51-4474-a131-cb252860f008 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:36.706953523 +0000 UTC m=+50.840929610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6vqc4" (UID: "e6a7866b-ab51-4474-a131-cb252860f008") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:35.912039 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.911937    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:35.973785 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:35.973744    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:36.232881 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.232835    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr"]
Jul 14 19:52:36.241263 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.241239    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr"
Jul 14 19:52:36.243565 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.243545    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-59rjr\""
Jul 14 19:52:36.243565 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.243563    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 14 19:52:36.243723 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.243552    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 14 19:52:36.246540 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.246520    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr"]
Jul 14 19:52:36.289996 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.289948    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:36.312003 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.311967    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk97d\" (UniqueName: \"kubernetes.io/projected/4ea1791d-9b0a-4acb-92bb-78875202f3a9-kube-api-access-qk97d\") pod \"migrator-7f59b54f6c-9pvmr\" (UID: \"4ea1791d-9b0a-4acb-92bb-78875202f3a9\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr"
Jul 14 19:52:36.389887 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.389831    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:36.412433 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.412406    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk97d\" (UniqueName: \"kubernetes.io/projected/4ea1791d-9b0a-4acb-92bb-78875202f3a9-kube-api-access-qk97d\") pod \"migrator-7f59b54f6c-9pvmr\" (UID: \"4ea1791d-9b0a-4acb-92bb-78875202f3a9\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr"
Jul 14 19:52:36.420760 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.420728    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk97d\" (UniqueName: \"kubernetes.io/projected/4ea1791d-9b0a-4acb-92bb-78875202f3a9-kube-api-access-qk97d\") pod \"migrator-7f59b54f6c-9pvmr\" (UID: \"4ea1791d-9b0a-4acb-92bb-78875202f3a9\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr"
Jul 14 19:52:36.550528 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.550451    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr"
Jul 14 19:52:36.687441 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.687412    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr"]
Jul 14 19:52:36.690677 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:52:36.690648    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea1791d_9b0a_4acb_92bb_78875202f3a9.slice/crio-3c11ec66e8fada49d28cc554dbfd95f09b96ae000f35fb647b9c9da66fdcae67 WatchSource:0}: Error finding container 3c11ec66e8fada49d28cc554dbfd95f09b96ae000f35fb647b9c9da66fdcae67: Status 404 returned error can't find the container with id 3c11ec66e8fada49d28cc554dbfd95f09b96ae000f35fb647b9c9da66fdcae67
Jul 14 19:52:36.715318 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.715289    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:36.715471 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:36.715384    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:36.715471 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:36.715414    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:36.715580 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:36.715475    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm podName:e6a7866b-ab51-4474-a131-cb252860f008 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.715459202 +0000 UTC m=+52.849435259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6vqc4" (UID: "e6a7866b-ab51-4474-a131-cb252860f008") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:36.715580 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:36.715534    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:36.715670 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:36.715611    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls podName:e6a7866b-ab51-4474-a131-cb252860f008 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:38.715593 +0000 UTC m=+52.849569061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vqc4" (UID: "e6a7866b-ab51-4474-a131-cb252860f008") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:37.118582 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:37.118542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:37.118793 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:37.118699    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:52:37.118793 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:37.118761    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls podName:8331d2d1-30c1-41d2-b28c-60d91153001c nodeName:}" failed. No retries permitted until 2026-07-14 19:52:53.118746092 +0000 UTC m=+67.252722150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls") pod "dns-default-5x95s" (UID: "8331d2d1-30c1-41d2-b28c-60d91153001c") : secret "dns-default-metrics-tls" not found
Jul 14 19:52:37.208596 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:37.208568    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mhgfv_29243480-09bb-4c97-9d5a-4a2d4623c3a9/dns-node-resolver/0.log"
Jul 14 19:52:37.636208 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:37.636169    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr" event={"ID":"4ea1791d-9b0a-4acb-92bb-78875202f3a9","Type":"ContainerStarted","Data":"3c11ec66e8fada49d28cc554dbfd95f09b96ae000f35fb647b9c9da66fdcae67"}
Jul 14 19:52:37.807755 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:37.807729    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5pd6v_8c0fca7e-9658-43b2-8208-4edce8612b34/node-ca/0.log"
Jul 14 19:52:37.851849 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:37.851811    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:37.925104 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:37.925015    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:38.266806 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:38.266776    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:38.334843 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:38.334809    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:38.608198 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:38.608029    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-59msp_5475f6af-72c5-4ef5-8dde-4e5cc5840a9f/serve-healthcheck-canary/0.log"
Jul 14 19:52:38.630367 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:38.630336    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:38.630530 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:38.630399    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:38.630603 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:38.630526    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 19:52:38.630603 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:38.630535    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:46.630517223 +0000 UTC m=+60.764493305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : configmap references non-existent config key: service-ca.crt
Jul 14 19:52:38.630603 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:38.630600    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:52:46.630586099 +0000 UTC m=+60.764562157 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : secret "router-metrics-certs-default" not found
Jul 14 19:52:38.731143 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:38.731109    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:38.731622 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:38.731221    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:38.731622 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:38.731236    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:38.731622 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:38.731292    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm podName:e6a7866b-ab51-4474-a131-cb252860f008 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:42.731279607 +0000 UTC m=+56.865255665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6vqc4" (UID: "e6a7866b-ab51-4474-a131-cb252860f008") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:38.731622 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:38.731347    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:38.731622 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:38.731410    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls podName:e6a7866b-ab51-4474-a131-cb252860f008 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:42.731392394 +0000 UTC m=+56.865368469 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vqc4" (UID: "e6a7866b-ab51-4474-a131-cb252860f008") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:39.214193 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:39.214152    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:40.645837 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:40.645802    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr" event={"ID":"4ea1791d-9b0a-4acb-92bb-78875202f3a9","Type":"ContainerStarted","Data":"4ef3f907b86f2dbbe8c4827468257fb63ba1575f2ef8134a8f75d21b43921365"}
Jul 14 19:52:40.646235 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:40.645854    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr" event={"ID":"4ea1791d-9b0a-4acb-92bb-78875202f3a9","Type":"ContainerStarted","Data":"555d5452daf5530ed2518ec64493910b2d8c3df7c79f09dca78c5f2cd5178e7a"}
Jul 14 19:52:40.665107 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:40.665062    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9pvmr" podStartSLOduration=1.773206609 podStartE2EDuration="4.665047545s" totalImagesPullingTime="2.891840936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:40.663725945 +0000 UTC m=+54.797702024" watchObservedRunningTime="2026-07-14 19:52:40.665047545 +0000 UTC m=+54.799023624"
Jul 14 19:52:42.765245 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:42.765192    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:42.765642 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:42.765303    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:42.765642 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:42.765382    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:52:42.765642 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:42.765382    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:42.765642 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:42.765450    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm podName:e6a7866b-ab51-4474-a131-cb252860f008 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:50.765433595 +0000 UTC m=+64.899409657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6vqc4" (UID: "e6a7866b-ab51-4474-a131-cb252860f008") : configmap "kube-rbac-proxy" not found
Jul 14 19:52:42.765642 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:42.765466    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls podName:e6a7866b-ab51-4474-a131-cb252860f008 nodeName:}" failed. No retries permitted until 2026-07-14 19:52:50.765459856 +0000 UTC m=+64.899435914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vqc4" (UID: "e6a7866b-ab51-4474-a131-cb252860f008") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:43.104724 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:43.104634    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:44.770728 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:44.770690    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:44.996032 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:44.995992    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:45.093959 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:45.093855    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:45.166949 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:45.166914    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:45.294479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:45.294447    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:45.914350 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:45.914308    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:46.469587 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:46.469550    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:46.567639 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:46.567612    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nzhmm"
Jul 14 19:52:46.663983 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:46.663938    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:46.694455 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:46.694423    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:46.694631 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:46.694533    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:52:46.694631 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:46.694598    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:53:02.694581527 +0000 UTC m=+76.828557586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : configmap references non-existent config key: service-ca.crt
Jul 14 19:52:46.694631 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:46.694623    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 19:52:46.694742 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:46.694662    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs podName:7f80533b-d0ec-4684-9a75-2dc53eae9b4d nodeName:}" failed. No retries permitted until 2026-07-14 19:53:02.694650904 +0000 UTC m=+76.828626962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs") pod "router-default-79969f9494-rw7n6" (UID: "7f80533b-d0ec-4684-9a75-2dc53eae9b4d") : secret "router-metrics-certs-default" not found
Jul 14 19:52:47.077321 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:47.077286    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:47.275127 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:47.275095    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:47.665269 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:47.665237    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:48.284390 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:48.284358    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:48.404141 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:48.404109    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:48.505687 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:48.505650    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:48.576335 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:48.576248    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:48.677198 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:48.677166    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:48.868816 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:48.868725    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:49.270851 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:49.270809    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:49.328437 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:49.328385    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:49.869806 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:49.869760    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:50.064757 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:50.064727    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:50.465495 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:50.465453    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:50.829583 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:50.829487    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:50.829583 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:50.829567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:50.829807 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:50.829659    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:50.829807 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:52:50.829713    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls podName:e6a7866b-ab51-4474-a131-cb252860f008 nodeName:}" failed. No retries permitted until 2026-07-14 19:53:06.829699322 +0000 UTC m=+80.963675379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vqc4" (UID: "e6a7866b-ab51-4474-a131-cb252860f008") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:52:50.830149 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:50.830125    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6a7866b-ab51-4474-a131-cb252860f008-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:52:50.973535 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:50.973500    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:51.075054 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:51.075018    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:51.131751 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:51.131667    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:51.469133 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:51.469099    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:51.682028 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:51.681994    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:52.038165 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.038126    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:52.038342 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.038183    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:52.040701 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.040679    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 19:52:52.040816 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.040689    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 19:52:52.050997 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.050971    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05bbb5d7-bb7c-407f-aca1-7dab01b15aa6-metrics-certs\") pod \"network-metrics-daemon-2ksr7\" (UID: \"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6\") " pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:52.051094 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.051076    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63c3ab45-2ab8-47ba-9445-8aff47b1c703-original-pull-secret\") pod \"global-pull-secret-syncer-2zwms\" (UID: \"63c3ab45-2ab8-47ba-9445-8aff47b1c703\") " pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:52.068160 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.068135    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-78ljl\""
Jul 14 19:52:52.072201 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.072177    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2zwms"
Jul 14 19:52:52.076525 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.076502    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2ksr7"
Jul 14 19:52:52.204434 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.204404    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2zwms"]
Jul 14 19:52:52.208628 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:52:52.208601    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c3ab45_2ab8_47ba_9445_8aff47b1c703.slice/crio-f828eaac4b73a6b12adf462d4410f279389f541d093f65403bc5a41e1bea8406 WatchSource:0}: Error finding container f828eaac4b73a6b12adf462d4410f279389f541d093f65403bc5a41e1bea8406: Status 404 returned error can't find the container with id f828eaac4b73a6b12adf462d4410f279389f541d093f65403bc5a41e1bea8406
Jul 14 19:52:52.220653 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.220627    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2ksr7"]
Jul 14 19:52:52.223303 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:52:52.223281    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05bbb5d7_bb7c_407f_aca1_7dab01b15aa6.slice/crio-3a93c7f395b135baa3f0e765c6247be337523cf8ccb0266bca79fc9389ddaa0c WatchSource:0}: Error finding container 3a93c7f395b135baa3f0e765c6247be337523cf8ccb0266bca79fc9389ddaa0c: Status 404 returned error can't find the container with id 3a93c7f395b135baa3f0e765c6247be337523cf8ccb0266bca79fc9389ddaa0c
Jul 14 19:52:52.239394 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.239372    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfp6k\" (UniqueName: \"kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k\") pod \"network-check-target-v4k6s\" (UID: \"a7d23547-a538-48b0-951f-ae616a9573af\") " pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:52.241984 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.241964    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfp6k\" (UniqueName: \"kubernetes.io/projected/a7d23547-a538-48b0-951f-ae616a9573af-kube-api-access-jfp6k\") pod \"network-check-target-v4k6s\" (UID: \"a7d23547-a538-48b0-951f-ae616a9573af\") " pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:52.266236 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.266207    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:52.381306 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.381222    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fkvzh\""
Jul 14 19:52:52.389317 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.389298    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:52.469723 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.469693    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:52.518154 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.518122    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v4k6s"]
Jul 14 19:52:52.522961 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:52:52.522931    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d23547_a538_48b0_951f_ae616a9573af.slice/crio-34aeeb0e0aa42937a793fa8bfad9317cf2915b20cc4e3e192a602ef3a2519681 WatchSource:0}: Error finding container 34aeeb0e0aa42937a793fa8bfad9317cf2915b20cc4e3e192a602ef3a2519681: Status 404 returned error can't find the container with id 34aeeb0e0aa42937a793fa8bfad9317cf2915b20cc4e3e192a602ef3a2519681
Jul 14 19:52:52.681835 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.681735    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v4k6s" event={"ID":"a7d23547-a538-48b0-951f-ae616a9573af","Type":"ContainerStarted","Data":"451e6314fd94dc07d56068869d1a3a9a1678cf3f2c196303f402b347313b9a16"}
Jul 14 19:52:52.681835 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.681783    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v4k6s" event={"ID":"a7d23547-a538-48b0-951f-ae616a9573af","Type":"ContainerStarted","Data":"34aeeb0e0aa42937a793fa8bfad9317cf2915b20cc4e3e192a602ef3a2519681"}
Jul 14 19:52:52.682099 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.681851    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:52:52.682850 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.682830    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2zwms" event={"ID":"63c3ab45-2ab8-47ba-9445-8aff47b1c703","Type":"ContainerStarted","Data":"f828eaac4b73a6b12adf462d4410f279389f541d093f65403bc5a41e1bea8406"}
Jul 14 19:52:52.683979 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.683956    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2ksr7" event={"ID":"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6","Type":"ContainerStarted","Data":"3a93c7f395b135baa3f0e765c6247be337523cf8ccb0266bca79fc9389ddaa0c"}
Jul 14 19:52:52.696695 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.696648    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v4k6s" podStartSLOduration=66.696630623 podStartE2EDuration="1m6.696630623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:52.696507297 +0000 UTC m=+66.830483388" watchObservedRunningTime="2026-07-14 19:52:52.696630623 +0000 UTC m=+66.830606705"
Jul 14 19:52:52.867425 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:52.867383    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:53.146177 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:53.146140    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:53.148848 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:53.148824    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8331d2d1-30c1-41d2-b28c-60d91153001c-metrics-tls\") pod \"dns-default-5x95s\" (UID: \"8331d2d1-30c1-41d2-b28c-60d91153001c\") " pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:53.353658 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:53.353631    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wc26t\""
Jul 14 19:52:53.361940 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:53.361914    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:53.471562 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:53.471527    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:53.512403 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:53.512367    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5x95s"]
Jul 14 19:52:53.515974 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:52:53.515944    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8331d2d1_30c1_41d2_b28c_60d91153001c.slice/crio-f611cc750a26e35195ce050bde4144e4b045b75d3c316b14febfeecedef1e6b6 WatchSource:0}: Error finding container f611cc750a26e35195ce050bde4144e4b045b75d3c316b14febfeecedef1e6b6: Status 404 returned error can't find the container with id f611cc750a26e35195ce050bde4144e4b045b75d3c316b14febfeecedef1e6b6
Jul 14 19:52:53.689981 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:53.689845    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5x95s" event={"ID":"8331d2d1-30c1-41d2-b28c-60d91153001c","Type":"ContainerStarted","Data":"f611cc750a26e35195ce050bde4144e4b045b75d3c316b14febfeecedef1e6b6"}
Jul 14 19:52:53.871262 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:53.871229    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:54.266098 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:54.266050    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:54.469288 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:54.469207    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:54.695018 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:54.694986    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2ksr7" event={"ID":"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6","Type":"ContainerStarted","Data":"fc8731121e8efdd566f816dd6aba94f1911ea76de24c0c7b728bbc80d22535db"}
Jul 14 19:52:54.695436 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:54.695072    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2ksr7" event={"ID":"05bbb5d7-bb7c-407f-aca1-7dab01b15aa6","Type":"ContainerStarted","Data":"221cb8301a1c31b3c1c65e7fbd2dd2408e13558f83f88621e920bcf2d552c120"}
Jul 14 19:52:54.712497 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:54.712439    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2ksr7" podStartSLOduration=66.672351629 podStartE2EDuration="1m8.712423413s" totalImagesPullingTime="2.040071784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:54.71149386 +0000 UTC m=+68.845469940" watchObservedRunningTime="2026-07-14 19:52:54.712423413 +0000 UTC m=+68.846399492"
Jul 14 19:52:54.873463 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:54.873425    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:55.269810 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:55.269768    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:55.469279 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:55.469169    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:56.573153 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:56.573114    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:56.678136 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:56.678101    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:56.735812 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:56.735777    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:57.073587 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:57.073549    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:57.262778 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:57.262752    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:57.362826 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:57.362792    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:57.462242 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:57.462207    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:57.706402 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:57.706369    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2zwms" event={"ID":"63c3ab45-2ab8-47ba-9445-8aff47b1c703","Type":"ContainerStarted","Data":"d27ffa752aad0c75fe6c3d1914b35fed48b8b1ed5be0adcb2e4fc4694ce5922f"}
Jul 14 19:52:57.708230 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:57.708204    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5x95s" event={"ID":"8331d2d1-30c1-41d2-b28c-60d91153001c","Type":"ContainerStarted","Data":"49afaa5ac73b5874ebbd5b7f12ef5dbd7c906e0b17de09ec100b74cdb35c4711"}
Jul 14 19:52:57.708356 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:57.708245    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5x95s" event={"ID":"8331d2d1-30c1-41d2-b28c-60d91153001c","Type":"ContainerStarted","Data":"538d25da61be89d0e753228923066c0e04e707a59dc0ade0873fd161e4953ba3"}
Jul 14 19:52:57.708356 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:57.708277    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5x95s"
Jul 14 19:52:57.723958 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:57.723916    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2zwms" podStartSLOduration=66.816351706 podStartE2EDuration="1m11.723902495s" totalImagesPullingTime="4.907550789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:57.722864206 +0000 UTC m=+71.856840286" watchObservedRunningTime="2026-07-14 19:52:57.723902495 +0000 UTC m=+71.857878601"
Jul 14 19:52:57.741970 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:57.741926    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5x95s" podStartSLOduration=33.152745927 podStartE2EDuration="36.741911776s" totalImagesPullingTime="3.589165849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:52:57.740822649 +0000 UTC m=+71.874798730" watchObservedRunningTime="2026-07-14 19:52:57.741911776 +0000 UTC m=+71.875887855"
Jul 14 19:52:58.060145 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:58.060048    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:58.285441 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:58.285404    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:58.386069 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:58.385981    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:58.667267 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:58.667184    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:59.001820 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.001784    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:59.281863 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.281790    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"]
Jul 14 19:52:59.313091 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.313056    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"]
Jul 14 19:52:59.313242 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.313164    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.315641 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.315612    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 14 19:52:59.315787 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.315648    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 14 19:52:59.315787 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.315663    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 14 19:52:59.316429 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.316402    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 14 19:52:59.316534 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.316501    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 19:52:59.316534 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.316521    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 19:52:59.316657 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.316521    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 19:52:59.370697 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.370665    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:59.393830 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.393799    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-ca\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.394071 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.393839    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.394071 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.393857    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt6dt\" (UniqueName: \"kubernetes.io/projected/fecdac61-5be2-47dd-b194-8e4b5df473c9-kube-api-access-bt6dt\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.394071 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.393925    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fecdac61-5be2-47dd-b194-8e4b5df473c9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.394071 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.393966    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.394071 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.394004    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-hub\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.455185 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.455143    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:59.494932 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.494897    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.495082 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.494938    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-hub\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.495082 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.494996    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-ca\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.495082 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.495028    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.495082 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.495047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt6dt\" (UniqueName: \"kubernetes.io/projected/fecdac61-5be2-47dd-b194-8e4b5df473c9-kube-api-access-bt6dt\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.495082 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.495068    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fecdac61-5be2-47dd-b194-8e4b5df473c9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.495987 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.495960    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fecdac61-5be2-47dd-b194-8e4b5df473c9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.497721 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.497699    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-hub\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.497821 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.497767    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.497910 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.497888    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-ca\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.497964 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.497951    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fecdac61-5be2-47dd-b194-8e4b5df473c9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.505395 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.505369    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt6dt\" (UniqueName: \"kubernetes.io/projected/fecdac61-5be2-47dd-b194-8e4b5df473c9-kube-api-access-bt6dt\") pod \"cluster-proxy-proxy-agent-745b6dc656-zwzjm\" (UID: \"fecdac61-5be2-47dd-b194-8e4b5df473c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.556709 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.556632    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:59.635027 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.634987    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"
Jul 14 19:52:59.688178 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.688085    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:59.768174 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.768148    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm"]
Jul 14 19:52:59.771532 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:52:59.771509    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfecdac61_5be2_47dd_b194_8e4b5df473c9.slice/crio-21bf9e84c22d14bbb3c3910bb417b3fb512a8e95477c32d0577b8a6da1930e03 WatchSource:0}: Error finding container 21bf9e84c22d14bbb3c3910bb417b3fb512a8e95477c32d0577b8a6da1930e03: Status 404 returned error can't find the container with id 21bf9e84c22d14bbb3c3910bb417b3fb512a8e95477c32d0577b8a6da1930e03
Jul 14 19:52:59.791047 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:52:59.791016    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:00.721553 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:00.721516    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm" event={"ID":"fecdac61-5be2-47dd-b194-8e4b5df473c9","Type":"ContainerStarted","Data":"21bf9e84c22d14bbb3c3910bb417b3fb512a8e95477c32d0577b8a6da1930e03"}
Jul 14 19:53:02.723835 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:02.723794    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:53:02.724307 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:02.723888    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:53:02.724777 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:02.724749    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-service-ca-bundle\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:53:02.727896 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:02.726584    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f80533b-d0ec-4684-9a75-2dc53eae9b4d-metrics-certs\") pod \"router-default-79969f9494-rw7n6\" (UID: \"7f80533b-d0ec-4684-9a75-2dc53eae9b4d\") " pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:53:02.937758 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:02.937722    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p4mm6\""
Jul 14 19:53:02.945930 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:02.945906    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:53:03.346894 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.346462    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79969f9494-rw7n6"]
Jul 14 19:53:03.360010 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:53:03.359979    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f80533b_d0ec_4684_9a75_2dc53eae9b4d.slice/crio-55c55914e289d44cf7398a71ffabf150ae3ed94445f3808b06b37bd2d985e363 WatchSource:0}: Error finding container 55c55914e289d44cf7398a71ffabf150ae3ed94445f3808b06b37bd2d985e363: Status 404 returned error can't find the container with id 55c55914e289d44cf7398a71ffabf150ae3ed94445f3808b06b37bd2d985e363
Jul 14 19:53:03.438169 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.438141    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:03.538450 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.538330    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:03.736252 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.736214    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm" event={"ID":"fecdac61-5be2-47dd-b194-8e4b5df473c9","Type":"ContainerStarted","Data":"0e36f39e5413b03d9b617e0df78e73e625d4b5eea6d1887552400db1b4682ee4"}
Jul 14 19:53:03.736657 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.736268    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm" event={"ID":"fecdac61-5be2-47dd-b194-8e4b5df473c9","Type":"ContainerStarted","Data":"e29be6618784a8e53280c20ba633f63db0f7dd54aea2700af1178042f0ee0d03"}
Jul 14 19:53:03.736657 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.736285    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm" event={"ID":"fecdac61-5be2-47dd-b194-8e4b5df473c9","Type":"ContainerStarted","Data":"4fbde520bb5614054d711a6390bd637123775bb13253a1733a843f4547bb51c4"}
Jul 14 19:53:03.737934 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.737910    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79969f9494-rw7n6" event={"ID":"7f80533b-d0ec-4684-9a75-2dc53eae9b4d","Type":"ContainerStarted","Data":"55d2e6649c7882be9f0012558876eb0495a863fb70db5569c268c2bbf007fc4f"}
Jul 14 19:53:03.738067 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.737980    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79969f9494-rw7n6" event={"ID":"7f80533b-d0ec-4684-9a75-2dc53eae9b4d","Type":"ContainerStarted","Data":"55c55914e289d44cf7398a71ffabf150ae3ed94445f3808b06b37bd2d985e363"}
Jul 14 19:53:03.756809 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.756763    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-745b6dc656-zwzjm" podStartSLOduration=1.278989504 podStartE2EDuration="4.756749091s" totalImagesPullingTime="3.477759587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:03.75633004 +0000 UTC m=+77.890306120" watchObservedRunningTime="2026-07-14 19:53:03.756749091 +0000 UTC m=+77.890725170"
Jul 14 19:53:03.778694 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.778637    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-79969f9494-rw7n6" podStartSLOduration=33.778616633 podStartE2EDuration="33.778616633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:52:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:03.777997196 +0000 UTC m=+77.911973276" watchObservedRunningTime="2026-07-14 19:53:03.778616633 +0000 UTC m=+77.912592713"
Jul 14 19:53:03.947043 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.947008    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:53:03.949665 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:03.949641    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:53:04.741696 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:04.741669    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:53:04.742977 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:04.742956    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79969f9494-rw7n6"
Jul 14 19:53:05.331255 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:05.331216    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:05.431409 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:05.431375    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:05.513982 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:05.513946    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:05.579035 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:05.579003    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:06.859068 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:06.858896    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:53:06.861426 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:06.861402    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6a7866b-ab51-4474-a131-cb252860f008-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vqc4\" (UID: \"e6a7866b-ab51-4474-a131-cb252860f008\") " pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:53:06.894978 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:06.894951    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mlhmv\""
Jul 14 19:53:06.903300 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:06.903281    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6vqc4"
Jul 14 19:53:07.033900 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:07.033853    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6vqc4"]
Jul 14 19:53:07.036859 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:53:07.036835    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a7866b_ab51_4474_a131_cb252860f008.slice/crio-d2f0f0ac9e16ee78cc9a59aab98d62edf2943f413010185c8894f6f6a4d0c4ac WatchSource:0}: Error finding container d2f0f0ac9e16ee78cc9a59aab98d62edf2943f413010185c8894f6f6a4d0c4ac: Status 404 returned error can't find the container with id d2f0f0ac9e16ee78cc9a59aab98d62edf2943f413010185c8894f6f6a4d0c4ac
Jul 14 19:53:07.715441 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:07.714960    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5x95s"
Jul 14 19:53:07.754038 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:07.753997    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vqc4" event={"ID":"e6a7866b-ab51-4474-a131-cb252860f008","Type":"ContainerStarted","Data":"d2f0f0ac9e16ee78cc9a59aab98d62edf2943f413010185c8894f6f6a4d0c4ac"}
Jul 14 19:53:08.535562 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:08.535510    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:08.616084 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:08.616039    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:08.683134 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:08.683101    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:09.485547 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:09.485503    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:09.549234 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:09.549201    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:11.496584 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:11.496555    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:11.767902 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:11.767809    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vqc4" event={"ID":"e6a7866b-ab51-4474-a131-cb252860f008","Type":"ContainerStarted","Data":"e7fda57b30e3d3c7db54cdd0e64d764b5adaa51edbd282e09d79154d8d5f12be"}
Jul 14 19:53:12.320305 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:12.320269    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:12.380021 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:12.379984    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:12.772986 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:12.772950    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vqc4" event={"ID":"e6a7866b-ab51-4474-a131-cb252860f008","Type":"ContainerStarted","Data":"75fbb2a799d66d9987fc42570d9ad6c55b4bc35ece66348c1f9d3dd1bc92bc41"}
Jul 14 19:53:12.891780 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:12.891741    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:13.693712 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:13.693678    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:13.756436 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:13.756396    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:14.971214 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:14.971182    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"]
Jul 14 19:53:14.979760 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:14.979727    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:14.984575 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:14.984549    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 14 19:53:14.984728 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:14.984636    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 19:53:14.984944 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:14.984920    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 19:53:14.985063 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:14.984945    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 19:53:14.986062 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:14.985651    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 14 19:53:14.986062 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:14.985900    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 14 19:53:14.990134 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:14.990114    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-59mzf\""
Jul 14 19:53:14.995177 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:14.995098    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"]
Jul 14 19:53:14.998771 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:14.998747    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lxh5b"]
Jul 14 19:53:15.002241 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.002220    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.006980 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.006957    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 19:53:15.007297 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.007278    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 19:53:15.007509 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.007494    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pq5qb\""
Jul 14 19:53:15.008235 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.008215    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 19:53:15.075578 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.075526    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:15.120570 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.120535    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-wtmp\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.120766 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.120581    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.120766 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.120617    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-tls\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.120766 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.120657    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fcv7\" (UniqueName: \"kubernetes.io/projected/6286f237-d319-4e06-b9dc-ce90ed493b77-kube-api-access-8fcv7\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.120766 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.120731    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-textfile\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.120766 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.120756    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.121018 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.120788    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6286f237-d319-4e06-b9dc-ce90ed493b77-sys\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.121018 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.120815    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq6cc\" (UniqueName: \"kubernetes.io/projected/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-api-access-bq6cc\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.121018 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.120849    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa4dc4b-017c-4513-a286-6ccdba79dca2-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.121018 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.120919    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6286f237-d319-4e06-b9dc-ce90ed493b77-root\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.121018 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.120965    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-accelerators-collector-config\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.121018 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.121007    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.121219 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.121061    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6286f237-d319-4e06-b9dc-ce90ed493b77-metrics-client-ca\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.121219 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.121096    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.121219 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.121141    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/caa4dc4b-017c-4513-a286-6ccdba79dca2-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.164778 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.164737    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:15.222089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222005    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/caa4dc4b-017c-4513-a286-6ccdba79dca2-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.222089 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222046    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-wtmp\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.222298 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222086    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.222298 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222127    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-tls\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.222298 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222162    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fcv7\" (UniqueName: \"kubernetes.io/projected/6286f237-d319-4e06-b9dc-ce90ed493b77-kube-api-access-8fcv7\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.222298 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-textfile\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.222298 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222209    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-wtmp\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.222298 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.222298 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:53:15.222255    2584 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 14 19:53:15.222298 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222280    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6286f237-d319-4e06-b9dc-ce90ed493b77-sys\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.222701 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222315    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq6cc\" (UniqueName: \"kubernetes.io/projected/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-api-access-bq6cc\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.222701 ip-10-0-142-56 kubenswrapper[2584]: E0714 19:53:15.222333    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-tls podName:caa4dc4b-017c-4513-a286-6ccdba79dca2 nodeName:}" failed. No retries permitted until 2026-07-14 19:53:15.722311458 +0000 UTC m=+89.856287530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-kxvsj" (UID: "caa4dc4b-017c-4513-a286-6ccdba79dca2") : secret "kube-state-metrics-tls" not found
Jul 14 19:53:15.222701 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222388    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa4dc4b-017c-4513-a286-6ccdba79dca2-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.222701 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222413    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6286f237-d319-4e06-b9dc-ce90ed493b77-root\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.222701 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222444    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-accelerators-collector-config\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.222701 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222445    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/caa4dc4b-017c-4513-a286-6ccdba79dca2-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.222701 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222502    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.222701 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222552    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6286f237-d319-4e06-b9dc-ce90ed493b77-metrics-client-ca\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.222701 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222586    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.222701 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.222673    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6286f237-d319-4e06-b9dc-ce90ed493b77-sys\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.223230 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.223018    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.223230 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.223040    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-accelerators-collector-config\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.223230 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.223114    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6286f237-d319-4e06-b9dc-ce90ed493b77-root\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.223376 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.223284    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa4dc4b-017c-4513-a286-6ccdba79dca2-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.223650 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.223629    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-textfile\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.223757 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.223714    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6286f237-d319-4e06-b9dc-ce90ed493b77-metrics-client-ca\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.225661 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.225634    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.225841 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.225810    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.226281 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.226263    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6286f237-d319-4e06-b9dc-ce90ed493b77-node-exporter-tls\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.231739 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.231712    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq6cc\" (UniqueName: \"kubernetes.io/projected/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-api-access-bq6cc\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.234732 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.234703    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fcv7\" (UniqueName: \"kubernetes.io/projected/6286f237-d319-4e06-b9dc-ce90ed493b77-kube-api-access-8fcv7\") pod \"node-exporter-lxh5b\" (UID: \"6286f237-d319-4e06-b9dc-ce90ed493b77\") " pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.264477 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.264439    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:15.312992 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.312953    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lxh5b"
Jul 14 19:53:15.375765 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.375733    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:15.615152 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:53:15.615124    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6286f237_d319_4e06_b9dc_ce90ed493b77.slice/crio-2612c73fec562137701e93f26e4aeab3cb0ed26f11077ec789ad73e7e7d9f097 WatchSource:0}: Error finding container 2612c73fec562137701e93f26e4aeab3cb0ed26f11077ec789ad73e7e7d9f097: Status 404 returned error can't find the container with id 2612c73fec562137701e93f26e4aeab3cb0ed26f11077ec789ad73e7e7d9f097
Jul 14 19:53:15.726696 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.726666    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.729002 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.728981    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/caa4dc4b-017c-4513-a286-6ccdba79dca2-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kxvsj\" (UID: \"caa4dc4b-017c-4513-a286-6ccdba79dca2\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.784647 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.784615    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vqc4" event={"ID":"e6a7866b-ab51-4474-a131-cb252860f008","Type":"ContainerStarted","Data":"8a3794058fa02d70a5c8647efff34b6caae139d2468b1da056ff809b0eb6fda1"}
Jul 14 19:53:15.785953 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.785927    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lxh5b" event={"ID":"6286f237-d319-4e06-b9dc-ce90ed493b77","Type":"ContainerStarted","Data":"2612c73fec562137701e93f26e4aeab3cb0ed26f11077ec789ad73e7e7d9f097"}
Jul 14 19:53:15.807325 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.807272    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6vqc4" podStartSLOduration=32.303994918 podStartE2EDuration="40.80724969s" totalImagesPullingTime="8.503254772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:52:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:15.805714575 +0000 UTC m=+89.939690655" watchObservedRunningTime="2026-07-14 19:53:15.80724969 +0000 UTC m=+89.941225770"
Jul 14 19:53:15.890725 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.890649    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"
Jul 14 19:53:15.958897 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:15.944087    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:16.061809 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:16.061767    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kxvsj"]
Jul 14 19:53:16.065705 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:53:16.065675    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa4dc4b_017c_4513_a286_6ccdba79dca2.slice/crio-8d38823913eda44f14cb48b955cebfd39c14d6d9d030cf3f29980c88733b13fb WatchSource:0}: Error finding container 8d38823913eda44f14cb48b955cebfd39c14d6d9d030cf3f29980c88733b13fb: Status 404 returned error can't find the container with id 8d38823913eda44f14cb48b955cebfd39c14d6d9d030cf3f29980c88733b13fb
Jul 14 19:53:16.458606 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:16.458569    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:16.654519 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:16.654485    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:16.791047 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:16.790961    2584 generic.go:356] "Generic (PLEG): container finished" podID="6286f237-d319-4e06-b9dc-ce90ed493b77" containerID="6f0615f9c9f734072264091edf19f7a15a0a58cfc175dab753400d9ae1b4196c" exitCode=0
Jul 14 19:53:16.791047 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:16.791035    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lxh5b" event={"ID":"6286f237-d319-4e06-b9dc-ce90ed493b77","Type":"ContainerDied","Data":"6f0615f9c9f734072264091edf19f7a15a0a58cfc175dab753400d9ae1b4196c"}
Jul 14 19:53:16.792314 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:16.792290    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj" event={"ID":"caa4dc4b-017c-4513-a286-6ccdba79dca2","Type":"ContainerStarted","Data":"8d38823913eda44f14cb48b955cebfd39c14d6d9d030cf3f29980c88733b13fb"}
Jul 14 19:53:17.799458 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:17.799413    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lxh5b" event={"ID":"6286f237-d319-4e06-b9dc-ce90ed493b77","Type":"ContainerStarted","Data":"ed9ef033c8eefe92a23bfe3ae9cf1f1016dd5f7989c9949907eb579160f0b263"}
Jul 14 19:53:17.800030 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:17.799486    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lxh5b" event={"ID":"6286f237-d319-4e06-b9dc-ce90ed493b77","Type":"ContainerStarted","Data":"2d39d6548a18d3ffd0a95b74e0724d7c0f3976535de22d427f8f60517543334d"}
Jul 14 19:53:17.803177 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:17.803049    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj" event={"ID":"caa4dc4b-017c-4513-a286-6ccdba79dca2","Type":"ContainerStarted","Data":"d753b571b27abe878ccfcba6f3dfe906a490e5133723c89741a664d6cdc73471"}
Jul 14 19:53:17.803177 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:17.803112    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj" event={"ID":"caa4dc4b-017c-4513-a286-6ccdba79dca2","Type":"ContainerStarted","Data":"f607b006dff1e2f5f205e5a2dbb76ce92d89a0ebef8e76dd37a6c3c304cfa3c4"}
Jul 14 19:53:17.803177 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:17.803142    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj" event={"ID":"caa4dc4b-017c-4513-a286-6ccdba79dca2","Type":"ContainerStarted","Data":"9447c4bfeb14e0aad7322c129495c9ee45fa869dc06f061e8039c2c6462ec0ab"}
Jul 14 19:53:17.822200 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:17.822097    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lxh5b" podStartSLOduration=2.85877455 podStartE2EDuration="3.822079357s" totalImagesPullingTime="891.060456ms" totalInitContainerRuntime="72.244351ms" isStatefulPod=true podCreationTimestamp="2026-07-14 19:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:17.821179878 +0000 UTC m=+91.955155971" watchObservedRunningTime="2026-07-14 19:53:17.822079357 +0000 UTC m=+91.956055433"
Jul 14 19:53:17.840918 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:17.840839    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-kxvsj" podStartSLOduration=2.348275068 podStartE2EDuration="3.840817214s" totalImagesPullingTime="1.492542146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:17.839958408 +0000 UTC m=+91.973934506" watchObservedRunningTime="2026-07-14 19:53:17.840817214 +0000 UTC m=+91.974793295"
Jul 14 19:53:17.913814 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:17.913780    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:18.006240 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:18.006202    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:18.158162 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:18.158072    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:19.712281 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:19.712237    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:19.781784 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:19.781741    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:20.757226 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:20.757189    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:20.846304 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:20.846269    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:21.241629 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:21.241584    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:21.324980 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:21.324937    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:21.426685 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:21.426650    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:21.528479 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:21.528389    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:21.628887 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:21.628851    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:23.692268 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:23.692244    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v4k6s"
Jul 14 19:53:31.545312 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:31.545269    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:31.645212 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:31.645179    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:31.741264 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:31.741232    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:33.445577 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:33.445541    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:33.509781 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:33.509749    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:34.605727 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:34.605698    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:34.706519 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:34.706487    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:41.547063 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:41.547018    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:42.911598 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:42.911555    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:43.268491 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:43.268453    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:48.438345 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:48.438305    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:48.512817 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:48.512789    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:50.505533 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:50.505443    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79969f9494-rw7n6_7f80533b-d0ec-4684-9a75-2dc53eae9b4d/router/0.log"
Jul 14 19:53:50.511558 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:50.511535    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-59msp_5475f6af-72c5-4ef5-8dde-4e5cc5840a9f/serve-healthcheck-canary/0.log"
Jul 14 19:53:50.918407 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:50.918317    2584 generic.go:356] "Generic (PLEG): container finished" podID="0e7a9bcc-5144-42c6-9aac-afa5b8f06abc" containerID="73954c35f82a2a1cac15ebfb1f62eea2ac3d4f68fef9cae8e2955df88b7f742d" exitCode=0
Jul 14 19:53:50.918407 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:50.918389    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr" event={"ID":"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc","Type":"ContainerDied","Data":"73954c35f82a2a1cac15ebfb1f62eea2ac3d4f68fef9cae8e2955df88b7f742d"}
Jul 14 19:53:50.918722 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:50.918708    2584 scope.go:117] "RemoveContainer" containerID="73954c35f82a2a1cac15ebfb1f62eea2ac3d4f68fef9cae8e2955df88b7f742d"
Jul 14 19:53:51.924068 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:51.924035    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-xjjtr" event={"ID":"0e7a9bcc-5144-42c6-9aac-afa5b8f06abc","Type":"ContainerStarted","Data":"bbc03f40b897a908c32d07c11379c8fc056842a84ef97e2f51abb858a82a6f9e"}
Jul 14 19:53:52.556256 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:52.556223    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:52.657186 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:53:52.657157    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:04.005405 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:04.005368    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:04.106184 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:04.106145    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:05.014575 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:05.014542    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:10.982244 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:10.982208    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:11.100260 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:11.100217    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:11.201091 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:11.201057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:34.206668 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:34.206628    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:34.776859 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:34.776830    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:43.442800 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:43.442698    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:43.502795 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:43.502754    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:49.529783 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:49.529747    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:49.622075 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:54:49.622043    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:00.517649 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:00.517610    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:00.585421 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:00.585376    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:01.440714 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:01.440674    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:01.811088 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:01.811057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:05.899156 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:05.899123    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:05.999911 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:05.999862    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:06.101127 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:06.101089    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:18.478095 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:18.478053    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:18.571927 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:18.571898    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:20.857240 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:20.857206    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:20.914028 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:20.914000    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:45.935240 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:45.935206    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:46.029826 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:46.029793    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:55:59.894972 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:55:59.894929    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:01.358084 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:01.358046    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:12.372143 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:12.372071    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:13.770488 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:13.770455    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:15.976080 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:15.976037    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:16.075761 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:16.075728    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:17.492996 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:17.492956    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:17.643575 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:17.643537    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:17.948582 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:17.948544    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:18.050303 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:18.050275    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:20.160294 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:20.160253    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:20.349005 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:20.348960    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:22.784354 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:22.784319    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:22.885128 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:22.885084    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:28.558055 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:28.558020    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:29.646090 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:29.646053    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:29.746696 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:29.746666    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:34.406620 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:34.406590    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:34.503180 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:34.503141    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:41.067085 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:41.067048    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:41.167215 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:41.167184    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:42.877609 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:42.877577    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:46.221017 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:46.220987    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 19:56:46.229165 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:46.229138    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 19:56:46.230485 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:46.230460    2584 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 19:56:55.793326 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:55.793280    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:56.804737 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.804694    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"]
Jul 14 19:56:56.808052 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.808027    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:56.811172 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.811138    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 19:56:56.811172 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.811159    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 19:56:56.811348 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.811224    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 19:56:56.811465 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.811449    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 19:56:56.811503 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.811463    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6vqlw\""
Jul 14 19:56:56.824729 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.824704    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"]
Jul 14 19:56:56.904246 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.904214    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f05a4f-2459-4fdd-a341-c6ac0594454e-tmp\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:56.904429 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.904262    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f05a4f-2459-4fdd-a341-c6ac0594454e-webhook-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:56.904429 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.904297    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f05a4f-2459-4fdd-a341-c6ac0594454e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:56.904429 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.904387    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f05a4f-2459-4fdd-a341-c6ac0594454e-manifests\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:56.904429 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:56.904407    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tghxp\" (UniqueName: \"kubernetes.io/projected/14f05a4f-2459-4fdd-a341-c6ac0594454e-kube-api-access-tghxp\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.005468 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.005426    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f05a4f-2459-4fdd-a341-c6ac0594454e-manifests\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.005468 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.005471    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tghxp\" (UniqueName: \"kubernetes.io/projected/14f05a4f-2459-4fdd-a341-c6ac0594454e-kube-api-access-tghxp\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.005685 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.005524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f05a4f-2459-4fdd-a341-c6ac0594454e-tmp\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.005685 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.005551    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f05a4f-2459-4fdd-a341-c6ac0594454e-webhook-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.005685 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.005582    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f05a4f-2459-4fdd-a341-c6ac0594454e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.005946 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.005926    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f05a4f-2459-4fdd-a341-c6ac0594454e-manifests\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.008085 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.008057    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f05a4f-2459-4fdd-a341-c6ac0594454e-tmp\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.008216 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.008196    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f05a4f-2459-4fdd-a341-c6ac0594454e-webhook-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.008256 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.008244    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f05a4f-2459-4fdd-a341-c6ac0594454e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.028237 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.028204    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tghxp\" (UniqueName: \"kubernetes.io/projected/14f05a4f-2459-4fdd-a341-c6ac0594454e-kube-api-access-tghxp\") pod \"opendatahub-operator-controller-manager-786799b55c-2rsr6\" (UID: \"14f05a4f-2459-4fdd-a341-c6ac0594454e\") " pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.118265 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.118173    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:56:57.246799 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.246768    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"]
Jul 14 19:56:57.250038 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.250018    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.253161 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.253123    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 19:56:57.253292 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.253204    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 14 19:56:57.253780 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.253764    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ghbhg\""
Jul 14 19:56:57.253780 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.253774    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 14 19:56:57.253965 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.253829    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 14 19:56:57.254120 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.254105    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:56:57.261172 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.261149    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"]
Jul 14 19:56:57.287598 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.287577    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"]
Jul 14 19:56:57.290439 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:56:57.290415    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f05a4f_2459_4fdd_a341_c6ac0594454e.slice/crio-8879ecb44ea9d52f9951b3dcbcf07fb1737784baf1c377278bcbb3c890371b41 WatchSource:0}: Error finding container 8879ecb44ea9d52f9951b3dcbcf07fb1737784baf1c377278bcbb3c890371b41: Status 404 returned error can't find the container with id 8879ecb44ea9d52f9951b3dcbcf07fb1737784baf1c377278bcbb3c890371b41
Jul 14 19:56:57.292216 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.292201    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:56:57.307998 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.307973    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pxfj\" (UniqueName: \"kubernetes.io/projected/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-kube-api-access-9pxfj\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.308135 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.308012    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-metrics-cert\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.308135 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.308059    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-cert\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.308135 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.308096    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-manager-config\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.408975 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.408851    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-cert\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.408975 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.408920    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-manager-config\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.408975 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.408964    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pxfj\" (UniqueName: \"kubernetes.io/projected/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-kube-api-access-9pxfj\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.409249 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.408986    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-metrics-cert\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.409598 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.409569    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-manager-config\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.411528 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.411507    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-cert\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.411628 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.411549    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-metrics-cert\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.420584 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.420555    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pxfj\" (UniqueName: \"kubernetes.io/projected/1bb4d04f-a3a0-40e6-823e-edb6c8a9669f-kube-api-access-9pxfj\") pod \"lws-controller-manager-7fb95d5d68-m52l5\" (UID: \"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f\") " pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.554704 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.554669    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6" event={"ID":"14f05a4f-2459-4fdd-a341-c6ac0594454e","Type":"ContainerStarted","Data":"8879ecb44ea9d52f9951b3dcbcf07fb1737784baf1c377278bcbb3c890371b41"}
Jul 14 19:56:57.559834 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.559816    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:56:57.699402 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:57.699373    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"]
Jul 14 19:56:57.702321 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:56:57.702294    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb4d04f_a3a0_40e6_823e_edb6c8a9669f.slice/crio-7caaba31a88c8576648ee25fddc0c33397b5559c325d020032f32aa7983b9990 WatchSource:0}: Error finding container 7caaba31a88c8576648ee25fddc0c33397b5559c325d020032f32aa7983b9990: Status 404 returned error can't find the container with id 7caaba31a88c8576648ee25fddc0c33397b5559c325d020032f32aa7983b9990
Jul 14 19:56:58.086887 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:58.086727    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:58.560820 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:56:58.560748    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5" event={"ID":"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f","Type":"ContainerStarted","Data":"7caaba31a88c8576648ee25fddc0c33397b5559c325d020032f32aa7983b9990"}
Jul 14 19:57:00.575430 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:00.575306    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6" event={"ID":"14f05a4f-2459-4fdd-a341-c6ac0594454e","Type":"ContainerStarted","Data":"1061d51031286379c65c315307f414b214a032fd20d94747668ea6e99a698f5a"}
Jul 14 19:57:02.584232 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:02.584198    2584 generic.go:356] "Generic (PLEG): container finished" podID="14f05a4f-2459-4fdd-a341-c6ac0594454e" containerID="1061d51031286379c65c315307f414b214a032fd20d94747668ea6e99a698f5a" exitCode=0
Jul 14 19:57:02.584669 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:02.584270    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6" event={"ID":"14f05a4f-2459-4fdd-a341-c6ac0594454e","Type":"ContainerDied","Data":"1061d51031286379c65c315307f414b214a032fd20d94747668ea6e99a698f5a"}
Jul 14 19:57:02.585894 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:02.585859    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5" event={"ID":"1bb4d04f-a3a0-40e6-823e-edb6c8a9669f","Type":"ContainerStarted","Data":"2529224068eba46a54c330bcacbd77c54ea366dbbad463be227d442de4e0bcd3"}
Jul 14 19:57:02.586015 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:02.585999    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:57:02.629166 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:02.629118    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5" podStartSLOduration=1.197372586 podStartE2EDuration="5.629061434s" totalImagesPullingTime="4.431688848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:02.628177668 +0000 UTC m=+316.762153749" watchObservedRunningTime="2026-07-14 19:57:02.629061434 +0000 UTC m=+316.763037514"
Jul 14 19:57:03.591664 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:03.591630    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6" event={"ID":"14f05a4f-2459-4fdd-a341-c6ac0594454e","Type":"ContainerStarted","Data":"8f1a6636a81ec863205999e979fed404090d6936e2a403566d5d1d2fb06090e9"}
Jul 14 19:57:03.592070 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:03.591844    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:57:03.618202 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:03.618117    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6" podStartSLOduration=2.879218451 podStartE2EDuration="7.618101078s" totalImagesPullingTime="3.318444073s" totalInitContainerRuntime="1.420438554s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:56:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:03.617727871 +0000 UTC m=+317.751703950" watchObservedRunningTime="2026-07-14 19:57:03.618101078 +0000 UTC m=+317.752077157"
Jul 14 19:57:06.305268 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:06.305231    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:06.362450 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:06.362423    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:08.038963 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:08.038922    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:08.141953 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:08.141921    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:13.593728 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:13.593698    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fb95d5d68-m52l5"
Jul 14 19:57:14.601759 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:14.601729    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-786799b55c-2rsr6"
Jul 14 19:57:15.848974 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:15.848933    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:16.402523 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:16.402486    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:16.582542 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:16.582506    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:16.894692 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:16.894655    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:17.004210 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.004182    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"]
Jul 14 19:57:17.012632 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.012603    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"
Jul 14 19:57:17.018762 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.018721    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 19:57:17.018858 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.018775    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t49bn\""
Jul 14 19:57:17.018938 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.018905    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 19:57:17.032567 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.032542    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"]
Jul 14 19:57:17.108010 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.107978    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:17.173359 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.173274    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xznhh\" (UniqueName: \"kubernetes.io/projected/3409785f-0f87-4bad-aa10-95e4167084f7-kube-api-access-xznhh\") pod \"kube-auth-proxy-59df779c5f-hd2qp\" (UID: \"3409785f-0f87-4bad-aa10-95e4167084f7\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"
Jul 14 19:57:17.173359 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.173319    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3409785f-0f87-4bad-aa10-95e4167084f7-tmp\") pod \"kube-auth-proxy-59df779c5f-hd2qp\" (UID: \"3409785f-0f87-4bad-aa10-95e4167084f7\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"
Jul 14 19:57:17.173359 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.173341    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3409785f-0f87-4bad-aa10-95e4167084f7-tls-certs\") pod \"kube-auth-proxy-59df779c5f-hd2qp\" (UID: \"3409785f-0f87-4bad-aa10-95e4167084f7\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"
Jul 14 19:57:17.274739 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.274701    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3409785f-0f87-4bad-aa10-95e4167084f7-tmp\") pod \"kube-auth-proxy-59df779c5f-hd2qp\" (UID: \"3409785f-0f87-4bad-aa10-95e4167084f7\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"
Jul 14 19:57:17.274739 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.274741    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3409785f-0f87-4bad-aa10-95e4167084f7-tls-certs\") pod \"kube-auth-proxy-59df779c5f-hd2qp\" (UID: \"3409785f-0f87-4bad-aa10-95e4167084f7\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"
Jul 14 19:57:17.275028 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.274791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xznhh\" (UniqueName: \"kubernetes.io/projected/3409785f-0f87-4bad-aa10-95e4167084f7-kube-api-access-xznhh\") pod \"kube-auth-proxy-59df779c5f-hd2qp\" (UID: \"3409785f-0f87-4bad-aa10-95e4167084f7\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"
Jul 14 19:57:17.277410 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.277379    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3409785f-0f87-4bad-aa10-95e4167084f7-tmp\") pod \"kube-auth-proxy-59df779c5f-hd2qp\" (UID: \"3409785f-0f87-4bad-aa10-95e4167084f7\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"
Jul 14 19:57:17.277556 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.277524    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3409785f-0f87-4bad-aa10-95e4167084f7-tls-certs\") pod \"kube-auth-proxy-59df779c5f-hd2qp\" (UID: \"3409785f-0f87-4bad-aa10-95e4167084f7\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"
Jul 14 19:57:17.333204 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.333171    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xznhh\" (UniqueName: \"kubernetes.io/projected/3409785f-0f87-4bad-aa10-95e4167084f7-kube-api-access-xznhh\") pod \"kube-auth-proxy-59df779c5f-hd2qp\" (UID: \"3409785f-0f87-4bad-aa10-95e4167084f7\") " pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"
Jul 14 19:57:17.453825 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.453778    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:17.586753 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.586718    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:17.621933 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.621894    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"
Jul 14 19:57:17.695817 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.695692    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:17.781583 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:17.781549    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp"]
Jul 14 19:57:17.790266 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:57:17.790103    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3409785f_0f87_4bad_aa10_95e4167084f7.slice/crio-2bac74818b4a5417a4c3bed486a5641993fe724ac2bf7c153458e9e8e00df556 WatchSource:0}: Error finding container 2bac74818b4a5417a4c3bed486a5641993fe724ac2bf7c153458e9e8e00df556: Status 404 returned error can't find the container with id 2bac74818b4a5417a4c3bed486a5641993fe724ac2bf7c153458e9e8e00df556
Jul 14 19:57:18.429014 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:18.428981    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:18.594142 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:18.594107    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:18.650610 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:18.650581    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp" event={"ID":"3409785f-0f87-4bad-aa10-95e4167084f7","Type":"ContainerStarted","Data":"2bac74818b4a5417a4c3bed486a5641993fe724ac2bf7c153458e9e8e00df556"}
Jul 14 19:57:18.693456 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:18.693364    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:18.909207 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:18.909172    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:19.766306 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:19.766269    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:21.663124 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:21.663086    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp" event={"ID":"3409785f-0f87-4bad-aa10-95e4167084f7","Type":"ContainerStarted","Data":"d7ef888e713496ef253c49a97cdec041ddb0858e8b76bdc40a911e7644567895"}
Jul 14 19:57:21.680883 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:21.680820    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59df779c5f-hd2qp" podStartSLOduration=2.8429141060000003 podStartE2EDuration="5.680798116s" totalImagesPullingTime="2.83788401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:57:21.680774072 +0000 UTC m=+335.814750153" watchObservedRunningTime="2026-07-14 19:57:21.680798116 +0000 UTC m=+335.814774198"
Jul 14 19:57:24.467127 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:24.467083    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:24.605586 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:24.605554    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:25.492010 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:25.491979    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:25.576202 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:25.576169    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:25.681541 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:25.681508    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:29.191541 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:29.191505    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:29.317090 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:29.317038    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:29.423728 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:29.423686    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:29.522389 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:29.522334    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:29.669405 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:29.669370    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:30.371605 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:30.371573    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:32.015023 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:32.014992    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:32.188498 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:32.188464    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:34.725549 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:34.725497    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:34.824745 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:34.824699    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:48.451463 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:48.451385    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:48.516707 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:57:48.516667    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:17.989567 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:17.989528    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:18.132781 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:18.132746    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:18.247864 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:18.247770    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:47.674436 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:47.674407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:48.292143 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:48.292112    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:53.095846 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:53.095813    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:55.200234 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:55.200199    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:55.430070 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:55.430031    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:56.182447 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:56.182408    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:56.940656 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:56.940623    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:59.136220 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:59.136186    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:59.651741 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:58:59.651700    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:02.783720 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:02.783681    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:04.697370 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:04.697338    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:04.798387 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:04.798344    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:05.119941 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:05.119801    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:05.217710 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:05.217671    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:08.717762 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:08.717684    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:08.818379 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:08.818334    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:12.464119 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.464079    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"]
Jul 14 19:59:12.467044 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.467024    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"
Jul 14 19:59:12.469320 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.469296    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 14 19:59:12.469569 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.469553    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 14 19:59:12.469636 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.469588    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 19:59:12.469695 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.469678    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 19:59:12.470515 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.470497    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mpbkm\""
Jul 14 19:59:12.476243 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.476205    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"]
Jul 14 19:59:12.476530 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.476501    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:12.529145 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.529108    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/23b9aed2-db8c-4ea6-b859-9da269edac8f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6bpsq\" (UID: \"23b9aed2-db8c-4ea6-b859-9da269edac8f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"
Jul 14 19:59:12.529145 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.529147    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/23b9aed2-db8c-4ea6-b859-9da269edac8f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6bpsq\" (UID: \"23b9aed2-db8c-4ea6-b859-9da269edac8f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"
Jul 14 19:59:12.529359 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.529187    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lnxv\" (UniqueName: \"kubernetes.io/projected/23b9aed2-db8c-4ea6-b859-9da269edac8f-kube-api-access-2lnxv\") pod \"kuadrant-console-plugin-66b5774985-6bpsq\" (UID: \"23b9aed2-db8c-4ea6-b859-9da269edac8f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"
Jul 14 19:59:12.629511 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.629472    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/23b9aed2-db8c-4ea6-b859-9da269edac8f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6bpsq\" (UID: \"23b9aed2-db8c-4ea6-b859-9da269edac8f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"
Jul 14 19:59:12.629511 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.629507    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/23b9aed2-db8c-4ea6-b859-9da269edac8f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6bpsq\" (UID: \"23b9aed2-db8c-4ea6-b859-9da269edac8f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"
Jul 14 19:59:12.629723 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.629536    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lnxv\" (UniqueName: \"kubernetes.io/projected/23b9aed2-db8c-4ea6-b859-9da269edac8f-kube-api-access-2lnxv\") pod \"kuadrant-console-plugin-66b5774985-6bpsq\" (UID: \"23b9aed2-db8c-4ea6-b859-9da269edac8f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"
Jul 14 19:59:12.630217 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.630191    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/23b9aed2-db8c-4ea6-b859-9da269edac8f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6bpsq\" (UID: \"23b9aed2-db8c-4ea6-b859-9da269edac8f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"
Jul 14 19:59:12.632105 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.632083    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/23b9aed2-db8c-4ea6-b859-9da269edac8f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6bpsq\" (UID: \"23b9aed2-db8c-4ea6-b859-9da269edac8f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"
Jul 14 19:59:12.638717 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.638692    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lnxv\" (UniqueName: \"kubernetes.io/projected/23b9aed2-db8c-4ea6-b859-9da269edac8f-kube-api-access-2lnxv\") pod \"kuadrant-console-plugin-66b5774985-6bpsq\" (UID: \"23b9aed2-db8c-4ea6-b859-9da269edac8f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"
Jul 14 19:59:12.645172 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.645146    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:12.746104 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.746009    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:12.777098 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.777066    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"
Jul 14 19:59:12.847407 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.847372    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:12.908411 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:12.908380    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq"]
Jul 14 19:59:12.911306 ip-10-0-142-56 kubenswrapper[2584]: W0714 19:59:12.911276    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23b9aed2_db8c_4ea6_b859_9da269edac8f.slice/crio-d10d3bea34962223fbc939bad44287e6c0677c8d059a58ba3537c3bb0e6cc51e WatchSource:0}: Error finding container d10d3bea34962223fbc939bad44287e6c0677c8d059a58ba3537c3bb0e6cc51e: Status 404 returned error can't find the container with id d10d3bea34962223fbc939bad44287e6c0677c8d059a58ba3537c3bb0e6cc51e
Jul 14 19:59:13.063672 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:13.063589    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq" event={"ID":"23b9aed2-db8c-4ea6-b859-9da269edac8f","Type":"ContainerStarted","Data":"d10d3bea34962223fbc939bad44287e6c0677c8d059a58ba3537c3bb0e6cc51e"}
Jul 14 19:59:16.242691 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:16.242647    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:16.341945 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:16.341903    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:24.158620 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:24.158576    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:24.261033 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:24.260990    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:24.704044 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:24.703998    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:24.802797 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:24.802731    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:27.072738 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:27.072665    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:27.173265 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:27.173230    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:32.408853 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:32.408809    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:32.513168 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:32.513129    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:34.822522 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:34.822484    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:34.924537 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:34.924504    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:37.168558 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:37.168525    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq" event={"ID":"23b9aed2-db8c-4ea6-b859-9da269edac8f","Type":"ContainerStarted","Data":"f43697a4ce7ddb9d846608bbdd864b6df895305e882b541673dc54fc8a4cf4f0"}
Jul 14 19:59:37.194680 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:37.194627    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6bpsq" podStartSLOduration=1.9661070980000002 podStartE2EDuration="25.194610711s" totalImagesPullingTime="23.228503613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:59:37.193519293 +0000 UTC m=+471.327495376" watchObservedRunningTime="2026-07-14 19:59:37.194610711 +0000 UTC m=+471.328586838"
Jul 14 19:59:51.518482 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:51.518444    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:51.836755 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:51.836667    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:56.570908 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:56.570858    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 19:59:56.626190 ip-10-0-142-56 kubenswrapper[2584]: I0714 19:59:56.626159    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:06.538606 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:06.538567    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:06.636284 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:06.636243    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:07.371084 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.371055    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hx4wp"]
Jul 14 20:00:07.375388 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.375366    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hx4wp"
Jul 14 20:00:07.378021 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.378005    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l52gg\""
Jul 14 20:00:07.381789 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.381764    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hx4wp"]
Jul 14 20:00:07.384413 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.384384    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h9sc\" (UniqueName: \"kubernetes.io/projected/58e29054-30e9-442c-a436-24c44af5fb8c-kube-api-access-8h9sc\") pod \"authorino-58cd955675-hx4wp\" (UID: \"58e29054-30e9-442c-a436-24c44af5fb8c\") " pod="kuadrant-system/authorino-58cd955675-hx4wp"
Jul 14 20:00:07.400333 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.400303    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:07.485438 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.485400    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h9sc\" (UniqueName: \"kubernetes.io/projected/58e29054-30e9-442c-a436-24c44af5fb8c-kube-api-access-8h9sc\") pod \"authorino-58cd955675-hx4wp\" (UID: \"58e29054-30e9-442c-a436-24c44af5fb8c\") " pod="kuadrant-system/authorino-58cd955675-hx4wp"
Jul 14 20:00:07.494476 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.494449    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h9sc\" (UniqueName: \"kubernetes.io/projected/58e29054-30e9-442c-a436-24c44af5fb8c-kube-api-access-8h9sc\") pod \"authorino-58cd955675-hx4wp\" (UID: \"58e29054-30e9-442c-a436-24c44af5fb8c\") " pod="kuadrant-system/authorino-58cd955675-hx4wp"
Jul 14 20:00:07.567679 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.567643    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5k76"]
Jul 14 20:00:07.569820 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.569804    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5k76"
Jul 14 20:00:07.579666 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.579633    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5k76"]
Jul 14 20:00:07.585766 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.585742    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xn4q\" (UniqueName: \"kubernetes.io/projected/b89686f6-32af-49e9-9857-41ce25cb99e1-kube-api-access-8xn4q\") pod \"authorino-75d556bd77-n5k76\" (UID: \"b89686f6-32af-49e9-9857-41ce25cb99e1\") " pod="kuadrant-system/authorino-75d556bd77-n5k76"
Jul 14 20:00:07.685699 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.685607    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hx4wp"
Jul 14 20:00:07.686910 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.686862    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xn4q\" (UniqueName: \"kubernetes.io/projected/b89686f6-32af-49e9-9857-41ce25cb99e1-kube-api-access-8xn4q\") pod \"authorino-75d556bd77-n5k76\" (UID: \"b89686f6-32af-49e9-9857-41ce25cb99e1\") " pod="kuadrant-system/authorino-75d556bd77-n5k76"
Jul 14 20:00:07.696477 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.696455    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xn4q\" (UniqueName: \"kubernetes.io/projected/b89686f6-32af-49e9-9857-41ce25cb99e1-kube-api-access-8xn4q\") pod \"authorino-75d556bd77-n5k76\" (UID: \"b89686f6-32af-49e9-9857-41ce25cb99e1\") " pod="kuadrant-system/authorino-75d556bd77-n5k76"
Jul 14 20:00:07.818389 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.818345    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hx4wp"]
Jul 14 20:00:07.821546 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:00:07.821513    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58e29054_30e9_442c_a436_24c44af5fb8c.slice/crio-d0b2bc55ab088407137b935fb72943b0f4e1eda0852d9279bbba69c79c38510d WatchSource:0}: Error finding container d0b2bc55ab088407137b935fb72943b0f4e1eda0852d9279bbba69c79c38510d: Status 404 returned error can't find the container with id d0b2bc55ab088407137b935fb72943b0f4e1eda0852d9279bbba69c79c38510d
Jul 14 20:00:07.879580 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:07.879543    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5k76"
Jul 14 20:00:08.007642 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:08.007612    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5k76"]
Jul 14 20:00:08.010630 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:00:08.010606    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb89686f6_32af_49e9_9857_41ce25cb99e1.slice/crio-a042ff026249fb3d2392dec657d3f8394eb355f83ad41b42490fb2644569db81 WatchSource:0}: Error finding container a042ff026249fb3d2392dec657d3f8394eb355f83ad41b42490fb2644569db81: Status 404 returned error can't find the container with id a042ff026249fb3d2392dec657d3f8394eb355f83ad41b42490fb2644569db81
Jul 14 20:00:08.279614 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:08.279518    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5k76" event={"ID":"b89686f6-32af-49e9-9857-41ce25cb99e1","Type":"ContainerStarted","Data":"a042ff026249fb3d2392dec657d3f8394eb355f83ad41b42490fb2644569db81"}
Jul 14 20:00:08.280708 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:08.280683    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hx4wp" event={"ID":"58e29054-30e9-442c-a436-24c44af5fb8c","Type":"ContainerStarted","Data":"d0b2bc55ab088407137b935fb72943b0f4e1eda0852d9279bbba69c79c38510d"}
Jul 14 20:00:09.359817 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:09.359781    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:12.302404 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:12.302361    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hx4wp" event={"ID":"58e29054-30e9-442c-a436-24c44af5fb8c","Type":"ContainerStarted","Data":"b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792"}
Jul 14 20:00:12.303831 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:12.303807    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5k76" event={"ID":"b89686f6-32af-49e9-9857-41ce25cb99e1","Type":"ContainerStarted","Data":"ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf"}
Jul 14 20:00:12.319467 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:12.319408    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hx4wp" podStartSLOduration=1.800381743 podStartE2EDuration="5.319391572s" totalImagesPullingTime="3.519009829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:12.318126245 +0000 UTC m=+506.452102325" watchObservedRunningTime="2026-07-14 20:00:12.319391572 +0000 UTC m=+506.453367652"
Jul 14 20:00:12.333363 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:12.333312    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-n5k76" podStartSLOduration=2.007070729 podStartE2EDuration="5.333295524s" totalImagesPullingTime="3.326224795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:12.333253322 +0000 UTC m=+506.467229403" watchObservedRunningTime="2026-07-14 20:00:12.333295524 +0000 UTC m=+506.467271604"
Jul 14 20:00:12.364509 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:12.364477    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hx4wp"]
Jul 14 20:00:14.311473 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:14.311434    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hx4wp" podUID="58e29054-30e9-442c-a436-24c44af5fb8c" containerName="authorino" containerID="cri-o://b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792" gracePeriod=30
Jul 14 20:00:14.560796 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:14.560771    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hx4wp"
Jul 14 20:00:14.649261 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:14.649168    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h9sc\" (UniqueName: \"kubernetes.io/projected/58e29054-30e9-442c-a436-24c44af5fb8c-kube-api-access-8h9sc\") pod \"58e29054-30e9-442c-a436-24c44af5fb8c\" (UID: \"58e29054-30e9-442c-a436-24c44af5fb8c\") "
Jul 14 20:00:14.651459 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:14.651436    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e29054-30e9-442c-a436-24c44af5fb8c-kube-api-access-8h9sc" (OuterVolumeSpecName: "kube-api-access-8h9sc") pod "58e29054-30e9-442c-a436-24c44af5fb8c" (UID: "58e29054-30e9-442c-a436-24c44af5fb8c"). InnerVolumeSpecName "kube-api-access-8h9sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:00:14.749681 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:14.749652    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h9sc\" (UniqueName: \"kubernetes.io/projected/58e29054-30e9-442c-a436-24c44af5fb8c-kube-api-access-8h9sc\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:00:15.316124 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:15.316094    2584 generic.go:356] "Generic (PLEG): container finished" podID="58e29054-30e9-442c-a436-24c44af5fb8c" containerID="b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792" exitCode=0
Jul 14 20:00:15.316562 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:15.316139    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hx4wp"
Jul 14 20:00:15.316562 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:15.316143    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hx4wp" event={"ID":"58e29054-30e9-442c-a436-24c44af5fb8c","Type":"ContainerDied","Data":"b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792"}
Jul 14 20:00:15.316562 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:15.316236    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hx4wp" event={"ID":"58e29054-30e9-442c-a436-24c44af5fb8c","Type":"ContainerDied","Data":"d0b2bc55ab088407137b935fb72943b0f4e1eda0852d9279bbba69c79c38510d"}
Jul 14 20:00:15.316970 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:15.316252    2584 scope.go:117] "RemoveContainer" containerID="b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792"
Jul 14 20:00:15.325485 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:15.325464    2584 scope.go:117] "RemoveContainer" containerID="b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792"
Jul 14 20:00:15.325790 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:00:15.325772    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792\": container with ID starting with b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792 not found: ID does not exist" containerID="b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792"
Jul 14 20:00:15.325840 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:15.325800    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792"} err="failed to get container status \"b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792\": rpc error: code = NotFound desc = could not find container \"b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792\": container with ID starting with b699321a0295dcf032416be650ee11166fe98e66944d5cfaaf8717e29d086792 not found: ID does not exist"
Jul 14 20:00:15.337235 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:15.337203    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hx4wp"]
Jul 14 20:00:15.343584 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:15.343557    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hx4wp"]
Jul 14 20:00:16.358721 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:16.358684    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e29054-30e9-442c-a436-24c44af5fb8c" path="/var/lib/kubelet/pods/58e29054-30e9-442c-a436-24c44af5fb8c/volumes"
Jul 14 20:00:27.410553 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:27.410509    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:27.515685 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:27.515652    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:37.979587 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:37.979501    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptg44"]
Jul 14 20:00:37.980008 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:37.979771    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e29054-30e9-442c-a436-24c44af5fb8c" containerName="authorino"
Jul 14 20:00:37.980008 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:37.979781    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e29054-30e9-442c-a436-24c44af5fb8c" containerName="authorino"
Jul 14 20:00:37.980008 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:37.979831    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e29054-30e9-442c-a436-24c44af5fb8c" containerName="authorino"
Jul 14 20:00:37.981530 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:37.981514    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptg44"
Jul 14 20:00:37.990504 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:37.990480    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptg44"]
Jul 14 20:00:38.029356 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.029314    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w47vq\" (UniqueName: \"kubernetes.io/projected/b2cf5483-e236-4837-8804-c7a51aeabce6-kube-api-access-w47vq\") pod \"authorino-5d4b67c446-ptg44\" (UID: \"b2cf5483-e236-4837-8804-c7a51aeabce6\") " pod="kuadrant-system/authorino-5d4b67c446-ptg44"
Jul 14 20:00:38.117104 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.117071    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:38.130735 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.130711    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w47vq\" (UniqueName: \"kubernetes.io/projected/b2cf5483-e236-4837-8804-c7a51aeabce6-kube-api-access-w47vq\") pod \"authorino-5d4b67c446-ptg44\" (UID: \"b2cf5483-e236-4837-8804-c7a51aeabce6\") " pod="kuadrant-system/authorino-5d4b67c446-ptg44"
Jul 14 20:00:38.139746 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.139721    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w47vq\" (UniqueName: \"kubernetes.io/projected/b2cf5483-e236-4837-8804-c7a51aeabce6-kube-api-access-w47vq\") pod \"authorino-5d4b67c446-ptg44\" (UID: \"b2cf5483-e236-4837-8804-c7a51aeabce6\") " pod="kuadrant-system/authorino-5d4b67c446-ptg44"
Jul 14 20:00:38.219958 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.219921    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptg44"]
Jul 14 20:00:38.220182 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.220168    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptg44"
Jul 14 20:00:38.220561 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.220536    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:38.254797 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.254765    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65fc58c59d-qpgpn"]
Jul 14 20:00:38.257194 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.257174    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65fc58c59d-qpgpn"
Jul 14 20:00:38.267801 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.267773    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65fc58c59d-qpgpn"]
Jul 14 20:00:38.332430 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.332397    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7c2j\" (UniqueName: \"kubernetes.io/projected/212b32ba-66a8-49d2-8654-4fd176e5310c-kube-api-access-v7c2j\") pod \"authorino-65fc58c59d-qpgpn\" (UID: \"212b32ba-66a8-49d2-8654-4fd176e5310c\") " pod="kuadrant-system/authorino-65fc58c59d-qpgpn"
Jul 14 20:00:38.361532 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.361496    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptg44"]
Jul 14 20:00:38.364499 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:00:38.364465    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2cf5483_e236_4837_8804_c7a51aeabce6.slice/crio-06c88ff6d436fa8f2acad7212c9fda2ca40b49ec6e3cb28521706b434d40e47a WatchSource:0}: Error finding container 06c88ff6d436fa8f2acad7212c9fda2ca40b49ec6e3cb28521706b434d40e47a: Status 404 returned error can't find the container with id 06c88ff6d436fa8f2acad7212c9fda2ca40b49ec6e3cb28521706b434d40e47a
Jul 14 20:00:38.407888 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.407833    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptg44" event={"ID":"b2cf5483-e236-4837-8804-c7a51aeabce6","Type":"ContainerStarted","Data":"06c88ff6d436fa8f2acad7212c9fda2ca40b49ec6e3cb28521706b434d40e47a"}
Jul 14 20:00:38.433260 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.433222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7c2j\" (UniqueName: \"kubernetes.io/projected/212b32ba-66a8-49d2-8654-4fd176e5310c-kube-api-access-v7c2j\") pod \"authorino-65fc58c59d-qpgpn\" (UID: \"212b32ba-66a8-49d2-8654-4fd176e5310c\") " pod="kuadrant-system/authorino-65fc58c59d-qpgpn"
Jul 14 20:00:38.442486 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.442456    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7c2j\" (UniqueName: \"kubernetes.io/projected/212b32ba-66a8-49d2-8654-4fd176e5310c-kube-api-access-v7c2j\") pod \"authorino-65fc58c59d-qpgpn\" (UID: \"212b32ba-66a8-49d2-8654-4fd176e5310c\") " pod="kuadrant-system/authorino-65fc58c59d-qpgpn"
Jul 14 20:00:38.443562 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.443542    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65fc58c59d-qpgpn"]
Jul 14 20:00:38.443768 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.443757    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65fc58c59d-qpgpn"
Jul 14 20:00:38.476444 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.476412    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8d85fd9b6-xcf54"]
Jul 14 20:00:38.478730 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.478704    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8d85fd9b6-xcf54"
Jul 14 20:00:38.482109 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.482053    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 14 20:00:38.488091 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.488065    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8d85fd9b6-xcf54"]
Jul 14 20:00:38.534550 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.534519    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-tls-cert\") pod \"authorino-8d85fd9b6-xcf54\" (UID: \"9c8bcf90-0547-4a68-ac47-bd3a1df4f802\") " pod="kuadrant-system/authorino-8d85fd9b6-xcf54"
Jul 14 20:00:38.534705 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.534582    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z42bb\" (UniqueName: \"kubernetes.io/projected/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-kube-api-access-z42bb\") pod \"authorino-8d85fd9b6-xcf54\" (UID: \"9c8bcf90-0547-4a68-ac47-bd3a1df4f802\") " pod="kuadrant-system/authorino-8d85fd9b6-xcf54"
Jul 14 20:00:38.578470 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.578439    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65fc58c59d-qpgpn"]
Jul 14 20:00:38.581799 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:00:38.581772    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod212b32ba_66a8_49d2_8654_4fd176e5310c.slice/crio-e6475748fccb7a76061677f307f9cab7a05884c1e1da1c6c7cc19da7a6fffd21 WatchSource:0}: Error finding container e6475748fccb7a76061677f307f9cab7a05884c1e1da1c6c7cc19da7a6fffd21: Status 404 returned error can't find the container with id e6475748fccb7a76061677f307f9cab7a05884c1e1da1c6c7cc19da7a6fffd21
Jul 14 20:00:38.635944 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.635898    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-tls-cert\") pod \"authorino-8d85fd9b6-xcf54\" (UID: \"9c8bcf90-0547-4a68-ac47-bd3a1df4f802\") " pod="kuadrant-system/authorino-8d85fd9b6-xcf54"
Jul 14 20:00:38.635944 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.635949    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z42bb\" (UniqueName: \"kubernetes.io/projected/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-kube-api-access-z42bb\") pod \"authorino-8d85fd9b6-xcf54\" (UID: \"9c8bcf90-0547-4a68-ac47-bd3a1df4f802\") " pod="kuadrant-system/authorino-8d85fd9b6-xcf54"
Jul 14 20:00:38.638649 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.638618    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-tls-cert\") pod \"authorino-8d85fd9b6-xcf54\" (UID: \"9c8bcf90-0547-4a68-ac47-bd3a1df4f802\") " pod="kuadrant-system/authorino-8d85fd9b6-xcf54"
Jul 14 20:00:38.646024 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.645949    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z42bb\" (UniqueName: \"kubernetes.io/projected/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-kube-api-access-z42bb\") pod \"authorino-8d85fd9b6-xcf54\" (UID: \"9c8bcf90-0547-4a68-ac47-bd3a1df4f802\") " pod="kuadrant-system/authorino-8d85fd9b6-xcf54"
Jul 14 20:00:38.790156 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.790074    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8d85fd9b6-xcf54"
Jul 14 20:00:38.918725 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:38.918694    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8d85fd9b6-xcf54"]
Jul 14 20:00:38.921590 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:00:38.921562    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c8bcf90_0547_4a68_ac47_bd3a1df4f802.slice/crio-a321adc950fb31d324c666879dfb1c91ed176575e0054776428f66dc952a3c3a WatchSource:0}: Error finding container a321adc950fb31d324c666879dfb1c91ed176575e0054776428f66dc952a3c3a: Status 404 returned error can't find the container with id a321adc950fb31d324c666879dfb1c91ed176575e0054776428f66dc952a3c3a
Jul 14 20:00:39.413034 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.413000    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptg44" event={"ID":"b2cf5483-e236-4837-8804-c7a51aeabce6","Type":"ContainerStarted","Data":"5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9"}
Jul 14 20:00:39.413673 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.413048    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-ptg44" podUID="b2cf5483-e236-4837-8804-c7a51aeabce6" containerName="authorino" containerID="cri-o://5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9" gracePeriod=30
Jul 14 20:00:39.414388 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.414357    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8d85fd9b6-xcf54" event={"ID":"9c8bcf90-0547-4a68-ac47-bd3a1df4f802","Type":"ContainerStarted","Data":"a321adc950fb31d324c666879dfb1c91ed176575e0054776428f66dc952a3c3a"}
Jul 14 20:00:39.415760 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.415730    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65fc58c59d-qpgpn" event={"ID":"212b32ba-66a8-49d2-8654-4fd176e5310c","Type":"ContainerStarted","Data":"fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da"}
Jul 14 20:00:39.415886 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.415769    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65fc58c59d-qpgpn" event={"ID":"212b32ba-66a8-49d2-8654-4fd176e5310c","Type":"ContainerStarted","Data":"e6475748fccb7a76061677f307f9cab7a05884c1e1da1c6c7cc19da7a6fffd21"}
Jul 14 20:00:39.415886 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.415785    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-65fc58c59d-qpgpn" podUID="212b32ba-66a8-49d2-8654-4fd176e5310c" containerName="authorino" containerID="cri-o://fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da" gracePeriod=30
Jul 14 20:00:39.428738 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.428687    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-ptg44" podStartSLOduration=2.151849686 podStartE2EDuration="2.428667788s" totalImagesPullingTime="276.818102ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:39.427915689 +0000 UTC m=+533.561891771" watchObservedRunningTime="2026-07-14 20:00:39.428667788 +0000 UTC m=+533.562643877"
Jul 14 20:00:39.444989 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.444946    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65fc58c59d-qpgpn" podStartSLOduration=1.101281457 podStartE2EDuration="1.444930707s" totalImagesPullingTime="343.64925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:39.443394669 +0000 UTC m=+533.577370742" watchObservedRunningTime="2026-07-14 20:00:39.444930707 +0000 UTC m=+533.578906789"
Jul 14 20:00:39.689303 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.689276    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65fc58c59d-qpgpn"
Jul 14 20:00:39.692442 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.692421    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptg44"
Jul 14 20:00:39.745437 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.745400    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7c2j\" (UniqueName: \"kubernetes.io/projected/212b32ba-66a8-49d2-8654-4fd176e5310c-kube-api-access-v7c2j\") pod \"212b32ba-66a8-49d2-8654-4fd176e5310c\" (UID: \"212b32ba-66a8-49d2-8654-4fd176e5310c\") "
Jul 14 20:00:39.745621 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.745510    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w47vq\" (UniqueName: \"kubernetes.io/projected/b2cf5483-e236-4837-8804-c7a51aeabce6-kube-api-access-w47vq\") pod \"b2cf5483-e236-4837-8804-c7a51aeabce6\" (UID: \"b2cf5483-e236-4837-8804-c7a51aeabce6\") "
Jul 14 20:00:39.747600 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.747570    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/212b32ba-66a8-49d2-8654-4fd176e5310c-kube-api-access-v7c2j" (OuterVolumeSpecName: "kube-api-access-v7c2j") pod "212b32ba-66a8-49d2-8654-4fd176e5310c" (UID: "212b32ba-66a8-49d2-8654-4fd176e5310c"). InnerVolumeSpecName "kube-api-access-v7c2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:00:39.747710 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.747608    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2cf5483-e236-4837-8804-c7a51aeabce6-kube-api-access-w47vq" (OuterVolumeSpecName: "kube-api-access-w47vq") pod "b2cf5483-e236-4837-8804-c7a51aeabce6" (UID: "b2cf5483-e236-4837-8804-c7a51aeabce6"). InnerVolumeSpecName "kube-api-access-w47vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:00:39.846313 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.846280    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7c2j\" (UniqueName: \"kubernetes.io/projected/212b32ba-66a8-49d2-8654-4fd176e5310c-kube-api-access-v7c2j\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:00:39.846313 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:39.846310    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w47vq\" (UniqueName: \"kubernetes.io/projected/b2cf5483-e236-4837-8804-c7a51aeabce6-kube-api-access-w47vq\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:00:40.420615 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.420524    2584 generic.go:356] "Generic (PLEG): container finished" podID="b2cf5483-e236-4837-8804-c7a51aeabce6" containerID="5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9" exitCode=0
Jul 14 20:00:40.420615 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.420573    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptg44"
Jul 14 20:00:40.421177 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.420619    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptg44" event={"ID":"b2cf5483-e236-4837-8804-c7a51aeabce6","Type":"ContainerDied","Data":"5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9"}
Jul 14 20:00:40.421177 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.420660    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptg44" event={"ID":"b2cf5483-e236-4837-8804-c7a51aeabce6","Type":"ContainerDied","Data":"06c88ff6d436fa8f2acad7212c9fda2ca40b49ec6e3cb28521706b434d40e47a"}
Jul 14 20:00:40.421177 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.420681    2584 scope.go:117] "RemoveContainer" containerID="5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9"
Jul 14 20:00:40.421954 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.421934    2584 generic.go:356] "Generic (PLEG): container finished" podID="212b32ba-66a8-49d2-8654-4fd176e5310c" containerID="fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da" exitCode=0
Jul 14 20:00:40.422040 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.421983    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65fc58c59d-qpgpn"
Jul 14 20:00:40.422040 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.421994    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65fc58c59d-qpgpn" event={"ID":"212b32ba-66a8-49d2-8654-4fd176e5310c","Type":"ContainerDied","Data":"fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da"}
Jul 14 20:00:40.422040 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.422034    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65fc58c59d-qpgpn" event={"ID":"212b32ba-66a8-49d2-8654-4fd176e5310c","Type":"ContainerDied","Data":"e6475748fccb7a76061677f307f9cab7a05884c1e1da1c6c7cc19da7a6fffd21"}
Jul 14 20:00:40.429434 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.429417    2584 scope.go:117] "RemoveContainer" containerID="5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9"
Jul 14 20:00:40.429684 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:00:40.429657    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9\": container with ID starting with 5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9 not found: ID does not exist" containerID="5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9"
Jul 14 20:00:40.429755 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.429698    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9"} err="failed to get container status \"5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9\": rpc error: code = NotFound desc = could not find container \"5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9\": container with ID starting with 5eaddbe72c3d3a11e9c13b16c33acf7a1538455c3ac4ef8587ad8f9b0c92b9e9 not found: ID does not exist"
Jul 14 20:00:40.429755 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.429723    2584 scope.go:117] "RemoveContainer" containerID="fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da"
Jul 14 20:00:40.437386 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.437263    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptg44"]
Jul 14 20:00:40.437434 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.437422    2584 scope.go:117] "RemoveContainer" containerID="fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da"
Jul 14 20:00:40.437731 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:00:40.437713    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da\": container with ID starting with fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da not found: ID does not exist" containerID="fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da"
Jul 14 20:00:40.437772 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.437738    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da"} err="failed to get container status \"fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da\": rpc error: code = NotFound desc = could not find container \"fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da\": container with ID starting with fea1e99ef1ad25296d57a67a9e906412f863dd9077218b40c8ec576a0074e7da not found: ID does not exist"
Jul 14 20:00:40.444634 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.444609    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptg44"]
Jul 14 20:00:40.456462 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.456437    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65fc58c59d-qpgpn"]
Jul 14 20:00:40.460204 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:40.460181    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-65fc58c59d-qpgpn"]
Jul 14 20:00:41.656145 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:41.656109    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:41.735655 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:41.735615    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:42.358715 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:42.358684    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="212b32ba-66a8-49d2-8654-4fd176e5310c" path="/var/lib/kubelet/pods/212b32ba-66a8-49d2-8654-4fd176e5310c/volumes"
Jul 14 20:00:42.359010 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:42.358997    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2cf5483-e236-4837-8804-c7a51aeabce6" path="/var/lib/kubelet/pods/b2cf5483-e236-4837-8804-c7a51aeabce6/volumes"
Jul 14 20:00:42.433621 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:42.433529    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8d85fd9b6-xcf54" event={"ID":"9c8bcf90-0547-4a68-ac47-bd3a1df4f802","Type":"ContainerStarted","Data":"17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161"}
Jul 14 20:00:42.450604 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:42.450551    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8d85fd9b6-xcf54" podStartSLOduration=1.243245788 podStartE2EDuration="4.450534754s" totalImagesPullingTime="3.207288966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:00:42.449635544 +0000 UTC m=+536.583611627" watchObservedRunningTime="2026-07-14 20:00:42.450534754 +0000 UTC m=+536.584510834"
Jul 14 20:00:42.475262 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:42.475229    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5k76"]
Jul 14 20:00:42.475442 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:42.475396    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-n5k76" podUID="b89686f6-32af-49e9-9857-41ce25cb99e1" containerName="authorino" containerID="cri-o://ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf" gracePeriod=30
Jul 14 20:00:42.708569 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:42.708543    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5k76"
Jul 14 20:00:42.775332 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:42.775298    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xn4q\" (UniqueName: \"kubernetes.io/projected/b89686f6-32af-49e9-9857-41ce25cb99e1-kube-api-access-8xn4q\") pod \"b89686f6-32af-49e9-9857-41ce25cb99e1\" (UID: \"b89686f6-32af-49e9-9857-41ce25cb99e1\") "
Jul 14 20:00:42.777485 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:42.777462    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b89686f6-32af-49e9-9857-41ce25cb99e1-kube-api-access-8xn4q" (OuterVolumeSpecName: "kube-api-access-8xn4q") pod "b89686f6-32af-49e9-9857-41ce25cb99e1" (UID: "b89686f6-32af-49e9-9857-41ce25cb99e1"). InnerVolumeSpecName "kube-api-access-8xn4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:00:42.876603 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:42.876572    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xn4q\" (UniqueName: \"kubernetes.io/projected/b89686f6-32af-49e9-9857-41ce25cb99e1-kube-api-access-8xn4q\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:00:43.439359 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:43.439265    2584 generic.go:356] "Generic (PLEG): container finished" podID="b89686f6-32af-49e9-9857-41ce25cb99e1" containerID="ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf" exitCode=0
Jul 14 20:00:43.439359 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:43.439305    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n5k76"
Jul 14 20:00:43.439359 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:43.439345    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5k76" event={"ID":"b89686f6-32af-49e9-9857-41ce25cb99e1","Type":"ContainerDied","Data":"ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf"}
Jul 14 20:00:43.439629 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:43.439385    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n5k76" event={"ID":"b89686f6-32af-49e9-9857-41ce25cb99e1","Type":"ContainerDied","Data":"a042ff026249fb3d2392dec657d3f8394eb355f83ad41b42490fb2644569db81"}
Jul 14 20:00:43.439629 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:43.439401    2584 scope.go:117] "RemoveContainer" containerID="ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf"
Jul 14 20:00:43.447919 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:43.447902    2584 scope.go:117] "RemoveContainer" containerID="ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf"
Jul 14 20:00:43.448139 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:00:43.448122    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf\": container with ID starting with ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf not found: ID does not exist" containerID="ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf"
Jul 14 20:00:43.448185 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:43.448147    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf"} err="failed to get container status \"ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf\": rpc error: code = NotFound desc = could not find container \"ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf\": container with ID starting with ac96869344f3653cdb5b1e98bee8fe7b9d8d5c61a6bde947426686098dde30cf not found: ID does not exist"
Jul 14 20:00:43.461322 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:43.461298    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5k76"]
Jul 14 20:00:43.464173 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:43.464155    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n5k76"]
Jul 14 20:00:44.358205 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:44.358174    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b89686f6-32af-49e9-9857-41ce25cb99e1" path="/var/lib/kubelet/pods/b89686f6-32af-49e9-9857-41ce25cb99e1/volumes"
Jul 14 20:00:47.185567 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:47.185534    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:47.292540 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:47.292507    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:47.373165 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:47.373132    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:47.443747 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:47.443654    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:50.103637 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:50.103598    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:00:50.203457 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:00:50.203417    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:21.915769 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:21.915732    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:22.009224 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.009191    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:22.460728 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.460686    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:22.578793 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.578760    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"]
Jul 14 20:01:22.579088 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.579074    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="212b32ba-66a8-49d2-8654-4fd176e5310c" containerName="authorino"
Jul 14 20:01:22.579138 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.579092    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="212b32ba-66a8-49d2-8654-4fd176e5310c" containerName="authorino"
Jul 14 20:01:22.579138 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.579104    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2cf5483-e236-4837-8804-c7a51aeabce6" containerName="authorino"
Jul 14 20:01:22.579138 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.579110    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2cf5483-e236-4837-8804-c7a51aeabce6" containerName="authorino"
Jul 14 20:01:22.579138 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.579120    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b89686f6-32af-49e9-9857-41ce25cb99e1" containerName="authorino"
Jul 14 20:01:22.579138 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.579125    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89686f6-32af-49e9-9857-41ce25cb99e1" containerName="authorino"
Jul 14 20:01:22.579296 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.579181    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b89686f6-32af-49e9-9857-41ce25cb99e1" containerName="authorino"
Jul 14 20:01:22.579296 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.579191    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="212b32ba-66a8-49d2-8654-4fd176e5310c" containerName="authorino"
Jul 14 20:01:22.579296 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.579196    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2cf5483-e236-4837-8804-c7a51aeabce6" containerName="authorino"
Jul 14 20:01:22.581425 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.581405    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:22.583948 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.583926    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 14 20:01:22.584060 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.583956    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 20:01:22.584119 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.584074    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lktjp\""
Jul 14 20:01:22.584119 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.584081    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 14 20:01:22.591972 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.591944    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"]
Jul 14 20:01:22.675295 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.675256    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a0bc4a3-7509-4c4a-994f-349430e22327-openshift-service-ca\") pod \"maas-api-6cf85b6845-496rp\" (UID: \"3a0bc4a3-7509-4c4a-994f-349430e22327\") " pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:22.675295 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.675301    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a0bc4a3-7509-4c4a-994f-349430e22327-maas-api-tls\") pod \"maas-api-6cf85b6845-496rp\" (UID: \"3a0bc4a3-7509-4c4a-994f-349430e22327\") " pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:22.675505 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.675333    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpr2s\" (UniqueName: \"kubernetes.io/projected/3a0bc4a3-7509-4c4a-994f-349430e22327-kube-api-access-tpr2s\") pod \"maas-api-6cf85b6845-496rp\" (UID: \"3a0bc4a3-7509-4c4a-994f-349430e22327\") " pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:22.776062 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.775984    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a0bc4a3-7509-4c4a-994f-349430e22327-openshift-service-ca\") pod \"maas-api-6cf85b6845-496rp\" (UID: \"3a0bc4a3-7509-4c4a-994f-349430e22327\") " pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:22.776062 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.776022    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a0bc4a3-7509-4c4a-994f-349430e22327-maas-api-tls\") pod \"maas-api-6cf85b6845-496rp\" (UID: \"3a0bc4a3-7509-4c4a-994f-349430e22327\") " pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:22.776243 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.776062    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpr2s\" (UniqueName: \"kubernetes.io/projected/3a0bc4a3-7509-4c4a-994f-349430e22327-kube-api-access-tpr2s\") pod \"maas-api-6cf85b6845-496rp\" (UID: \"3a0bc4a3-7509-4c4a-994f-349430e22327\") " pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:22.776243 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:01:22.776156    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 14 20:01:22.776243 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:01:22.776238    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a0bc4a3-7509-4c4a-994f-349430e22327-maas-api-tls podName:3a0bc4a3-7509-4c4a-994f-349430e22327 nodeName:}" failed. No retries permitted until 2026-07-14 20:01:23.276218386 +0000 UTC m=+577.410194445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3a0bc4a3-7509-4c4a-994f-349430e22327-maas-api-tls") pod "maas-api-6cf85b6845-496rp" (UID: "3a0bc4a3-7509-4c4a-994f-349430e22327") : secret "maas-api-serving-cert" not found
Jul 14 20:01:22.776601 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.776582    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a0bc4a3-7509-4c4a-994f-349430e22327-openshift-service-ca\") pod \"maas-api-6cf85b6845-496rp\" (UID: \"3a0bc4a3-7509-4c4a-994f-349430e22327\") " pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:22.786071 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.786036    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpr2s\" (UniqueName: \"kubernetes.io/projected/3a0bc4a3-7509-4c4a-994f-349430e22327-kube-api-access-tpr2s\") pod \"maas-api-6cf85b6845-496rp\" (UID: \"3a0bc4a3-7509-4c4a-994f-349430e22327\") " pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:22.893097 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.893055    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:22.992509 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:22.992460    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:23.059611 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.059523    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"]
Jul 14 20:01:23.061851 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.061834    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"
Jul 14 20:01:23.064568 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.064544    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 14 20:01:23.064568 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.064556    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-98dtf\""
Jul 14 20:01:23.076031 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.076006    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"]
Jul 14 20:01:23.078551 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.078525    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdqsc\" (UniqueName: \"kubernetes.io/projected/42c60b58-2d2c-42f8-a110-92bb83b69f75-kube-api-access-gdqsc\") pod \"payload-pre-processing-74584bb9f8-xghbs\" (UID: \"42c60b58-2d2c-42f8-a110-92bb83b69f75\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"
Jul 14 20:01:23.078667 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.078568    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42c60b58-2d2c-42f8-a110-92bb83b69f75-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-xghbs\" (UID: \"42c60b58-2d2c-42f8-a110-92bb83b69f75\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"
Jul 14 20:01:23.088414 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.088386    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:23.179582 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.179551    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdqsc\" (UniqueName: \"kubernetes.io/projected/42c60b58-2d2c-42f8-a110-92bb83b69f75-kube-api-access-gdqsc\") pod \"payload-pre-processing-74584bb9f8-xghbs\" (UID: \"42c60b58-2d2c-42f8-a110-92bb83b69f75\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"
Jul 14 20:01:23.179750 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.179589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42c60b58-2d2c-42f8-a110-92bb83b69f75-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-xghbs\" (UID: \"42c60b58-2d2c-42f8-a110-92bb83b69f75\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"
Jul 14 20:01:23.180334 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.180315    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42c60b58-2d2c-42f8-a110-92bb83b69f75-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-xghbs\" (UID: \"42c60b58-2d2c-42f8-a110-92bb83b69f75\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"
Jul 14 20:01:23.195021 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.194994    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdqsc\" (UniqueName: \"kubernetes.io/projected/42c60b58-2d2c-42f8-a110-92bb83b69f75-kube-api-access-gdqsc\") pod \"payload-pre-processing-74584bb9f8-xghbs\" (UID: \"42c60b58-2d2c-42f8-a110-92bb83b69f75\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"
Jul 14 20:01:23.280100 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.280069    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a0bc4a3-7509-4c4a-994f-349430e22327-maas-api-tls\") pod \"maas-api-6cf85b6845-496rp\" (UID: \"3a0bc4a3-7509-4c4a-994f-349430e22327\") " pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:23.282647 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.282616    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a0bc4a3-7509-4c4a-994f-349430e22327-maas-api-tls\") pod \"maas-api-6cf85b6845-496rp\" (UID: \"3a0bc4a3-7509-4c4a-994f-349430e22327\") " pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:23.372159 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.372070    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"
Jul 14 20:01:23.491504 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.491468    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:23.508636 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.508612    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"]
Jul 14 20:01:23.511406 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:01:23.511363    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c60b58_2d2c_42f8_a110_92bb83b69f75.slice/crio-b0c40f9016f663e034f592898249f51fbb2d0c8390a7b6b998168d0583c03bfb WatchSource:0}: Error finding container b0c40f9016f663e034f592898249f51fbb2d0c8390a7b6b998168d0583c03bfb: Status 404 returned error can't find the container with id b0c40f9016f663e034f592898249f51fbb2d0c8390a7b6b998168d0583c03bfb
Jul 14 20:01:23.587775 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.587745    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs" event={"ID":"42c60b58-2d2c-42f8-a110-92bb83b69f75","Type":"ContainerStarted","Data":"b0c40f9016f663e034f592898249f51fbb2d0c8390a7b6b998168d0583c03bfb"}
Jul 14 20:01:23.628466 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:23.628395    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"]
Jul 14 20:01:23.631240 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:01:23.631219    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0bc4a3_7509_4c4a_994f_349430e22327.slice/crio-589580694af439fbc4d4a328be1b349f5cbeaf3cfae420ee3c4215c15972fbd6 WatchSource:0}: Error finding container 589580694af439fbc4d4a328be1b349f5cbeaf3cfae420ee3c4215c15972fbd6: Status 404 returned error can't find the container with id 589580694af439fbc4d4a328be1b349f5cbeaf3cfae420ee3c4215c15972fbd6
Jul 14 20:01:24.594889 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:24.594835    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp" event={"ID":"3a0bc4a3-7509-4c4a-994f-349430e22327","Type":"ContainerStarted","Data":"589580694af439fbc4d4a328be1b349f5cbeaf3cfae420ee3c4215c15972fbd6"}
Jul 14 20:01:26.605475 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:26.605436    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs" event={"ID":"42c60b58-2d2c-42f8-a110-92bb83b69f75","Type":"ContainerStarted","Data":"1320713570f258428358e505f68bb927364f2b324c1b33c720e41f890081ad54"}
Jul 14 20:01:26.605938 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:26.605576    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"
Jul 14 20:01:26.606985 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:26.606960    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp" event={"ID":"3a0bc4a3-7509-4c4a-994f-349430e22327","Type":"ContainerStarted","Data":"bc3743e6d7eede0d0b068c283bb81b6edb2b5cc200550eba95f4d63b019bd612"}
Jul 14 20:01:26.607107 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:26.607092    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:26.620951 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:26.620910    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs" podStartSLOduration=1.123538478 podStartE2EDuration="3.62089509s" totalImagesPullingTime="2.497356612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:01:26.620481245 +0000 UTC m=+580.754457326" watchObservedRunningTime="2026-07-14 20:01:26.62089509 +0000 UTC m=+580.754871167"
Jul 14 20:01:26.636800 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:26.636750    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp" podStartSLOduration=2.233225324 podStartE2EDuration="4.636734739s" totalImagesPullingTime="2.403509415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:01:26.635618583 +0000 UTC m=+580.769594701" watchObservedRunningTime="2026-07-14 20:01:26.636734739 +0000 UTC m=+580.770710818"
Jul 14 20:01:32.616192 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:32.616163    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6cf85b6845-496rp"
Jul 14 20:01:33.627997 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:33.627954    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:33.712477 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:33.712439    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:37.613352 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:37.613323    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-xghbs"
Jul 14 20:01:42.561705 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:42.561666    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:46.253639 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.253597    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:01:46.254131 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.254001    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:01:46.903495 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.903455    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"]
Jul 14 20:01:46.906098 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.906075    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:46.908773 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.908750    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 14 20:01:46.909650 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.909627    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ccq98\""
Jul 14 20:01:46.909765 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.909647    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 20:01:46.909765 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.909647    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 20:01:46.917332 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.917310    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"]
Jul 14 20:01:46.928220 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.928185    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:46.968082 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.968049    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00b15c47-6582-4577-b564-b4a1c5498211-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:46.968082 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.968089    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:46.968288 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.968112    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:46.968288 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.968132    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:46.968288 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.968201    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:46.968288 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:46.968282    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pfgd\" (UniqueName: \"kubernetes.io/projected/00b15c47-6582-4577-b564-b4a1c5498211-kube-api-access-5pfgd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.068760 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.068725    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pfgd\" (UniqueName: \"kubernetes.io/projected/00b15c47-6582-4577-b564-b4a1c5498211-kube-api-access-5pfgd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.068959 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.068770    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00b15c47-6582-4577-b564-b4a1c5498211-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.068959 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.068792    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.068959 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.068809    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.068959 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.068829    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.068959 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.068850    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.069276 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.069253    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.069349 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.069277    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.069349 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.069283    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.071236 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.071208    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00b15c47-6582-4577-b564-b4a1c5498211-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.071518 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.071501    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00b15c47-6582-4577-b564-b4a1c5498211-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.079226 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.079200    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pfgd\" (UniqueName: \"kubernetes.io/projected/00b15c47-6582-4577-b564-b4a1c5498211-kube-api-access-5pfgd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t\" (UID: \"00b15c47-6582-4577-b564-b4a1c5498211\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.216564 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.216529    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:47.352394 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.352216    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"]
Jul 14 20:01:47.355177 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:01:47.355138    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b15c47_6582_4577_b564_b4a1c5498211.slice/crio-05f9a42f9064fa23fa21aabcae9f959c9aba3d31fc32abb140c79126b121d4cb WatchSource:0}: Error finding container 05f9a42f9064fa23fa21aabcae9f959c9aba3d31fc32abb140c79126b121d4cb: Status 404 returned error can't find the container with id 05f9a42f9064fa23fa21aabcae9f959c9aba3d31fc32abb140c79126b121d4cb
Jul 14 20:01:47.694990 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:47.694943    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t" event={"ID":"00b15c47-6582-4577-b564-b4a1c5498211","Type":"ContainerStarted","Data":"05f9a42f9064fa23fa21aabcae9f959c9aba3d31fc32abb140c79126b121d4cb"}
Jul 14 20:01:48.700679 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:48.700640    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t" event={"ID":"00b15c47-6582-4577-b564-b4a1c5498211","Type":"ContainerStarted","Data":"7a442a30c077c0f54d7ba4cd2a20425efeab36bb6808c74b6fc288cd85525e3a"}
Jul 14 20:01:48.721739 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:48.721681    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t" podStartSLOduration=1.5503045 podStartE2EDuration="2.721662719s" totalImagesPullingTime="1.171358219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:01:48.719624184 +0000 UTC m=+602.853600268" watchObservedRunningTime="2026-07-14 20:01:48.721662719 +0000 UTC m=+602.855638799"
Jul 14 20:01:53.208835 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:53.208791    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:57.217271 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:57.217238    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:57.218786 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:57.217310    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:57.229637 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:57.229613    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:01:57.750352 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:01:57.750325    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t"
Jul 14 20:02:02.663447 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:02.663409    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:02:06.289999 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.289969    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"]
Jul 14 20:02:06.294224 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.294202    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.296797 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.296766    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"]
Jul 14 20:02:06.297439 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.297419    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 14 20:02:06.429331 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.429243    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49tp\" (UniqueName: \"kubernetes.io/projected/6596456d-8e0a-45b3-8221-8cac65393f55-kube-api-access-k49tp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.429331 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.429294    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6596456d-8e0a-45b3-8221-8cac65393f55-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.429570 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.429438    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.429570 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.429478    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.429570 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.429513    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.429570 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.429535    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.530534 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.530494    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.530534 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.530541    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.530796 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.530557    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.530796 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.530586    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49tp\" (UniqueName: \"kubernetes.io/projected/6596456d-8e0a-45b3-8221-8cac65393f55-kube-api-access-k49tp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.530796 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.530607    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6596456d-8e0a-45b3-8221-8cac65393f55-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.530796 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.530657    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.531045 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.531006    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.531086 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.531045    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.531146 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.531125    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.533099 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.533077    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6596456d-8e0a-45b3-8221-8cac65393f55-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.533322 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.533302    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6596456d-8e0a-45b3-8221-8cac65393f55-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.539037 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.539013    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49tp\" (UniqueName: \"kubernetes.io/projected/6596456d-8e0a-45b3-8221-8cac65393f55-kube-api-access-k49tp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kltt5\" (UID: \"6596456d-8e0a-45b3-8221-8cac65393f55\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.605119 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.605036    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:06.736762 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.736733    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"]
Jul 14 20:02:06.739189 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:02:06.739159    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6596456d_8e0a_45b3_8221_8cac65393f55.slice/crio-003adeb070cc2636cb6312faf26024b0fcd456e92ff852f79666ad9de69c95a5 WatchSource:0}: Error finding container 003adeb070cc2636cb6312faf26024b0fcd456e92ff852f79666ad9de69c95a5: Status 404 returned error can't find the container with id 003adeb070cc2636cb6312faf26024b0fcd456e92ff852f79666ad9de69c95a5
Jul 14 20:02:06.740632 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.740610    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:02:06.777166 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:06.777134    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5" event={"ID":"6596456d-8e0a-45b3-8221-8cac65393f55","Type":"ContainerStarted","Data":"003adeb070cc2636cb6312faf26024b0fcd456e92ff852f79666ad9de69c95a5"}
Jul 14 20:02:07.782709 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:07.782670    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5" event={"ID":"6596456d-8e0a-45b3-8221-8cac65393f55","Type":"ContainerStarted","Data":"89ee4da73beb0b9aa18d2b0050c9cc948437465c6bde54446b6406e2af892c01"}
Jul 14 20:02:07.802934 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:07.802852    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5" podStartSLOduration=1.5754722220000001 podStartE2EDuration="1.802834363s" totalImagesPullingTime="227.362141ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:02:07.801671425 +0000 UTC m=+621.935647506" watchObservedRunningTime="2026-07-14 20:02:07.802834363 +0000 UTC m=+621.936810443"
Jul 14 20:02:09.037368 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:09.037333    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:02:16.605546 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:16.605484    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:16.605949 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:16.605568    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:16.618196 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:16.618167    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:16.830126 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:16.830100    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kltt5"
Jul 14 20:02:27.844503 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:27.844470    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:02:46.617322 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:46.617288    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:02:49.408589 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.408551    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"]
Jul 14 20:02:49.411172 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.411149    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.414119 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.414094    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 14 20:02:49.435961 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.435925    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"]
Jul 14 20:02:49.460421 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.460373    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:02:49.470623 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.470587    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.470793 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.470636    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/031cbe24-5bcf-4117-9318-ab50dd55936a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.470793 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.470693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.470793 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.470713    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwsrm\" (UniqueName: \"kubernetes.io/projected/031cbe24-5bcf-4117-9318-ab50dd55936a-kube-api-access-rwsrm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.470793 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.470748    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.470793 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.470774    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.571775 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.571735    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.571775 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.571782    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.572052 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.571826    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.572052 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.571848    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/031cbe24-5bcf-4117-9318-ab50dd55936a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.572052 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.571909    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.572194 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.572042    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwsrm\" (UniqueName: \"kubernetes.io/projected/031cbe24-5bcf-4117-9318-ab50dd55936a-kube-api-access-rwsrm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.572291 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.572270    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.572351 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.572330    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.572412 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.572390    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.574296 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.574267    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/031cbe24-5bcf-4117-9318-ab50dd55936a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.574545 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.574528    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/031cbe24-5bcf-4117-9318-ab50dd55936a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.581622 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.581598    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwsrm\" (UniqueName: \"kubernetes.io/projected/031cbe24-5bcf-4117-9318-ab50dd55936a-kube-api-access-rwsrm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p\" (UID: \"031cbe24-5bcf-4117-9318-ab50dd55936a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.721546 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.721513    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:49.894816 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.894775    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"]
Jul 14 20:02:49.898253 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:02:49.898225    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod031cbe24_5bcf_4117_9318_ab50dd55936a.slice/crio-a011db1098e86691599ec8168b4f177d9a04135d315241edae88c2ea293229b9 WatchSource:0}: Error finding container a011db1098e86691599ec8168b4f177d9a04135d315241edae88c2ea293229b9: Status 404 returned error can't find the container with id a011db1098e86691599ec8168b4f177d9a04135d315241edae88c2ea293229b9
Jul 14 20:02:49.955818 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:49.955785    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p" event={"ID":"031cbe24-5bcf-4117-9318-ab50dd55936a","Type":"ContainerStarted","Data":"a011db1098e86691599ec8168b4f177d9a04135d315241edae88c2ea293229b9"}
Jul 14 20:02:50.961590 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:50.961547    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p" event={"ID":"031cbe24-5bcf-4117-9318-ab50dd55936a","Type":"ContainerStarted","Data":"56936ca72c1efa0e15442c70542287d40cda9939f24e379b88aafc16edb06998"}
Jul 14 20:02:50.980302 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:50.980242    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p" podStartSLOduration=1.7757011729999999 podStartE2EDuration="1.980224152s" totalImagesPullingTime="204.522979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:02:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:02:50.97800965 +0000 UTC m=+665.111985763" watchObservedRunningTime="2026-07-14 20:02:50.980224152 +0000 UTC m=+665.114200231"
Jul 14 20:02:56.972278 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:56.972219    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:02:57.032692 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:57.032661    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:02:59.722060 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:59.722018    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:59.722468 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:59.722079    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:02:59.734803 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:02:59.734777    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:03:00.009400 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:00.009303    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p"
Jul 14 20:03:32.429019 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:32.428980    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:03:32.528758 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:32.528721    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:03:35.122332 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:35.122300    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-654758fb5f-hb2x6"]
Jul 14 20:03:35.125674 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:35.125655    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-654758fb5f-hb2x6"
Jul 14 20:03:35.138562 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:35.138530    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-654758fb5f-hb2x6"]
Jul 14 20:03:35.254660 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:35.254617    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75c6fd5a-227c-4050-ae8b-b42e769365ae-tls-cert\") pod \"authorino-654758fb5f-hb2x6\" (UID: \"75c6fd5a-227c-4050-ae8b-b42e769365ae\") " pod="kuadrant-system/authorino-654758fb5f-hb2x6"
Jul 14 20:03:35.254839 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:35.254703    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drnqm\" (UniqueName: \"kubernetes.io/projected/75c6fd5a-227c-4050-ae8b-b42e769365ae-kube-api-access-drnqm\") pod \"authorino-654758fb5f-hb2x6\" (UID: \"75c6fd5a-227c-4050-ae8b-b42e769365ae\") " pod="kuadrant-system/authorino-654758fb5f-hb2x6"
Jul 14 20:03:35.355809 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:35.355772    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drnqm\" (UniqueName: \"kubernetes.io/projected/75c6fd5a-227c-4050-ae8b-b42e769365ae-kube-api-access-drnqm\") pod \"authorino-654758fb5f-hb2x6\" (UID: \"75c6fd5a-227c-4050-ae8b-b42e769365ae\") " pod="kuadrant-system/authorino-654758fb5f-hb2x6"
Jul 14 20:03:35.355991 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:35.355830    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75c6fd5a-227c-4050-ae8b-b42e769365ae-tls-cert\") pod \"authorino-654758fb5f-hb2x6\" (UID: \"75c6fd5a-227c-4050-ae8b-b42e769365ae\") " pod="kuadrant-system/authorino-654758fb5f-hb2x6"
Jul 14 20:03:35.358405 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:35.358374    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75c6fd5a-227c-4050-ae8b-b42e769365ae-tls-cert\") pod \"authorino-654758fb5f-hb2x6\" (UID: \"75c6fd5a-227c-4050-ae8b-b42e769365ae\") " pod="kuadrant-system/authorino-654758fb5f-hb2x6"
Jul 14 20:03:35.377900 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:35.377811    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drnqm\" (UniqueName: \"kubernetes.io/projected/75c6fd5a-227c-4050-ae8b-b42e769365ae-kube-api-access-drnqm\") pod \"authorino-654758fb5f-hb2x6\" (UID: \"75c6fd5a-227c-4050-ae8b-b42e769365ae\") " pod="kuadrant-system/authorino-654758fb5f-hb2x6"
Jul 14 20:03:35.435405 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:35.435367    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-654758fb5f-hb2x6"
Jul 14 20:03:35.585535 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:35.585502    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-654758fb5f-hb2x6"]
Jul 14 20:03:35.588819 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:03:35.588790    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75c6fd5a_227c_4050_ae8b_b42e769365ae.slice/crio-536526b7ec15cb9801f9612066965f1b8be57d793e1b89ddaf8b1c2b96560951 WatchSource:0}: Error finding container 536526b7ec15cb9801f9612066965f1b8be57d793e1b89ddaf8b1c2b96560951: Status 404 returned error can't find the container with id 536526b7ec15cb9801f9612066965f1b8be57d793e1b89ddaf8b1c2b96560951
Jul 14 20:03:36.148354 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.148315    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-654758fb5f-hb2x6" event={"ID":"75c6fd5a-227c-4050-ae8b-b42e769365ae","Type":"ContainerStarted","Data":"c2d789d186b06e9e80b6a5e525a79421444450c8b143a4bd8171d0c88e21fc2b"}
Jul 14 20:03:36.148354 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.148356    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-654758fb5f-hb2x6" event={"ID":"75c6fd5a-227c-4050-ae8b-b42e769365ae","Type":"ContainerStarted","Data":"536526b7ec15cb9801f9612066965f1b8be57d793e1b89ddaf8b1c2b96560951"}
Jul 14 20:03:36.168093 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.168029    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-654758fb5f-hb2x6" podStartSLOduration=0.800458712 podStartE2EDuration="1.167999738s" totalImagesPullingTime="367.541026ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:03:36.167863867 +0000 UTC m=+710.301839974" watchObservedRunningTime="2026-07-14 20:03:36.167999738 +0000 UTC m=+710.301975819"
Jul 14 20:03:36.204932 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.204901    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8d85fd9b6-xcf54"]
Jul 14 20:03:36.205150 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.205123    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8d85fd9b6-xcf54" podUID="9c8bcf90-0547-4a68-ac47-bd3a1df4f802" containerName="authorino" containerID="cri-o://17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161" gracePeriod=30
Jul 14 20:03:36.457772 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.457742    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8d85fd9b6-xcf54"
Jul 14 20:03:36.564626 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.564513    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-tls-cert\") pod \"9c8bcf90-0547-4a68-ac47-bd3a1df4f802\" (UID: \"9c8bcf90-0547-4a68-ac47-bd3a1df4f802\") "
Jul 14 20:03:36.565053 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.564634    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z42bb\" (UniqueName: \"kubernetes.io/projected/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-kube-api-access-z42bb\") pod \"9c8bcf90-0547-4a68-ac47-bd3a1df4f802\" (UID: \"9c8bcf90-0547-4a68-ac47-bd3a1df4f802\") "
Jul 14 20:03:36.566985 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.566949    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-kube-api-access-z42bb" (OuterVolumeSpecName: "kube-api-access-z42bb") pod "9c8bcf90-0547-4a68-ac47-bd3a1df4f802" (UID: "9c8bcf90-0547-4a68-ac47-bd3a1df4f802"). InnerVolumeSpecName "kube-api-access-z42bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:03:36.575742 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.575707    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9c8bcf90-0547-4a68-ac47-bd3a1df4f802" (UID: "9c8bcf90-0547-4a68-ac47-bd3a1df4f802"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:03:36.665582 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.665546    2584 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-tls-cert\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:03:36.665582 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:36.665580    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z42bb\" (UniqueName: \"kubernetes.io/projected/9c8bcf90-0547-4a68-ac47-bd3a1df4f802-kube-api-access-z42bb\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:03:37.155021 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:37.154973    2584 generic.go:356] "Generic (PLEG): container finished" podID="9c8bcf90-0547-4a68-ac47-bd3a1df4f802" containerID="17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161" exitCode=0
Jul 14 20:03:37.155493 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:37.155127    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8d85fd9b6-xcf54" event={"ID":"9c8bcf90-0547-4a68-ac47-bd3a1df4f802","Type":"ContainerDied","Data":"17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161"}
Jul 14 20:03:37.155493 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:37.155176    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8d85fd9b6-xcf54" event={"ID":"9c8bcf90-0547-4a68-ac47-bd3a1df4f802","Type":"ContainerDied","Data":"a321adc950fb31d324c666879dfb1c91ed176575e0054776428f66dc952a3c3a"}
Jul 14 20:03:37.155493 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:37.155198    2584 scope.go:117] "RemoveContainer" containerID="17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161"
Jul 14 20:03:37.155493 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:37.155367    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8d85fd9b6-xcf54"
Jul 14 20:03:37.164916 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:37.164892    2584 scope.go:117] "RemoveContainer" containerID="17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161"
Jul 14 20:03:37.165247 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:03:37.165221    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161\": container with ID starting with 17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161 not found: ID does not exist" containerID="17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161"
Jul 14 20:03:37.165309 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:37.165260    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161"} err="failed to get container status \"17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161\": rpc error: code = NotFound desc = could not find container \"17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161\": container with ID starting with 17ca25ce83ed6070c14471af8b7536887a733b85660d8e42d39448a6eee21161 not found: ID does not exist"
Jul 14 20:03:37.178375 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:37.178345    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8d85fd9b6-xcf54"]
Jul 14 20:03:37.188572 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:37.188539    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8d85fd9b6-xcf54"]
Jul 14 20:03:38.096394 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:38.096351    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:03:38.205236 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:38.205194    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:03:38.360126 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:38.360045    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c8bcf90-0547-4a68-ac47-bd3a1df4f802" path="/var/lib/kubelet/pods/9c8bcf90-0547-4a68-ac47-bd3a1df4f802/volumes"
Jul 14 20:03:46.022323 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:03:46.022270    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:04:03.066679 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:04:03.066639    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:04:03.169530 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:04:03.169495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:04:12.642476 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:04:12.642441    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:04:12.755005 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:04:12.754974    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:05:20.507911 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:05:20.507809    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:05:22.565964 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:05:22.565925    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:07.814583 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:06:07.814552    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:09.983325 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:06:09.983287    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:11.981644 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:06:11.981603    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:12.090554 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:06:12.090522    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:12.185220 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:06:12.185185    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:12.480741 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:06:12.480709    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:18.600627 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:06:18.600588    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:18.727694 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:06:18.727664    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:46.281087 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:06:46.281000    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:06:46.281858 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:06:46.281831    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:09:26.651707 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:09:26.651660    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:48.183094 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:09:48.183006    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:48.288540 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:09:48.288504    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:53.625053 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:09:53.625021    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:53.730042 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:09:53.729996    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:04.721828 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:10:04.721782    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:04.898576 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:10:04.898536    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:44.877287 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:10:44.877249    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:11:46.307032 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:11:46.307000    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:11:46.308491 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:11:46.308459    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:13:29.995563 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:13:29.995527    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:12.101717 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:16:12.101687    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:46.332009 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:16:46.331980    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:16:46.333843 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:16:46.333810    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:17:00.263820 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:00.263787    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:16.238269 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:16.238189    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:23.777429 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:23.777392    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:31.970418 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:31.970381    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:37.084678 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:37.084645    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:40.050730 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:40.050693    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:41.313617 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:41.313584    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:41.404536 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:41.404505    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:46.749626 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:46.749564    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:46.854802 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:46.854741    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:46.969218 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:46.969187    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:47.060815 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:47.060713    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:48.234571 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.234536    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:48.338206 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.338172    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"]
Jul 14 20:17:48.338500 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.338488    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c8bcf90-0547-4a68-ac47-bd3a1df4f802" containerName="authorino"
Jul 14 20:17:48.338543 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.338502    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8bcf90-0547-4a68-ac47-bd3a1df4f802" containerName="authorino"
Jul 14 20:17:48.338576 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.338552    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c8bcf90-0547-4a68-ac47-bd3a1df4f802" containerName="authorino"
Jul 14 20:17:48.341439 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.341421    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:48.345234 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.345211    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-df972874-serving-cert\""
Jul 14 20:17:48.362811 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.362777    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"]
Jul 14 20:17:48.367821 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.367785    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:48.443266 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.443237    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-openshift-service-ca\") pod \"maas-api-e2e-ait-df972874-b89c48d57-6hzmf\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:48.443462 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.443282    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-maas-api-tls\") pod \"maas-api-e2e-ait-df972874-b89c48d57-6hzmf\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:48.443462 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.443327    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56lt9\" (UniqueName: \"kubernetes.io/projected/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-kube-api-access-56lt9\") pod \"maas-api-e2e-ait-df972874-b89c48d57-6hzmf\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:48.474983 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.474951    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:48.544364 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.544287    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-openshift-service-ca\") pod \"maas-api-e2e-ait-df972874-b89c48d57-6hzmf\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:48.544364 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.544325    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-maas-api-tls\") pod \"maas-api-e2e-ait-df972874-b89c48d57-6hzmf\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:48.544364 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.544344    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56lt9\" (UniqueName: \"kubernetes.io/projected/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-kube-api-access-56lt9\") pod \"maas-api-e2e-ait-df972874-b89c48d57-6hzmf\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:48.544576 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:17:48.544455    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-df972874-serving-cert: secret "maas-api-e2e-ait-df972874-serving-cert" not found
Jul 14 20:17:48.544576 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:17:48.544532    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-maas-api-tls podName:2ac7ea29-2937-484a-9ac4-3fcdedc87fe6 nodeName:}" failed. No retries permitted until 2026-07-14 20:17:49.044511363 +0000 UTC m=+1563.178487423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-maas-api-tls") pod "maas-api-e2e-ait-df972874-b89c48d57-6hzmf" (UID: "2ac7ea29-2937-484a-9ac4-3fcdedc87fe6") : secret "maas-api-e2e-ait-df972874-serving-cert" not found
Jul 14 20:17:48.545064 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.545048    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-openshift-service-ca\") pod \"maas-api-e2e-ait-df972874-b89c48d57-6hzmf\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:48.559060 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.559035    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56lt9\" (UniqueName: \"kubernetes.io/projected/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-kube-api-access-56lt9\") pod \"maas-api-e2e-ait-df972874-b89c48d57-6hzmf\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:48.802543 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:48.802462    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:49.048044 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:49.047998    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-maas-api-tls\") pod \"maas-api-e2e-ait-df972874-b89c48d57-6hzmf\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:49.050618 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:49.050597    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-maas-api-tls\") pod \"maas-api-e2e-ait-df972874-b89c48d57-6hzmf\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:49.252472 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:49.252433    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:49.364111 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:49.364073    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:49.408924 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:49.408900    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"]
Jul 14 20:17:49.411598 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:17:49.411571    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac7ea29_2937_484a_9ac4_3fcdedc87fe6.slice/crio-04d19ff9205ce8d9641344e98293843ffa61f3f6768f0995fa000322ba042b98 WatchSource:0}: Error finding container 04d19ff9205ce8d9641344e98293843ffa61f3f6768f0995fa000322ba042b98: Status 404 returned error can't find the container with id 04d19ff9205ce8d9641344e98293843ffa61f3f6768f0995fa000322ba042b98
Jul 14 20:17:49.412902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:49.412886    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:17:49.554578 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:49.554498    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:49.789387 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:49.789350    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf" event={"ID":"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6","Type":"ContainerStarted","Data":"04d19ff9205ce8d9641344e98293843ffa61f3f6768f0995fa000322ba042b98"}
Jul 14 20:17:50.799469 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:50.799435    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:51.799094 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:51.799062    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf" event={"ID":"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6","Type":"ContainerStarted","Data":"97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997"}
Jul 14 20:17:51.799281 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:51.799147    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:17:51.819484 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:51.819433    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf" podStartSLOduration=2.301370616 podStartE2EDuration="3.819417024s" totalImagesPullingTime="1.518046408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:17:51.818220962 +0000 UTC m=+1565.952197111" watchObservedRunningTime="2026-07-14 20:17:51.819417024 +0000 UTC m=+1565.953393104"
Jul 14 20:17:57.809825 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:17:57.809795    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:19:04.584722 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:04.584684    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"]
Jul 14 20:19:04.585229 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:04.584916    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf" podUID="2ac7ea29-2937-484a-9ac4-3fcdedc87fe6" containerName="maas-api" containerID="cri-o://97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997" gracePeriod=30
Jul 14 20:19:04.642385 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:04.642336    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:04.834683 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:04.834652    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:19:05.011657 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.011628    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-maas-api-tls\") pod \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") "
Jul 14 20:19:05.011821 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.011680    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56lt9\" (UniqueName: \"kubernetes.io/projected/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-kube-api-access-56lt9\") pod \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") "
Jul 14 20:19:05.011821 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.011724    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-openshift-service-ca\") pod \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\" (UID: \"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6\") "
Jul 14 20:19:05.012161 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.012138    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2ac7ea29-2937-484a-9ac4-3fcdedc87fe6" (UID: "2ac7ea29-2937-484a-9ac4-3fcdedc87fe6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:19:05.014042 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.014020    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-kube-api-access-56lt9" (OuterVolumeSpecName: "kube-api-access-56lt9") pod "2ac7ea29-2937-484a-9ac4-3fcdedc87fe6" (UID: "2ac7ea29-2937-484a-9ac4-3fcdedc87fe6"). InnerVolumeSpecName "kube-api-access-56lt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:19:05.014213 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.014194    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2ac7ea29-2937-484a-9ac4-3fcdedc87fe6" (UID: "2ac7ea29-2937-484a-9ac4-3fcdedc87fe6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:19:05.109312 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.109281    2584 generic.go:356] "Generic (PLEG): container finished" podID="2ac7ea29-2937-484a-9ac4-3fcdedc87fe6" containerID="97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997" exitCode=0
Jul 14 20:19:05.109477 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.109335    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"
Jul 14 20:19:05.109477 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.109373    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf" event={"ID":"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6","Type":"ContainerDied","Data":"97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997"}
Jul 14 20:19:05.109477 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.109430    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf" event={"ID":"2ac7ea29-2937-484a-9ac4-3fcdedc87fe6","Type":"ContainerDied","Data":"04d19ff9205ce8d9641344e98293843ffa61f3f6768f0995fa000322ba042b98"}
Jul 14 20:19:05.109477 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.109459    2584 scope.go:117] "RemoveContainer" containerID="97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997"
Jul 14 20:19:05.112304 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.112282    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:19:05.112410 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.112305    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56lt9\" (UniqueName: \"kubernetes.io/projected/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-kube-api-access-56lt9\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:19:05.112410 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.112319    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:19:05.119034 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.119018    2584 scope.go:117] "RemoveContainer" containerID="97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997"
Jul 14 20:19:05.119326 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:19:05.119305    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997\": container with ID starting with 97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997 not found: ID does not exist" containerID="97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997"
Jul 14 20:19:05.119372 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.119336    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997"} err="failed to get container status \"97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997\": rpc error: code = NotFound desc = could not find container \"97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997\": container with ID starting with 97e5e4be6aed5895eaccfa03ab3ef7979df0e9361611d71f2efd0aaf705ec997 not found: ID does not exist"
Jul 14 20:19:05.146286 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.146246    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"]
Jul 14 20:19:05.158779 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:05.158742    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df972874-b89c48d57-6hzmf"]
Jul 14 20:19:06.365204 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:06.365169    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ac7ea29-2937-484a-9ac4-3fcdedc87fe6" path="/var/lib/kubelet/pods/2ac7ea29-2937-484a-9ac4-3fcdedc87fe6/volumes"
Jul 14 20:19:08.675261 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:08.675226    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:17.034294 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:17.034259    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:17.347525 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:17.347447    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:18.881494 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:18.881464    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:19.316252 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:19.316223    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:19.734265 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:19.734239    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:19.909363 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:19.909332    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:21.200640 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.200608    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:21.432601 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.432563    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"]
Jul 14 20:19:21.433552 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.433526    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac7ea29-2937-484a-9ac4-3fcdedc87fe6" containerName="maas-api"
Jul 14 20:19:21.433705 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.433694    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac7ea29-2937-484a-9ac4-3fcdedc87fe6" containerName="maas-api"
Jul 14 20:19:21.433989 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.433976    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac7ea29-2937-484a-9ac4-3fcdedc87fe6" containerName="maas-api"
Jul 14 20:19:21.437803 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.437777    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:21.443550 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.443529    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-bc788bc2-serving-cert\""
Jul 14 20:19:21.544826 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.544740    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc9q7\" (UniqueName: \"kubernetes.io/projected/495b8bce-0e89-4cd8-a71a-07b84efb5f10-kube-api-access-lc9q7\") pod \"maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:21.544826 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.544782    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/495b8bce-0e89-4cd8-a71a-07b84efb5f10-maas-api-tls\") pod \"maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:21.544826 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.544808    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/495b8bce-0e89-4cd8-a71a-07b84efb5f10-openshift-service-ca\") pod \"maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:21.575010 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.574976    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"]
Jul 14 20:19:21.645784 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.645750    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc9q7\" (UniqueName: \"kubernetes.io/projected/495b8bce-0e89-4cd8-a71a-07b84efb5f10-kube-api-access-lc9q7\") pod \"maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:21.645784 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.645790    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/495b8bce-0e89-4cd8-a71a-07b84efb5f10-maas-api-tls\") pod \"maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:21.646008 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.645818    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/495b8bce-0e89-4cd8-a71a-07b84efb5f10-openshift-service-ca\") pod \"maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:21.646008 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:19:21.645955    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-serving-cert: secret "maas-api-e2e-migrate-bc788bc2-serving-cert" not found
Jul 14 20:19:21.646073 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:19:21.646019    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/495b8bce-0e89-4cd8-a71a-07b84efb5f10-maas-api-tls podName:495b8bce-0e89-4cd8-a71a-07b84efb5f10 nodeName:}" failed. No retries permitted until 2026-07-14 20:19:22.146002658 +0000 UTC m=+1656.279978715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/495b8bce-0e89-4cd8-a71a-07b84efb5f10-maas-api-tls") pod "maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p" (UID: "495b8bce-0e89-4cd8-a71a-07b84efb5f10") : secret "maas-api-e2e-migrate-bc788bc2-serving-cert" not found
Jul 14 20:19:21.646438 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.646422    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/495b8bce-0e89-4cd8-a71a-07b84efb5f10-openshift-service-ca\") pod \"maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:21.661432 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.661409    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc9q7\" (UniqueName: \"kubernetes.io/projected/495b8bce-0e89-4cd8-a71a-07b84efb5f10-kube-api-access-lc9q7\") pod \"maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:21.701480 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:21.701450    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:22.150629 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:22.150590    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/495b8bce-0e89-4cd8-a71a-07b84efb5f10-maas-api-tls\") pod \"maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:22.153162 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:22.153140    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/495b8bce-0e89-4cd8-a71a-07b84efb5f10-maas-api-tls\") pod \"maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:22.256410 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:22.256372    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:22.348149 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:22.348112    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:22.555459 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:22.555434    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"]
Jul 14 20:19:22.558003 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:19:22.557977    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495b8bce_0e89_4cd8_a71a_07b84efb5f10.slice/crio-e483b95a337eb30e791e74a393b370ef8e6e41e6dcc282432558a701efec90f6 WatchSource:0}: Error finding container e483b95a337eb30e791e74a393b370ef8e6e41e6dcc282432558a701efec90f6: Status 404 returned error can't find the container with id e483b95a337eb30e791e74a393b370ef8e6e41e6dcc282432558a701efec90f6
Jul 14 20:19:23.187476 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:23.187438    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p" event={"ID":"495b8bce-0e89-4cd8-a71a-07b84efb5f10","Type":"ContainerStarted","Data":"60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6"}
Jul 14 20:19:23.187681 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:23.187497    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p" event={"ID":"495b8bce-0e89-4cd8-a71a-07b84efb5f10","Type":"ContainerStarted","Data":"e483b95a337eb30e791e74a393b370ef8e6e41e6dcc282432558a701efec90f6"}
Jul 14 20:19:23.187681 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:23.187546    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:23.264753 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:23.264652    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p" podStartSLOduration=1.838916891 podStartE2EDuration="2.264636672s" totalImagesPullingTime="425.719781ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:19:23.264461215 +0000 UTC m=+1657.398437295" watchObservedRunningTime="2026-07-14 20:19:23.264636672 +0000 UTC m=+1657.398612752"
Jul 14 20:19:23.429403 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:23.429366    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:24.182094 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:24.182038    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:29.198376 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:29.198337    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:19:37.065215 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:37.065179    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:37.277343 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:37.277314    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:41.627031 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:19:41.626946    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:25.791745 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:25.791657    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:26.021015 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:26.020967    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:32.203211 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:32.203163    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:33.106989 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.106953    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"]
Jul 14 20:20:33.107190 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.107166    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p" podUID="495b8bce-0e89-4cd8-a71a-07b84efb5f10" containerName="maas-api" containerID="cri-o://60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6" gracePeriod=30
Jul 14 20:20:33.208900 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.208842    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:33.358616 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.358547    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:20:33.485127 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.485085    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc9q7\" (UniqueName: \"kubernetes.io/projected/495b8bce-0e89-4cd8-a71a-07b84efb5f10-kube-api-access-lc9q7\") pod \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") "
Jul 14 20:20:33.485320 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.485148    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/495b8bce-0e89-4cd8-a71a-07b84efb5f10-openshift-service-ca\") pod \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") "
Jul 14 20:20:33.485320 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.485216    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/495b8bce-0e89-4cd8-a71a-07b84efb5f10-maas-api-tls\") pod \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\" (UID: \"495b8bce-0e89-4cd8-a71a-07b84efb5f10\") "
Jul 14 20:20:33.485509 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.485483    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/495b8bce-0e89-4cd8-a71a-07b84efb5f10-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "495b8bce-0e89-4cd8-a71a-07b84efb5f10" (UID: "495b8bce-0e89-4cd8-a71a-07b84efb5f10"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:20:33.487463 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.487429    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/495b8bce-0e89-4cd8-a71a-07b84efb5f10-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "495b8bce-0e89-4cd8-a71a-07b84efb5f10" (UID: "495b8bce-0e89-4cd8-a71a-07b84efb5f10"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:20:33.487593 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.487517    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495b8bce-0e89-4cd8-a71a-07b84efb5f10-kube-api-access-lc9q7" (OuterVolumeSpecName: "kube-api-access-lc9q7") pod "495b8bce-0e89-4cd8-a71a-07b84efb5f10" (UID: "495b8bce-0e89-4cd8-a71a-07b84efb5f10"). InnerVolumeSpecName "kube-api-access-lc9q7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:20:33.494446 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.494413    2584 generic.go:356] "Generic (PLEG): container finished" podID="495b8bce-0e89-4cd8-a71a-07b84efb5f10" containerID="60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6" exitCode=0
Jul 14 20:20:33.494591 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.494475    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"
Jul 14 20:20:33.494591 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.494483    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p" event={"ID":"495b8bce-0e89-4cd8-a71a-07b84efb5f10","Type":"ContainerDied","Data":"60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6"}
Jul 14 20:20:33.494591 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.494537    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p" event={"ID":"495b8bce-0e89-4cd8-a71a-07b84efb5f10","Type":"ContainerDied","Data":"e483b95a337eb30e791e74a393b370ef8e6e41e6dcc282432558a701efec90f6"}
Jul 14 20:20:33.494591 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.494566    2584 scope.go:117] "RemoveContainer" containerID="60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6"
Jul 14 20:20:33.504241 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.504216    2584 scope.go:117] "RemoveContainer" containerID="60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6"
Jul 14 20:20:33.504539 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:20:33.504520    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6\": container with ID starting with 60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6 not found: ID does not exist" containerID="60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6"
Jul 14 20:20:33.504581 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.504549    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6"} err="failed to get container status \"60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6\": rpc error: code = NotFound desc = could not find container \"60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6\": container with ID starting with 60e5346152e9f00d3e14fd73842591d815eff622a924aeb20bd5dbf4a31575e6 not found: ID does not exist"
Jul 14 20:20:33.538489 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.538450    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"]
Jul 14 20:20:33.565946 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.563328    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bc788bc2-dc7fc6446-9dc4p"]
Jul 14 20:20:33.586310 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.586262    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc9q7\" (UniqueName: \"kubernetes.io/projected/495b8bce-0e89-4cd8-a71a-07b84efb5f10-kube-api-access-lc9q7\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:20:33.586310 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.586308    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/495b8bce-0e89-4cd8-a71a-07b84efb5f10-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:20:33.586310 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:33.586319    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/495b8bce-0e89-4cd8-a71a-07b84efb5f10-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:20:34.360378 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:34.360339    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="495b8bce-0e89-4cd8-a71a-07b84efb5f10" path="/var/lib/kubelet/pods/495b8bce-0e89-4cd8-a71a-07b84efb5f10/volumes"
Jul 14 20:20:34.489351 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:34.489320    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:42.620723 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:42.620690    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:42.904167 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:42.904087    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:43.278157 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:43.278123    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:43.533022 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:43.532941    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:44.275621 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.275585    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:44.539976 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.539898    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"]
Jul 14 20:20:44.540608 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.540578    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495b8bce-0e89-4cd8-a71a-07b84efb5f10" containerName="maas-api"
Jul 14 20:20:44.540608 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.540608    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="495b8bce-0e89-4cd8-a71a-07b84efb5f10" containerName="maas-api"
Jul 14 20:20:44.540830 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.540668    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="495b8bce-0e89-4cd8-a71a-07b84efb5f10" containerName="maas-api"
Jul 14 20:20:44.543713 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.543690    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:44.557112 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.557083    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c7cbf2c9-serving-cert\""
Jul 14 20:20:44.573537 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.573509    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"]
Jul 14 20:20:44.582029 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.581998    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4868c207-6ae6-4bc7-b9ed-763114e15d31-openshift-service-ca\") pod \"maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:44.582185 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.582039    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4868c207-6ae6-4bc7-b9ed-763114e15d31-maas-api-tls\") pod \"maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:44.582185 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.582104    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmx2m\" (UniqueName: \"kubernetes.io/projected/4868c207-6ae6-4bc7-b9ed-763114e15d31-kube-api-access-dmx2m\") pod \"maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:44.623821 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.623784    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:44.683306 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.683263    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4868c207-6ae6-4bc7-b9ed-763114e15d31-openshift-service-ca\") pod \"maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:44.683306 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.683309    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4868c207-6ae6-4bc7-b9ed-763114e15d31-maas-api-tls\") pod \"maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:44.683577 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.683343    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmx2m\" (UniqueName: \"kubernetes.io/projected/4868c207-6ae6-4bc7-b9ed-763114e15d31-kube-api-access-dmx2m\") pod \"maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:44.683577 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:20:44.683475    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-serving-cert: secret "maas-api-e2e-ait-c7cbf2c9-serving-cert" not found
Jul 14 20:20:44.683577 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:20:44.683545    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4868c207-6ae6-4bc7-b9ed-763114e15d31-maas-api-tls podName:4868c207-6ae6-4bc7-b9ed-763114e15d31 nodeName:}" failed. No retries permitted until 2026-07-14 20:20:45.183529234 +0000 UTC m=+1739.317505293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4868c207-6ae6-4bc7-b9ed-763114e15d31-maas-api-tls") pod "maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd" (UID: "4868c207-6ae6-4bc7-b9ed-763114e15d31") : secret "maas-api-e2e-ait-c7cbf2c9-serving-cert" not found
Jul 14 20:20:44.684039 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.684017    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4868c207-6ae6-4bc7-b9ed-763114e15d31-openshift-service-ca\") pod \"maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:44.730944 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:44.730898    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmx2m\" (UniqueName: \"kubernetes.io/projected/4868c207-6ae6-4bc7-b9ed-763114e15d31-kube-api-access-dmx2m\") pod \"maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:45.015912 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:45.015860    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:45.186447 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:45.186412    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4868c207-6ae6-4bc7-b9ed-763114e15d31-maas-api-tls\") pod \"maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:45.189017 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:45.188995    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4868c207-6ae6-4bc7-b9ed-763114e15d31-maas-api-tls\") pod \"maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:45.411844 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:45.411751    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:45.455796 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:45.455761    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:45.625541 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:20:45.625506    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4868c207_6ae6_4bc7_b9ed_763114e15d31.slice/crio-813c5562492eb749af35828473ad55fc2a08d2cd7c77db3fc8493bd9dffdb101 WatchSource:0}: Error finding container 813c5562492eb749af35828473ad55fc2a08d2cd7c77db3fc8493bd9dffdb101: Status 404 returned error can't find the container with id 813c5562492eb749af35828473ad55fc2a08d2cd7c77db3fc8493bd9dffdb101
Jul 14 20:20:45.634934 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:45.634901    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"]
Jul 14 20:20:46.557443 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:46.557360    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd" event={"ID":"4868c207-6ae6-4bc7-b9ed-763114e15d31","Type":"ContainerStarted","Data":"97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6"}
Jul 14 20:20:46.557957 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:46.557514    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:20:46.557957 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:46.557557    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd" event={"ID":"4868c207-6ae6-4bc7-b9ed-763114e15d31","Type":"ContainerStarted","Data":"813c5562492eb749af35828473ad55fc2a08d2cd7c77db3fc8493bd9dffdb101"}
Jul 14 20:20:46.702699 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:46.702634    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd" podStartSLOduration=1.9988898659999998 podStartE2EDuration="2.702617177s" totalImagesPullingTime="703.727311ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:20:46.683253385 +0000 UTC m=+1740.817229464" watchObservedRunningTime="2026-07-14 20:20:46.702617177 +0000 UTC m=+1740.836593257"
Jul 14 20:20:47.397749 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:47.397711    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:47.997542 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:47.997508    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:49.437727 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:49.437688    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:49.623558 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:49.623528    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:51.090668 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:51.090627    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:51.438079 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:51.437990    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:52.567807 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:20:52.567781    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:21:46.357589 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:21:46.357557    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:21:46.360521 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:21:46.360494    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:22:00.181617 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.181574    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"]
Jul 14 20:22:00.182103 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.181837    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd" podUID="4868c207-6ae6-4bc7-b9ed-763114e15d31" containerName="maas-api" containerID="cri-o://97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6" gracePeriod=30
Jul 14 20:22:00.251228 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.251199    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:00.425460 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.425434    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:22:00.531182 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.531129    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmx2m\" (UniqueName: \"kubernetes.io/projected/4868c207-6ae6-4bc7-b9ed-763114e15d31-kube-api-access-dmx2m\") pod \"4868c207-6ae6-4bc7-b9ed-763114e15d31\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") "
Jul 14 20:22:00.531362 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.531199    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4868c207-6ae6-4bc7-b9ed-763114e15d31-maas-api-tls\") pod \"4868c207-6ae6-4bc7-b9ed-763114e15d31\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") "
Jul 14 20:22:00.531408 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.531366    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4868c207-6ae6-4bc7-b9ed-763114e15d31-openshift-service-ca\") pod \"4868c207-6ae6-4bc7-b9ed-763114e15d31\" (UID: \"4868c207-6ae6-4bc7-b9ed-763114e15d31\") "
Jul 14 20:22:00.531711 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.531675    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4868c207-6ae6-4bc7-b9ed-763114e15d31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4868c207-6ae6-4bc7-b9ed-763114e15d31" (UID: "4868c207-6ae6-4bc7-b9ed-763114e15d31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:22:00.533372 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.533342    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4868c207-6ae6-4bc7-b9ed-763114e15d31-kube-api-access-dmx2m" (OuterVolumeSpecName: "kube-api-access-dmx2m") pod "4868c207-6ae6-4bc7-b9ed-763114e15d31" (UID: "4868c207-6ae6-4bc7-b9ed-763114e15d31"). InnerVolumeSpecName "kube-api-access-dmx2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:22:00.533479 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.533403    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4868c207-6ae6-4bc7-b9ed-763114e15d31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4868c207-6ae6-4bc7-b9ed-763114e15d31" (UID: "4868c207-6ae6-4bc7-b9ed-763114e15d31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:22:00.632100 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.632064    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmx2m\" (UniqueName: \"kubernetes.io/projected/4868c207-6ae6-4bc7-b9ed-763114e15d31-kube-api-access-dmx2m\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:22:00.632100 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.632093    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4868c207-6ae6-4bc7-b9ed-763114e15d31-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:22:00.632100 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.632104    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4868c207-6ae6-4bc7-b9ed-763114e15d31-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:22:00.867132 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.867038    2584 generic.go:356] "Generic (PLEG): container finished" podID="4868c207-6ae6-4bc7-b9ed-763114e15d31" containerID="97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6" exitCode=0
Jul 14 20:22:00.867132 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.867099    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"
Jul 14 20:22:00.867314 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.867126    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd" event={"ID":"4868c207-6ae6-4bc7-b9ed-763114e15d31","Type":"ContainerDied","Data":"97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6"}
Jul 14 20:22:00.867314 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.867208    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd" event={"ID":"4868c207-6ae6-4bc7-b9ed-763114e15d31","Type":"ContainerDied","Data":"813c5562492eb749af35828473ad55fc2a08d2cd7c77db3fc8493bd9dffdb101"}
Jul 14 20:22:00.867314 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.867232    2584 scope.go:117] "RemoveContainer" containerID="97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6"
Jul 14 20:22:00.876428 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.876401    2584 scope.go:117] "RemoveContainer" containerID="97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6"
Jul 14 20:22:00.876675 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:22:00.876659    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6\": container with ID starting with 97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6 not found: ID does not exist" containerID="97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6"
Jul 14 20:22:00.876716 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.876684    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6"} err="failed to get container status \"97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6\": rpc error: code = NotFound desc = could not find container \"97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6\": container with ID starting with 97c44b101518ab3d3133a6588c7a6f6581fbe0065964c29c8fd0392ad2e718f6 not found: ID does not exist"
Jul 14 20:22:00.895958 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.895926    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"]
Jul 14 20:22:00.900674 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:00.900646    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c7cbf2c9-57b75c6585-n4szd"]
Jul 14 20:22:02.358905 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:02.358852    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4868c207-6ae6-4bc7-b9ed-763114e15d31" path="/var/lib/kubelet/pods/4868c207-6ae6-4bc7-b9ed-763114e15d31/volumes"
Jul 14 20:22:04.678572 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:04.678540    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:12.399582 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:12.399545    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:12.550368 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:12.550316    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:15.736117 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:15.736077    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:16.057266 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:16.057237    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:17.312822 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.312788    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:17.485676 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.485639    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"]
Jul 14 20:22:17.486052 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.486038    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4868c207-6ae6-4bc7-b9ed-763114e15d31" containerName="maas-api"
Jul 14 20:22:17.486104 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.486054    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4868c207-6ae6-4bc7-b9ed-763114e15d31" containerName="maas-api"
Jul 14 20:22:17.486139 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.486117    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4868c207-6ae6-4bc7-b9ed-763114e15d31" containerName="maas-api"
Jul 14 20:22:17.489099 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.489079    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:17.495895 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.495855    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-7044c372-serving-cert\""
Jul 14 20:22:17.537447 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.537408    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"]
Jul 14 20:22:17.547357 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.547316    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:17.583943 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.583814    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49bfaf48-b506-401f-9fae-05f7b827140f-openshift-service-ca\") pod \"maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:17.583943 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.583856    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v88p5\" (UniqueName: \"kubernetes.io/projected/49bfaf48-b506-401f-9fae-05f7b827140f-kube-api-access-v88p5\") pod \"maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:17.583943 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.583929    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49bfaf48-b506-401f-9fae-05f7b827140f-maas-api-tls\") pod \"maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:17.684808 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.684776    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49bfaf48-b506-401f-9fae-05f7b827140f-openshift-service-ca\") pod \"maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:17.684808 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.684812    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v88p5\" (UniqueName: \"kubernetes.io/projected/49bfaf48-b506-401f-9fae-05f7b827140f-kube-api-access-v88p5\") pod \"maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:17.685101 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.684845    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49bfaf48-b506-401f-9fae-05f7b827140f-maas-api-tls\") pod \"maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:17.685101 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:22:17.684973    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-serving-cert: secret "maas-api-e2e-derive-7044c372-serving-cert" not found
Jul 14 20:22:17.685101 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:22:17.685048    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49bfaf48-b506-401f-9fae-05f7b827140f-maas-api-tls podName:49bfaf48-b506-401f-9fae-05f7b827140f nodeName:}" failed. No retries permitted until 2026-07-14 20:22:18.185032997 +0000 UTC m=+1832.319009055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/49bfaf48-b506-401f-9fae-05f7b827140f-maas-api-tls") pod "maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf" (UID: "49bfaf48-b506-401f-9fae-05f7b827140f") : secret "maas-api-e2e-derive-7044c372-serving-cert" not found
Jul 14 20:22:17.685522 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.685500    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49bfaf48-b506-401f-9fae-05f7b827140f-openshift-service-ca\") pod \"maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:17.701482 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.701448    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v88p5\" (UniqueName: \"kubernetes.io/projected/49bfaf48-b506-401f-9fae-05f7b827140f-kube-api-access-v88p5\") pod \"maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:17.825888 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.825831    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:17.991245 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:17.991211    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:18.189332 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:18.189297    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49bfaf48-b506-401f-9fae-05f7b827140f-maas-api-tls\") pod \"maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:18.191960 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:18.191928    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49bfaf48-b506-401f-9fae-05f7b827140f-maas-api-tls\") pod \"maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:18.398589 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:18.398492    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:18.466722 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:18.466683    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:18.552467 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:18.552431    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"]
Jul 14 20:22:18.560975 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:22:18.560948    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49bfaf48_b506_401f_9fae_05f7b827140f.slice/crio-23ceab16cd7b1fb18ea99ef7b129a2b54a24e5d07ccc89091cc503a375e04ed6 WatchSource:0}: Error finding container 23ceab16cd7b1fb18ea99ef7b129a2b54a24e5d07ccc89091cc503a375e04ed6: Status 404 returned error can't find the container with id 23ceab16cd7b1fb18ea99ef7b129a2b54a24e5d07ccc89091cc503a375e04ed6
Jul 14 20:22:18.592202 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:18.592164    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:18.946247 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:18.946215    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf" event={"ID":"49bfaf48-b506-401f-9fae-05f7b827140f","Type":"ContainerStarted","Data":"23ceab16cd7b1fb18ea99ef7b129a2b54a24e5d07ccc89091cc503a375e04ed6"}
Jul 14 20:22:19.952157 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:19.952124    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf" event={"ID":"49bfaf48-b506-401f-9fae-05f7b827140f","Type":"ContainerStarted","Data":"8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847"}
Jul 14 20:22:19.952569 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:19.952266    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:22:19.983711 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:19.983652    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf" podStartSLOduration=2.520594453 podStartE2EDuration="2.983635042s" totalImagesPullingTime="463.040589ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:19.982817421 +0000 UTC m=+1834.116793512" watchObservedRunningTime="2026-07-14 20:22:19.983635042 +0000 UTC m=+1834.117611122"
Jul 14 20:22:22.161761 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:22.161729    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:22.281606 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:22.281573    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:25.926435 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:25.926394    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:25.962524 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:22:25.962497    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:23:16.784886 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:16.784792    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:22.254808 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.254772    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"]
Jul 14 20:23:22.255349 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.254996    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf" podUID="49bfaf48-b506-401f-9fae-05f7b827140f" containerName="maas-api" containerID="cri-o://8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847" gracePeriod=30
Jul 14 20:23:22.294246 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.294205    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:22.496427 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.496398    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:23:22.531265 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.531177    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49bfaf48-b506-401f-9fae-05f7b827140f-maas-api-tls\") pod \"49bfaf48-b506-401f-9fae-05f7b827140f\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") "
Jul 14 20:23:22.531265 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.531225    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49bfaf48-b506-401f-9fae-05f7b827140f-openshift-service-ca\") pod \"49bfaf48-b506-401f-9fae-05f7b827140f\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") "
Jul 14 20:23:22.531265 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.531256    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v88p5\" (UniqueName: \"kubernetes.io/projected/49bfaf48-b506-401f-9fae-05f7b827140f-kube-api-access-v88p5\") pod \"49bfaf48-b506-401f-9fae-05f7b827140f\" (UID: \"49bfaf48-b506-401f-9fae-05f7b827140f\") "
Jul 14 20:23:22.531702 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.531676    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49bfaf48-b506-401f-9fae-05f7b827140f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "49bfaf48-b506-401f-9fae-05f7b827140f" (UID: "49bfaf48-b506-401f-9fae-05f7b827140f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:23:22.533541 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.533508    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49bfaf48-b506-401f-9fae-05f7b827140f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "49bfaf48-b506-401f-9fae-05f7b827140f" (UID: "49bfaf48-b506-401f-9fae-05f7b827140f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:23:22.533663 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.533570    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49bfaf48-b506-401f-9fae-05f7b827140f-kube-api-access-v88p5" (OuterVolumeSpecName: "kube-api-access-v88p5") pod "49bfaf48-b506-401f-9fae-05f7b827140f" (UID: "49bfaf48-b506-401f-9fae-05f7b827140f"). InnerVolumeSpecName "kube-api-access-v88p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:23:22.631770 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.631737    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/49bfaf48-b506-401f-9fae-05f7b827140f-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:23:22.631770 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.631763    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/49bfaf48-b506-401f-9fae-05f7b827140f-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:23:22.631770 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:22.631775    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v88p5\" (UniqueName: \"kubernetes.io/projected/49bfaf48-b506-401f-9fae-05f7b827140f-kube-api-access-v88p5\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:23:23.229728 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:23.229694    2584 generic.go:356] "Generic (PLEG): container finished" podID="49bfaf48-b506-401f-9fae-05f7b827140f" containerID="8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847" exitCode=0
Jul 14 20:23:23.229928 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:23.229736    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"
Jul 14 20:23:23.229928 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:23.229757    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf" event={"ID":"49bfaf48-b506-401f-9fae-05f7b827140f","Type":"ContainerDied","Data":"8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847"}
Jul 14 20:23:23.229928 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:23.229802    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf" event={"ID":"49bfaf48-b506-401f-9fae-05f7b827140f","Type":"ContainerDied","Data":"23ceab16cd7b1fb18ea99ef7b129a2b54a24e5d07ccc89091cc503a375e04ed6"}
Jul 14 20:23:23.229928 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:23.229823    2584 scope.go:117] "RemoveContainer" containerID="8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847"
Jul 14 20:23:23.239109 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:23.239090    2584 scope.go:117] "RemoveContainer" containerID="8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847"
Jul 14 20:23:23.239400 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:23:23.239384    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847\": container with ID starting with 8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847 not found: ID does not exist" containerID="8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847"
Jul 14 20:23:23.239454 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:23.239410    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847"} err="failed to get container status \"8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847\": rpc error: code = NotFound desc = could not find container \"8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847\": container with ID starting with 8381a86108f37b4576ea6413539ec750e3084f5e1d3ddca409f070a8e8cba847 not found: ID does not exist"
Jul 14 20:23:23.254368 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:23.254322    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"]
Jul 14 20:23:23.255754 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:23.255733    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7044c372-5fc5459b95-jpxnf"]
Jul 14 20:23:24.359452 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:24.359419    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49bfaf48-b506-401f-9fae-05f7b827140f" path="/var/lib/kubelet/pods/49bfaf48-b506-401f-9fae-05f7b827140f/volumes"
Jul 14 20:23:26.736496 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:26.736447    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:33.864222 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:33.864176    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:34.078096 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:34.078057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:37.009144 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:37.009106    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:37.647985 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:37.647953    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:37.745212 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:37.745181    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:37.845793 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:37.845750    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:39.493486 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:39.493457    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:43.673345 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:43.673311    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:45.408797 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:45.408765    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:45.507913 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:45.507857    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:45.606120 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:45.606087    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:45.705589 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:45.705558    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:46.207079 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:46.207044    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:51.541028 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:51.540985    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:23:51.646091 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:23:51.646060    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:12.348409 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:24:12.348370    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:19.375269 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:24:19.375238    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:19.488941 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:24:19.488906    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:19.587011 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:24:19.586967    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:35.656082 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:24:35.656046    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:41.721453 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:24:41.721372    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:41.846253 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:24:41.846218    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:41.973177 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:24:41.973094    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:52.670544 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:24:52.670508    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:53.512704 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:24:53.512668    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:00.381164 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:00.381129    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:00.484538 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:00.484499    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:00.620064 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:00.620030    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:00.716745 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:00.716715    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:01.645846 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:01.645814    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:01.743623 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:01.743590    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:01.899410 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:01.899326    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:03.775574 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:03.775542    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:10.659165 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:10.659130    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:10.759000 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:10.758967    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:11.465155 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:11.465119    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:17.484291 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:17.484248    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:17.588841 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:17.588802    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:17.751833 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:17.751756    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:18.529052 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:18.529016    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:18.974731 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:18.974699    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:21.713469 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.713441    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:21.815797 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.815767    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:21.849213 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.849184    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"]
Jul 14 20:25:21.849498 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.849485    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49bfaf48-b506-401f-9fae-05f7b827140f" containerName="maas-api"
Jul 14 20:25:21.849561 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.849498    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="49bfaf48-b506-401f-9fae-05f7b827140f" containerName="maas-api"
Jul 14 20:25:21.849616 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.849561    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="49bfaf48-b506-401f-9fae-05f7b827140f" containerName="maas-api"
Jul 14 20:25:21.852462 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.852441    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:21.860371 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.860347    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d080ee51-serving-cert\""
Jul 14 20:25:21.901667 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.901637    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"]
Jul 14 20:25:21.912417 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.912386    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b01ae13-cedc-4087-99c5-3720fbc1af19-openshift-service-ca\") pod \"maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:21.912545 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.912449    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b01ae13-cedc-4087-99c5-3720fbc1af19-maas-api-tls\") pod \"maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:21.912545 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.912528    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvbcb\" (UniqueName: \"kubernetes.io/projected/5b01ae13-cedc-4087-99c5-3720fbc1af19-kube-api-access-qvbcb\") pod \"maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:21.989666 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:21.989591    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:22.013884 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.013841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b01ae13-cedc-4087-99c5-3720fbc1af19-maas-api-tls\") pod \"maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:22.013992 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.013919    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbcb\" (UniqueName: \"kubernetes.io/projected/5b01ae13-cedc-4087-99c5-3720fbc1af19-kube-api-access-qvbcb\") pod \"maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:22.014030 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.014004    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b01ae13-cedc-4087-99c5-3720fbc1af19-openshift-service-ca\") pod \"maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:22.014655 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.014631    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b01ae13-cedc-4087-99c5-3720fbc1af19-openshift-service-ca\") pod \"maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:22.016535 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.016514    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b01ae13-cedc-4087-99c5-3720fbc1af19-maas-api-tls\") pod \"maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:22.023038 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.023011    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvbcb\" (UniqueName: \"kubernetes.io/projected/5b01ae13-cedc-4087-99c5-3720fbc1af19-kube-api-access-qvbcb\") pod \"maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:22.098466 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.098434    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:22.163379 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.163340    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:22.309830 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.309808    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"]
Jul 14 20:25:22.312087 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:25:22.312059    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b01ae13_cedc_4087_99c5_3720fbc1af19.slice/crio-bc8c53d24f8d904ee2ef32b83940a97414b94a1a1d1282cc66e60f25e1b6f4d9 WatchSource:0}: Error finding container bc8c53d24f8d904ee2ef32b83940a97414b94a1a1d1282cc66e60f25e1b6f4d9: Status 404 returned error can't find the container with id bc8c53d24f8d904ee2ef32b83940a97414b94a1a1d1282cc66e60f25e1b6f4d9
Jul 14 20:25:22.313443 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.313423    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:25:22.692859 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.692770    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:22.729550 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.729525    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd" event={"ID":"5b01ae13-cedc-4087-99c5-3720fbc1af19","Type":"ContainerStarted","Data":"bc8c53d24f8d904ee2ef32b83940a97414b94a1a1d1282cc66e60f25e1b6f4d9"}
Jul 14 20:25:22.794013 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:22.793983    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:23.735075 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:23.735042    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd" event={"ID":"5b01ae13-cedc-4087-99c5-3720fbc1af19","Type":"ContainerStarted","Data":"7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc"}
Jul 14 20:25:23.735461 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:23.735141    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:26.127512 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:26.127475    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:26.932345 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:26.932314    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:27.032106 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:27.032068    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:27.379071 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:27.379032    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:29.744770 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:29.744739    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:29.766293 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:29.766241    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd" podStartSLOduration=8.358887298 podStartE2EDuration="8.766224336s" totalImagesPullingTime="407.337038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:25:23.758184638 +0000 UTC m=+2017.892160717" watchObservedRunningTime="2026-07-14 20:25:29.766224336 +0000 UTC m=+2023.900200415"
Jul 14 20:25:34.029327 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:34.029288    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:34.163332 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:34.163296    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:45.201448 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.201413    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"]
Jul 14 20:25:45.201963 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.201620    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd" podUID="5b01ae13-cedc-4087-99c5-3720fbc1af19" containerName="maas-api" containerID="cri-o://7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc" gracePeriod=30
Jul 14 20:25:45.239615 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.239579    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:45.448978 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.448951    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:45.523388 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.523299    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b01ae13-cedc-4087-99c5-3720fbc1af19-maas-api-tls\") pod \"5b01ae13-cedc-4087-99c5-3720fbc1af19\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") "
Jul 14 20:25:45.523388 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.523342    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvbcb\" (UniqueName: \"kubernetes.io/projected/5b01ae13-cedc-4087-99c5-3720fbc1af19-kube-api-access-qvbcb\") pod \"5b01ae13-cedc-4087-99c5-3720fbc1af19\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") "
Jul 14 20:25:45.523602 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.523429    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b01ae13-cedc-4087-99c5-3720fbc1af19-openshift-service-ca\") pod \"5b01ae13-cedc-4087-99c5-3720fbc1af19\" (UID: \"5b01ae13-cedc-4087-99c5-3720fbc1af19\") "
Jul 14 20:25:45.523820 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.523795    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b01ae13-cedc-4087-99c5-3720fbc1af19-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b01ae13-cedc-4087-99c5-3720fbc1af19" (UID: "5b01ae13-cedc-4087-99c5-3720fbc1af19"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:25:45.525552 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.525528    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b01ae13-cedc-4087-99c5-3720fbc1af19-kube-api-access-qvbcb" (OuterVolumeSpecName: "kube-api-access-qvbcb") pod "5b01ae13-cedc-4087-99c5-3720fbc1af19" (UID: "5b01ae13-cedc-4087-99c5-3720fbc1af19"). InnerVolumeSpecName "kube-api-access-qvbcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:25:45.525606 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.525532    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b01ae13-cedc-4087-99c5-3720fbc1af19-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b01ae13-cedc-4087-99c5-3720fbc1af19" (UID: "5b01ae13-cedc-4087-99c5-3720fbc1af19"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:25:45.624535 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.624487    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b01ae13-cedc-4087-99c5-3720fbc1af19-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:25:45.624535 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.624530    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b01ae13-cedc-4087-99c5-3720fbc1af19-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:25:45.624535 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.624539    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvbcb\" (UniqueName: \"kubernetes.io/projected/5b01ae13-cedc-4087-99c5-3720fbc1af19-kube-api-access-qvbcb\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:25:45.829707 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.829620    2584 generic.go:356] "Generic (PLEG): container finished" podID="5b01ae13-cedc-4087-99c5-3720fbc1af19" containerID="7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc" exitCode=0
Jul 14 20:25:45.829707 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.829664    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd" event={"ID":"5b01ae13-cedc-4087-99c5-3720fbc1af19","Type":"ContainerDied","Data":"7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc"}
Jul 14 20:25:45.829707 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.829700    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd" event={"ID":"5b01ae13-cedc-4087-99c5-3720fbc1af19","Type":"ContainerDied","Data":"bc8c53d24f8d904ee2ef32b83940a97414b94a1a1d1282cc66e60f25e1b6f4d9"}
Jul 14 20:25:45.829980 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.829720    2584 scope.go:117] "RemoveContainer" containerID="7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc"
Jul 14 20:25:45.829980 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.829665    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"
Jul 14 20:25:45.838993 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.838970    2584 scope.go:117] "RemoveContainer" containerID="7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc"
Jul 14 20:25:45.839276 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:25:45.839255    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc\": container with ID starting with 7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc not found: ID does not exist" containerID="7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc"
Jul 14 20:25:45.839324 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.839285    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc"} err="failed to get container status \"7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc\": rpc error: code = NotFound desc = could not find container \"7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc\": container with ID starting with 7765b8428a25fb2ac2daa32dbe0b15abae23b56246b916078830aaeee992efcc not found: ID does not exist"
Jul 14 20:25:45.856669 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.856638    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"]
Jul 14 20:25:45.863972 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:45.863943    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d080ee51-57cdb97bdf-ltkdd"]
Jul 14 20:25:46.359395 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:46.359362    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b01ae13-cedc-4087-99c5-3720fbc1af19" path="/var/lib/kubelet/pods/5b01ae13-cedc-4087-99c5-3720fbc1af19/volumes"
Jul 14 20:25:49.700955 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:49.700921    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:51.077016 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:51.076974    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:51.233302 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:51.233268    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:56.737520 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:56.737482    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:56.880953 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:25:56.880916    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:00.679340 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:00.679301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:00.863256 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:00.863223    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:01.112154 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:01.112121    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:01.263081 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:01.263041    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:01.363935 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:01.363829    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:03.020924 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:03.020890    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:03.104065 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:03.104026    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:07.579689 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:07.579607    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:07.681429 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:07.681400    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:07.797929 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:07.797897    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:08.051832 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:08.051800    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:14.203197 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:14.203160    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:14.380162 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:14.380131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:21.689166 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:21.689124    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:22.161317 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:22.161288    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:22.487922 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:22.487891    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:25.124991 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.124953    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:25.331671 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.331636    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:25.539119 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.539080    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"]
Jul 14 20:26:25.539392 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.539379    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b01ae13-cedc-4087-99c5-3720fbc1af19" containerName="maas-api"
Jul 14 20:26:25.539438 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.539393    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b01ae13-cedc-4087-99c5-3720fbc1af19" containerName="maas-api"
Jul 14 20:26:25.539481 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.539457    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b01ae13-cedc-4087-99c5-3720fbc1af19" containerName="maas-api"
Jul 14 20:26:25.542392 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.542375    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:25.551549 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.551525    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-08c922cd-serving-cert\""
Jul 14 20:26:25.574738 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.574706    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"]
Jul 14 20:26:25.660474 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.660435    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prnww\" (UniqueName: \"kubernetes.io/projected/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-kube-api-access-prnww\") pod \"maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:25.660666 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.660486    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-maas-api-tls\") pod \"maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:25.660666 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.660548    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-openshift-service-ca\") pod \"maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:25.754582 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.754546    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:25.761717 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.761694    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prnww\" (UniqueName: \"kubernetes.io/projected/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-kube-api-access-prnww\") pod \"maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:25.761817 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.761727    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-maas-api-tls\") pod \"maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:25.761817 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.761780    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-openshift-service-ca\") pod \"maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:25.762532 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.762506    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-openshift-service-ca\") pod \"maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:25.764370 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.764352    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-maas-api-tls\") pod \"maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:25.780190 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.780156    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prnww\" (UniqueName: \"kubernetes.io/projected/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-kube-api-access-prnww\") pod \"maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:25.853041 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:25.852948    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:26.041536 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:26.041507    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"]
Jul 14 20:26:26.044823 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:26:26.044789    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c26967_6ad5_45fc_a0e2_579ec8aa7c01.slice/crio-8a3645837c6ae7dbecfb88879299a9588395ab6d2cb360f786b5484631f0cba2 WatchSource:0}: Error finding container 8a3645837c6ae7dbecfb88879299a9588395ab6d2cb360f786b5484631f0cba2: Status 404 returned error can't find the container with id 8a3645837c6ae7dbecfb88879299a9588395ab6d2cb360f786b5484631f0cba2
Jul 14 20:26:26.148340 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:26.148228    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:27.003712 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:27.003670    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp" event={"ID":"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01","Type":"ContainerStarted","Data":"cefe75946843709f62ec0155d455612b712afef4756643d4bdb38978896e600a"}
Jul 14 20:26:27.003929 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:27.003728    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp" event={"ID":"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01","Type":"ContainerStarted","Data":"8a3645837c6ae7dbecfb88879299a9588395ab6d2cb360f786b5484631f0cba2"}
Jul 14 20:26:27.003929 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:27.003772    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:27.040758 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:27.040697    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp" podStartSLOduration=1.674043471 podStartE2EDuration="2.04067589s" totalImagesPullingTime="366.632419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:27.039097666 +0000 UTC m=+2081.173073746" watchObservedRunningTime="2026-07-14 20:26:27.04067589 +0000 UTC m=+2081.174651971"
Jul 14 20:26:27.200494 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:27.200455    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:27.382902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:27.382786    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:29.634070 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:29.634038    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:33.013120 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:33.013088    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:26:36.939008 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:36.938976    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:46.380853 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:46.380821    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:26:46.386045 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:26:46.386024    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:27:06.951788 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:06.951741    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:27:08.950546 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:08.950515    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"]
Jul 14 20:27:08.950967 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:08.950713    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp" podUID="a1c26967-6ad5-45fc-a0e2-579ec8aa7c01" containerName="maas-api" containerID="cri-o://cefe75946843709f62ec0155d455612b712afef4756643d4bdb38978896e600a" gracePeriod=30
Jul 14 20:27:08.994773 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:08.994738    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:27:09.175562 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.175534    2584 generic.go:356] "Generic (PLEG): container finished" podID="a1c26967-6ad5-45fc-a0e2-579ec8aa7c01" containerID="cefe75946843709f62ec0155d455612b712afef4756643d4bdb38978896e600a" exitCode=0
Jul 14 20:27:09.175704 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.175605    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp" event={"ID":"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01","Type":"ContainerDied","Data":"cefe75946843709f62ec0155d455612b712afef4756643d4bdb38978896e600a"}
Jul 14 20:27:09.197143 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.197118    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:27:09.214504 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.214444    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-openshift-service-ca\") pod \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") "
Jul 14 20:27:09.214504 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.214495    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prnww\" (UniqueName: \"kubernetes.io/projected/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-kube-api-access-prnww\") pod \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") "
Jul 14 20:27:09.214675 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.214534    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-maas-api-tls\") pod \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\" (UID: \"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01\") "
Jul 14 20:27:09.214803 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.214777    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1c26967-6ad5-45fc-a0e2-579ec8aa7c01" (UID: "a1c26967-6ad5-45fc-a0e2-579ec8aa7c01"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:27:09.216633 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.216612    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-kube-api-access-prnww" (OuterVolumeSpecName: "kube-api-access-prnww") pod "a1c26967-6ad5-45fc-a0e2-579ec8aa7c01" (UID: "a1c26967-6ad5-45fc-a0e2-579ec8aa7c01"). InnerVolumeSpecName "kube-api-access-prnww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:27:09.216692 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.216613    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1c26967-6ad5-45fc-a0e2-579ec8aa7c01" (UID: "a1c26967-6ad5-45fc-a0e2-579ec8aa7c01"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:27:09.315795 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.315762    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:27:09.315795 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.315790    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:27:09.315795 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:09.315802    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prnww\" (UniqueName: \"kubernetes.io/projected/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01-kube-api-access-prnww\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:27:10.180853 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:10.180823    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"
Jul 14 20:27:10.181422 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:10.180830    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp" event={"ID":"a1c26967-6ad5-45fc-a0e2-579ec8aa7c01","Type":"ContainerDied","Data":"8a3645837c6ae7dbecfb88879299a9588395ab6d2cb360f786b5484631f0cba2"}
Jul 14 20:27:10.181422 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:10.180964    2584 scope.go:117] "RemoveContainer" containerID="cefe75946843709f62ec0155d455612b712afef4756643d4bdb38978896e600a"
Jul 14 20:27:10.204509 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:10.204478    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"]
Jul 14 20:27:10.216055 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:10.213108    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-08c922cd-848dd549b6-lnpsp"]
Jul 14 20:27:10.358700 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:10.358663    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1c26967-6ad5-45fc-a0e2-579ec8aa7c01" path="/var/lib/kubelet/pods/a1c26967-6ad5-45fc-a0e2-579ec8aa7c01/volumes"
Jul 14 20:27:13.449474 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:13.449437    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:27:18.502668 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:18.502628    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:27:54.916997 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:54.916956    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:27:56.078188 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:27:56.078154    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:02.011904 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:02.011851    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:02.170886 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:02.170834    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:06.086019 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:06.085986    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:06.374587 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:06.374507    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:07.641149 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:07.641115    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:07.738433 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:07.738401    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:07.838487 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:07.838454    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:08.737721 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:08.737685    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:08.834063 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:08.834032    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:08.934755 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:08.934725    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:10.571772 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:10.571735    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:16.745127 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:16.745098    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:16.847831 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:16.847796    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:17.515560 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:17.515522    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:23.883534 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:23.883503    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:24.044755 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:24.044725    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:24.153226 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:24.153150    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:34.755156 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:34.755117    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:35.210207 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:35.210176    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:56.286808 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:28:56.286772    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:02.725712 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:02.725677    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:02.856493 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:02.856457    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:03.122574 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:03.122486    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:03.524742 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:03.524709    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:03.858498 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:03.858416    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:06.889261 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:06.889190    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:06.992298 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:06.992266    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"]
Jul 14 20:29:06.992689 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:06.992670    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1c26967-6ad5-45fc-a0e2-579ec8aa7c01" containerName="maas-api"
Jul 14 20:29:06.992689 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:06.992690    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1c26967-6ad5-45fc-a0e2-579ec8aa7c01" containerName="maas-api"
Jul 14 20:29:06.992827 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:06.992787    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1c26967-6ad5-45fc-a0e2-579ec8aa7c01" containerName="maas-api"
Jul 14 20:29:06.995896 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:06.995850    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:06.999283 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:06.999256    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e56337-serving-cert\""
Jul 14 20:29:07.014067 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.014042    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"]
Jul 14 20:29:07.015123 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.015093    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:07.107830 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.107800    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-maas-api-tls\") pod \"maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:07.108023 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.107849    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:07.108023 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.107889    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjm7n\" (UniqueName: \"kubernetes.io/projected/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-kube-api-access-vjm7n\") pod \"maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:07.121636 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.121603    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:07.208587 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.208554    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-maas-api-tls\") pod \"maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:07.208773 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.208608    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:07.208773 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.208627    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjm7n\" (UniqueName: \"kubernetes.io/projected/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-kube-api-access-vjm7n\") pod \"maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:07.209315 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.209294    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:07.211245 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.211223    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-maas-api-tls\") pod \"maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:07.223256 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.223234    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjm7n\" (UniqueName: \"kubernetes.io/projected/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-kube-api-access-vjm7n\") pod \"maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:07.260641 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.260615    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:07.305773 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.305744    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:07.452068 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.452037    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"]
Jul 14 20:29:07.454180 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:29:07.454149    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41aa31f5_b4d2_4ac5_bc7a_4264baf27968.slice/crio-c2acecdf89721b9331764c1114bfecbf101ccf2cb2d7ce1587e1b22544129490 WatchSource:0}: Error finding container c2acecdf89721b9331764c1114bfecbf101ccf2cb2d7ce1587e1b22544129490: Status 404 returned error can't find the container with id c2acecdf89721b9331764c1114bfecbf101ccf2cb2d7ce1587e1b22544129490
Jul 14 20:29:07.665194 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:07.665102    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk" event={"ID":"41aa31f5-b4d2-4ac5-bc7a-4264baf27968","Type":"ContainerStarted","Data":"c2acecdf89721b9331764c1114bfecbf101ccf2cb2d7ce1587e1b22544129490"}
Jul 14 20:29:08.023122 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:08.023088    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:08.225335 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:08.225304    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:08.671364 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:08.671277    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk" event={"ID":"41aa31f5-b4d2-4ac5-bc7a-4264baf27968","Type":"ContainerStarted","Data":"934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947"}
Jul 14 20:29:08.671516 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:08.671392    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:08.709198 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:08.709147    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk" podStartSLOduration=2.246969135 podStartE2EDuration="2.709131485s" totalImagesPullingTime="462.16235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:29:08.706257661 +0000 UTC m=+2242.840233739" watchObservedRunningTime="2026-07-14 20:29:08.709131485 +0000 UTC m=+2242.843107611"
Jul 14 20:29:11.394978 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:11.394938    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:11.788858 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:11.788823    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:12.523949 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:12.523909    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:12.608379 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:12.608340    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:14.681249 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:14.681225    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:29:14.890065 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:14.890029    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:15.005300 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.005266    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:15.019342 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.019311    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"]
Jul 14 20:29:15.023296 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.023276    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:15.027888 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:29:15.027844    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6\" is forbidden: User \"system:node:ip-10-0-142-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-142-56.ec2.internal' and this object" podUID="8992a06c-ea3c-4022-abbf-ef9a02d332f3" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:15.028021 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:29:15.027993    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-e2e-inf-b-d86aa8-serving-cert\" is forbidden: User \"system:node:ip-10-0-142-56.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-142-56.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d86aa8-serving-cert\"" type="*v1.Secret"
Jul 14 20:29:15.076078 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.076047    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmzk\" (UniqueName: \"kubernetes.io/projected/8992a06c-ea3c-4022-abbf-ef9a02d332f3-kube-api-access-hsmzk\") pod \"maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:15.076078 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.076090    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8992a06c-ea3c-4022-abbf-ef9a02d332f3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:15.076299 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.076175    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8992a06c-ea3c-4022-abbf-ef9a02d332f3-maas-api-tls\") pod \"maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:15.113449 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.113413    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"]
Jul 14 20:29:15.159765 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.159732    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:15.177407 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.177375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8992a06c-ea3c-4022-abbf-ef9a02d332f3-maas-api-tls\") pod \"maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:15.177579 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.177420    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmzk\" (UniqueName: \"kubernetes.io/projected/8992a06c-ea3c-4022-abbf-ef9a02d332f3-kube-api-access-hsmzk\") pod \"maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:15.177579 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.177459    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8992a06c-ea3c-4022-abbf-ef9a02d332f3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:15.178129 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.178107    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8992a06c-ea3c-4022-abbf-ef9a02d332f3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:15.193749 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.193718    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmzk\" (UniqueName: \"kubernetes.io/projected/8992a06c-ea3c-4022-abbf-ef9a02d332f3-kube-api-access-hsmzk\") pod \"maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:15.281713 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.281640    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:15.784542 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.784502    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:15.887440 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:15.887401    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:16.178292 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:29:16.178198    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-serving-cert: failed to sync secret cache: timed out waiting for the condition
Jul 14 20:29:16.178292 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:29:16.178284    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8992a06c-ea3c-4022-abbf-ef9a02d332f3-maas-api-tls podName:8992a06c-ea3c-4022-abbf-ef9a02d332f3 nodeName:}" failed. No retries permitted until 2026-07-14 20:29:16.678266426 +0000 UTC m=+2250.812242499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8992a06c-ea3c-4022-abbf-ef9a02d332f3-maas-api-tls") pod "maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6" (UID: "8992a06c-ea3c-4022-abbf-ef9a02d332f3") : failed to sync secret cache: timed out waiting for the condition
Jul 14 20:29:16.459619 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:16.459593    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d86aa8-serving-cert\""
Jul 14 20:29:16.690694 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:16.690655    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8992a06c-ea3c-4022-abbf-ef9a02d332f3-maas-api-tls\") pod \"maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:16.693237 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:16.693213    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8992a06c-ea3c-4022-abbf-ef9a02d332f3-maas-api-tls\") pod \"maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:16.834691 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:16.834600    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:16.969579 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:16.969557    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"]
Jul 14 20:29:16.972102 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:29:16.972068    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8992a06c_ea3c_4022_abbf_ef9a02d332f3.slice/crio-d88379df3c6b6152d2722f3a162e5b1a988ec20985038cc0a7bb966dc244066b WatchSource:0}: Error finding container d88379df3c6b6152d2722f3a162e5b1a988ec20985038cc0a7bb966dc244066b: Status 404 returned error can't find the container with id d88379df3c6b6152d2722f3a162e5b1a988ec20985038cc0a7bb966dc244066b
Jul 14 20:29:17.706947 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:17.706914    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6" event={"ID":"8992a06c-ea3c-4022-abbf-ef9a02d332f3","Type":"ContainerStarted","Data":"d88379df3c6b6152d2722f3a162e5b1a988ec20985038cc0a7bb966dc244066b"}
Jul 14 20:29:18.712808 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:18.712760    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6" event={"ID":"8992a06c-ea3c-4022-abbf-ef9a02d332f3","Type":"ContainerStarted","Data":"6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53"}
Jul 14 20:29:18.713229 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:18.712944    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:18.732361 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:18.732319    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6" podStartSLOduration=3.8208826670000002 podStartE2EDuration="4.732304668s" totalImagesPullingTime="911.422001ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:29:18.73112859 +0000 UTC m=+2252.865104668" watchObservedRunningTime="2026-07-14 20:29:18.732304668 +0000 UTC m=+2252.866280746"
Jul 14 20:29:19.436883 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:19.436804    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:24.722502 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:24.722475    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:29:28.155348 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:28.155308    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:30.310667 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:30.310630    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:30.411684 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:30.411647    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:36.619989 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:36.619955    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:36.716198 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:36.716165    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:49.495475 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.495440    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"]
Jul 14 20:29:49.498541 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.498525    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.501360 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.501335    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d86aa8\"/\"default-dockercfg-8h6pq\""
Jul 14 20:29:49.501480 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.501335    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d86aa8\"/\"kube-root-ca.crt\""
Jul 14 20:29:49.502186 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.502167    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d86aa8\"/\"test-model-d86aa8-kserve-self-signed-certs\""
Jul 14 20:29:49.502266 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.502204    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d86aa8\"/\"openshift-service-ca.crt\""
Jul 14 20:29:49.511625 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.511603    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"]
Jul 14 20:29:49.553124 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.553091    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:49.676973 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.676946    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-model-cache\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.677139 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.677014    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-home\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.677139 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.677035    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-dshm\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.677139 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.677054    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b080149-8439-4ecc-9b20-feb0e340502a-tls-certs\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.677139 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.677083    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4wm9\" (UniqueName: \"kubernetes.io/projected/2b080149-8439-4ecc-9b20-feb0e340502a-kube-api-access-c4wm9\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.677139 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.677122    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-tmp-dir\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.777975 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.777861    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-home\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.777975 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.777931    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-dshm\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.777975 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.777952    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b080149-8439-4ecc-9b20-feb0e340502a-tls-certs\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.777975 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.777971    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4wm9\" (UniqueName: \"kubernetes.io/projected/2b080149-8439-4ecc-9b20-feb0e340502a-kube-api-access-c4wm9\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.778317 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.778018    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-tmp-dir\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.778317 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.778050    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-model-cache\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.778317 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.778298    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-home\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.778454 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.778386    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-tmp-dir\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.778454 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.778445    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-model-cache\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.780440 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.780418    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-dshm\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.780604 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.780587    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b080149-8439-4ecc-9b20-feb0e340502a-tls-certs\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.787400 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.787378    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4wm9\" (UniqueName: \"kubernetes.io/projected/2b080149-8439-4ecc-9b20-feb0e340502a-kube-api-access-c4wm9\") pod \"test-model-d86aa8-kserve-697976c957-5xkw5\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") " pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.808108 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.808085    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:49.942961 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:49.941252    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"]
Jul 14 20:29:50.845341 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:50.845305    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5" event={"ID":"2b080149-8439-4ecc-9b20-feb0e340502a","Type":"ContainerStarted","Data":"67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628"}
Jul 14 20:29:50.845341 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:50.845352    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5" event={"ID":"2b080149-8439-4ecc-9b20-feb0e340502a","Type":"ContainerStarted","Data":"099f3a3f91647d9e203f0c2b6953354bc702fc0b2ad2501314d0c7e71a7cbcde"}
Jul 14 20:29:50.872603 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:50.872554    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5" podStartSLOduration=1.872540479 podStartE2EDuration="1.872540479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:29:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:29:50.870468275 +0000 UTC m=+2285.004444354" watchObservedRunningTime="2026-07-14 20:29:50.872540479 +0000 UTC m=+2285.006516605"
Jul 14 20:29:59.808441 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:59.808400    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:59.808937 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:59.808457    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:59.820727 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:59.820707    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:29:59.893699 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:29:59.893671    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:30:09.427521 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:09.427464    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:10.335801 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:10.335770    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"]
Jul 14 20:30:10.445584 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:10.445559    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:11.250025 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:11.249990    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:11.342849 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:11.342816    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:20.979763 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:20.979727    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"]
Jul 14 20:30:20.980295 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:20.980020    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk" podUID="41aa31f5-b4d2-4ac5-bc7a-4264baf27968" containerName="maas-api" containerID="cri-o://934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947" gracePeriod=30
Jul 14 20:30:21.019827 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.019800    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:21.225521 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.225495    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:30:21.338264 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.338164    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-openshift-service-ca\") pod \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") "
Jul 14 20:30:21.338264 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.338220    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjm7n\" (UniqueName: \"kubernetes.io/projected/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-kube-api-access-vjm7n\") pod \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") "
Jul 14 20:30:21.338264 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.338265    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-maas-api-tls\") pod \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\" (UID: \"41aa31f5-b4d2-4ac5-bc7a-4264baf27968\") "
Jul 14 20:30:21.338624 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.338597    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "41aa31f5-b4d2-4ac5-bc7a-4264baf27968" (UID: "41aa31f5-b4d2-4ac5-bc7a-4264baf27968"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:30:21.340541 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.340518    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "41aa31f5-b4d2-4ac5-bc7a-4264baf27968" (UID: "41aa31f5-b4d2-4ac5-bc7a-4264baf27968"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:30:21.340618 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.340587    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-kube-api-access-vjm7n" (OuterVolumeSpecName: "kube-api-access-vjm7n") pod "41aa31f5-b4d2-4ac5-bc7a-4264baf27968" (UID: "41aa31f5-b4d2-4ac5-bc7a-4264baf27968"). InnerVolumeSpecName "kube-api-access-vjm7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:30:21.439515 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.439472    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjm7n\" (UniqueName: \"kubernetes.io/projected/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-kube-api-access-vjm7n\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:21.439515 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.439507    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:21.439515 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.439515    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41aa31f5-b4d2-4ac5-bc7a-4264baf27968-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:21.981552 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.981512    2584 generic.go:356] "Generic (PLEG): container finished" podID="41aa31f5-b4d2-4ac5-bc7a-4264baf27968" containerID="934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947" exitCode=0
Jul 14 20:30:21.981966 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.981576    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"
Jul 14 20:30:21.981966 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.981594    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk" event={"ID":"41aa31f5-b4d2-4ac5-bc7a-4264baf27968","Type":"ContainerDied","Data":"934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947"}
Jul 14 20:30:21.981966 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.981671    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk" event={"ID":"41aa31f5-b4d2-4ac5-bc7a-4264baf27968","Type":"ContainerDied","Data":"c2acecdf89721b9331764c1114bfecbf101ccf2cb2d7ce1587e1b22544129490"}
Jul 14 20:30:21.981966 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.981694    2584 scope.go:117] "RemoveContainer" containerID="934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947"
Jul 14 20:30:21.990737 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.990721    2584 scope.go:117] "RemoveContainer" containerID="934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947"
Jul 14 20:30:21.991014 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:30:21.990996    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947\": container with ID starting with 934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947 not found: ID does not exist" containerID="934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947"
Jul 14 20:30:21.991090 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:21.991023    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947"} err="failed to get container status \"934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947\": rpc error: code = NotFound desc = could not find container \"934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947\": container with ID starting with 934af3e02a668f1950f927c8b2c0b3b0ebfd9b9102905fd67fb26897a63ff947 not found: ID does not exist"
Jul 14 20:30:22.002153 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:22.002132    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"]
Jul 14 20:30:22.006470 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:22.006450    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e56337-5b54f6ccb4-qtwwk"]
Jul 14 20:30:22.358924 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:22.358846    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41aa31f5-b4d2-4ac5-bc7a-4264baf27968" path="/var/lib/kubelet/pods/41aa31f5-b4d2-4ac5-bc7a-4264baf27968/volumes"
Jul 14 20:30:25.355450 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.355391    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5" podUID="2b080149-8439-4ecc-9b20-feb0e340502a" containerName="main" containerID="cri-o://67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628" gracePeriod=45
Jul 14 20:30:25.599752 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.599728    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:30:25.620498 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.620421    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:25.681639 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.681608    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-home\") pod \"2b080149-8439-4ecc-9b20-feb0e340502a\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") "
Jul 14 20:30:25.681841 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.681658    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4wm9\" (UniqueName: \"kubernetes.io/projected/2b080149-8439-4ecc-9b20-feb0e340502a-kube-api-access-c4wm9\") pod \"2b080149-8439-4ecc-9b20-feb0e340502a\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") "
Jul 14 20:30:25.681841 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.681705    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-dshm\") pod \"2b080149-8439-4ecc-9b20-feb0e340502a\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") "
Jul 14 20:30:25.681841 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.681725    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b080149-8439-4ecc-9b20-feb0e340502a-tls-certs\") pod \"2b080149-8439-4ecc-9b20-feb0e340502a\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") "
Jul 14 20:30:25.681841 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.681773    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-tmp-dir\") pod \"2b080149-8439-4ecc-9b20-feb0e340502a\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") "
Jul 14 20:30:25.681841 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.681827    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-model-cache\") pod \"2b080149-8439-4ecc-9b20-feb0e340502a\" (UID: \"2b080149-8439-4ecc-9b20-feb0e340502a\") "
Jul 14 20:30:25.682100 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.681952    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-home" (OuterVolumeSpecName: "home") pod "2b080149-8439-4ecc-9b20-feb0e340502a" (UID: "2b080149-8439-4ecc-9b20-feb0e340502a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:25.682143 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.682112    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b080149-8439-4ecc-9b20-feb0e340502a" (UID: "2b080149-8439-4ecc-9b20-feb0e340502a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:25.682210 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.682149    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b080149-8439-4ecc-9b20-feb0e340502a" (UID: "2b080149-8439-4ecc-9b20-feb0e340502a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:25.682259 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.682220    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-home\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:25.682259 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.682232    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-tmp-dir\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:25.682259 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.682240    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-model-cache\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:25.684221 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.684189    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b080149-8439-4ecc-9b20-feb0e340502a-kube-api-access-c4wm9" (OuterVolumeSpecName: "kube-api-access-c4wm9") pod "2b080149-8439-4ecc-9b20-feb0e340502a" (UID: "2b080149-8439-4ecc-9b20-feb0e340502a"). InnerVolumeSpecName "kube-api-access-c4wm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:30:25.684221 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.684201    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-dshm" (OuterVolumeSpecName: "dshm") pod "2b080149-8439-4ecc-9b20-feb0e340502a" (UID: "2b080149-8439-4ecc-9b20-feb0e340502a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:30:25.684221 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.684206    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b080149-8439-4ecc-9b20-feb0e340502a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b080149-8439-4ecc-9b20-feb0e340502a" (UID: "2b080149-8439-4ecc-9b20-feb0e340502a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:30:25.782750 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.782710    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b080149-8439-4ecc-9b20-feb0e340502a-tls-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:25.782750 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.782742    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4wm9\" (UniqueName: \"kubernetes.io/projected/2b080149-8439-4ecc-9b20-feb0e340502a-kube-api-access-c4wm9\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:25.782750 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:25.782751    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b080149-8439-4ecc-9b20-feb0e340502a-dshm\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:26.001759 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:26.001728    2584 generic.go:356] "Generic (PLEG): container finished" podID="2b080149-8439-4ecc-9b20-feb0e340502a" containerID="67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628" exitCode=0
Jul 14 20:30:26.001950 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:26.001777    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"
Jul 14 20:30:26.001950 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:26.001793    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5" event={"ID":"2b080149-8439-4ecc-9b20-feb0e340502a","Type":"ContainerDied","Data":"67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628"}
Jul 14 20:30:26.001950 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:26.001824    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5" event={"ID":"2b080149-8439-4ecc-9b20-feb0e340502a","Type":"ContainerDied","Data":"099f3a3f91647d9e203f0c2b6953354bc702fc0b2ad2501314d0c7e71a7cbcde"}
Jul 14 20:30:26.001950 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:26.001840    2584 scope.go:117] "RemoveContainer" containerID="67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628"
Jul 14 20:30:26.010461 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:26.010442    2584 scope.go:117] "RemoveContainer" containerID="67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628"
Jul 14 20:30:26.010703 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:30:26.010684    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628\": container with ID starting with 67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628 not found: ID does not exist" containerID="67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628"
Jul 14 20:30:26.010745 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:26.010712    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628"} err="failed to get container status \"67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628\": rpc error: code = NotFound desc = could not find container \"67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628\": container with ID starting with 67fe85184ea36ce43fca6ad008252425c17f6a57c98b37bf1486e2b288839628 not found: ID does not exist"
Jul 14 20:30:26.023347 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:26.023327    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"]
Jul 14 20:30:26.027603 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:26.027581    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d86aa8/test-model-d86aa8-kserve-697976c957-5xkw5"]
Jul 14 20:30:26.364883 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:26.364796    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b080149-8439-4ecc-9b20-feb0e340502a" path="/var/lib/kubelet/pods/2b080149-8439-4ecc-9b20-feb0e340502a/volumes"
Jul 14 20:30:31.935681 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:31.935645    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:32.036589 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:32.036559    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:36.892823 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:36.892743    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:36.996484 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:36.996439    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:37.473415 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:37.473385    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:37.576845 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:37.576811    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:47.465067 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.465031    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"]
Jul 14 20:30:47.465504 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.465307    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6" podUID="8992a06c-ea3c-4022-abbf-ef9a02d332f3" containerName="maas-api" containerID="cri-o://6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53" gracePeriod=30
Jul 14 20:30:47.495236 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.495203    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:47.702960 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.702931    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:30:47.765649 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.765569    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8992a06c-ea3c-4022-abbf-ef9a02d332f3-openshift-service-ca\") pod \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") "
Jul 14 20:30:47.765649 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.765611    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsmzk\" (UniqueName: \"kubernetes.io/projected/8992a06c-ea3c-4022-abbf-ef9a02d332f3-kube-api-access-hsmzk\") pod \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") "
Jul 14 20:30:47.765649 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.765645    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8992a06c-ea3c-4022-abbf-ef9a02d332f3-maas-api-tls\") pod \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\" (UID: \"8992a06c-ea3c-4022-abbf-ef9a02d332f3\") "
Jul 14 20:30:47.766003 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.765981    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8992a06c-ea3c-4022-abbf-ef9a02d332f3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8992a06c-ea3c-4022-abbf-ef9a02d332f3" (UID: "8992a06c-ea3c-4022-abbf-ef9a02d332f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:30:47.767890 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.767843    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8992a06c-ea3c-4022-abbf-ef9a02d332f3-kube-api-access-hsmzk" (OuterVolumeSpecName: "kube-api-access-hsmzk") pod "8992a06c-ea3c-4022-abbf-ef9a02d332f3" (UID: "8992a06c-ea3c-4022-abbf-ef9a02d332f3"). InnerVolumeSpecName "kube-api-access-hsmzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:30:47.767985 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.767901    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8992a06c-ea3c-4022-abbf-ef9a02d332f3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8992a06c-ea3c-4022-abbf-ef9a02d332f3" (UID: "8992a06c-ea3c-4022-abbf-ef9a02d332f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:30:47.866820 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.866789    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8992a06c-ea3c-4022-abbf-ef9a02d332f3-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:47.866820 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.866815    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8992a06c-ea3c-4022-abbf-ef9a02d332f3-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:47.866820 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:47.866825    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsmzk\" (UniqueName: \"kubernetes.io/projected/8992a06c-ea3c-4022-abbf-ef9a02d332f3-kube-api-access-hsmzk\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:30:48.104693 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:48.104606    2584 generic.go:356] "Generic (PLEG): container finished" podID="8992a06c-ea3c-4022-abbf-ef9a02d332f3" containerID="6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53" exitCode=0
Jul 14 20:30:48.104693 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:48.104654    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"
Jul 14 20:30:48.104693 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:48.104651    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6" event={"ID":"8992a06c-ea3c-4022-abbf-ef9a02d332f3","Type":"ContainerDied","Data":"6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53"}
Jul 14 20:30:48.104944 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:48.104712    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6" event={"ID":"8992a06c-ea3c-4022-abbf-ef9a02d332f3","Type":"ContainerDied","Data":"d88379df3c6b6152d2722f3a162e5b1a988ec20985038cc0a7bb966dc244066b"}
Jul 14 20:30:48.104944 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:48.104734    2584 scope.go:117] "RemoveContainer" containerID="6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53"
Jul 14 20:30:48.114060 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:48.114042    2584 scope.go:117] "RemoveContainer" containerID="6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53"
Jul 14 20:30:48.114310 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:30:48.114291    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53\": container with ID starting with 6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53 not found: ID does not exist" containerID="6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53"
Jul 14 20:30:48.114372 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:48.114321    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53"} err="failed to get container status \"6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53\": rpc error: code = NotFound desc = could not find container \"6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53\": container with ID starting with 6ba0cd6bcefafa865642dbc30a037b24f325d3f46c611eec73b0b53b0077ce53 not found: ID does not exist"
Jul 14 20:30:48.125614 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:48.125594    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"]
Jul 14 20:30:48.132408 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:48.132388    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d86aa8-7bdd75c848-6s8p6"]
Jul 14 20:30:48.359269 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:48.359189    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8992a06c-ea3c-4022-abbf-ef9a02d332f3" path="/var/lib/kubelet/pods/8992a06c-ea3c-4022-abbf-ef9a02d332f3/volumes"
Jul 14 20:30:51.890262 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:51.890228    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:52.012433 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:52.012385    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:52.112256 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:52.112221    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:57.806194 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:57.806162    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:30:57.906670 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:30:57.906638    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:02.736628 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:02.736593    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:03.023983 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:03.023907    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:03.459168 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:03.459138    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:03.840466 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:03.840380    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:04.031416 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:04.031381    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:06.550518 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.550483    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:06.632162 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.632133    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"]
Jul 14 20:31:06.632438 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.632427    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8992a06c-ea3c-4022-abbf-ef9a02d332f3" containerName="maas-api"
Jul 14 20:31:06.632484 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.632440    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8992a06c-ea3c-4022-abbf-ef9a02d332f3" containerName="maas-api"
Jul 14 20:31:06.632484 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.632453    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41aa31f5-b4d2-4ac5-bc7a-4264baf27968" containerName="maas-api"
Jul 14 20:31:06.632484 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.632458    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="41aa31f5-b4d2-4ac5-bc7a-4264baf27968" containerName="maas-api"
Jul 14 20:31:06.632484 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.632471    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b080149-8439-4ecc-9b20-feb0e340502a" containerName="main"
Jul 14 20:31:06.632484 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.632476    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b080149-8439-4ecc-9b20-feb0e340502a" containerName="main"
Jul 14 20:31:06.632629 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.632523    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8992a06c-ea3c-4022-abbf-ef9a02d332f3" containerName="maas-api"
Jul 14 20:31:06.632629 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.632531    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="41aa31f5-b4d2-4ac5-bc7a-4264baf27968" containerName="maas-api"
Jul 14 20:31:06.632629 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.632536    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b080149-8439-4ecc-9b20-feb0e340502a" containerName="main"
Jul 14 20:31:06.635642 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.635622    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:06.638804 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.638783    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-16b455-serving-cert\""
Jul 14 20:31:06.641377 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.641351    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:06.646749 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.646727    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"]
Jul 14 20:31:06.717062 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.717024    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:06.724340 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.724314    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7lq6\" (UniqueName: \"kubernetes.io/projected/cabd900e-00f4-4f50-8541-4de2472b5f86-kube-api-access-g7lq6\") pod \"maas-api-e2e-api-a-16b455-799db94c4f-c2q5d\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:06.724421 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.724362    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cabd900e-00f4-4f50-8541-4de2472b5f86-maas-api-tls\") pod \"maas-api-e2e-api-a-16b455-799db94c4f-c2q5d\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:06.724459 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.724424    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cabd900e-00f4-4f50-8541-4de2472b5f86-openshift-service-ca\") pod \"maas-api-e2e-api-a-16b455-799db94c4f-c2q5d\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:06.825456 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.825362    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7lq6\" (UniqueName: \"kubernetes.io/projected/cabd900e-00f4-4f50-8541-4de2472b5f86-kube-api-access-g7lq6\") pod \"maas-api-e2e-api-a-16b455-799db94c4f-c2q5d\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:06.825456 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.825428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cabd900e-00f4-4f50-8541-4de2472b5f86-maas-api-tls\") pod \"maas-api-e2e-api-a-16b455-799db94c4f-c2q5d\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:06.825693 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.825481    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cabd900e-00f4-4f50-8541-4de2472b5f86-openshift-service-ca\") pod \"maas-api-e2e-api-a-16b455-799db94c4f-c2q5d\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:06.825693 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:31:06.825567    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-serving-cert: secret "maas-api-e2e-api-a-16b455-serving-cert" not found
Jul 14 20:31:06.825693 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:31:06.825647    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cabd900e-00f4-4f50-8541-4de2472b5f86-maas-api-tls podName:cabd900e-00f4-4f50-8541-4de2472b5f86 nodeName:}" failed. No retries permitted until 2026-07-14 20:31:07.325628615 +0000 UTC m=+2361.459604690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cabd900e-00f4-4f50-8541-4de2472b5f86-maas-api-tls") pod "maas-api-e2e-api-a-16b455-799db94c4f-c2q5d" (UID: "cabd900e-00f4-4f50-8541-4de2472b5f86") : secret "maas-api-e2e-api-a-16b455-serving-cert" not found
Jul 14 20:31:06.826180 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.826157    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cabd900e-00f4-4f50-8541-4de2472b5f86-openshift-service-ca\") pod \"maas-api-e2e-api-a-16b455-799db94c4f-c2q5d\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:06.842712 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.842687    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7lq6\" (UniqueName: \"kubernetes.io/projected/cabd900e-00f4-4f50-8541-4de2472b5f86-kube-api-access-g7lq6\") pod \"maas-api-e2e-api-a-16b455-799db94c4f-c2q5d\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:06.996421 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:06.996385    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:07.234142 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:07.234112    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:07.329785 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:07.329749    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cabd900e-00f4-4f50-8541-4de2472b5f86-maas-api-tls\") pod \"maas-api-e2e-api-a-16b455-799db94c4f-c2q5d\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:07.332347 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:07.332327    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cabd900e-00f4-4f50-8541-4de2472b5f86-maas-api-tls\") pod \"maas-api-e2e-api-a-16b455-799db94c4f-c2q5d\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:07.334562 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:07.334537    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:07.547601 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:07.547520    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:07.680735 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:07.680701    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"]
Jul 14 20:31:07.683669 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:31:07.683638    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcabd900e_00f4_4f50_8541_4de2472b5f86.slice/crio-bcda862cd9348f48809c5e466db23d7b51af788e543f87461ea6aa9a0cbdfd99 WatchSource:0}: Error finding container bcda862cd9348f48809c5e466db23d7b51af788e543f87461ea6aa9a0cbdfd99: Status 404 returned error can't find the container with id bcda862cd9348f48809c5e466db23d7b51af788e543f87461ea6aa9a0cbdfd99
Jul 14 20:31:07.685007 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:07.684990    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:31:08.191925 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:08.191864    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d" event={"ID":"cabd900e-00f4-4f50-8541-4de2472b5f86","Type":"ContainerStarted","Data":"05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666"}
Jul 14 20:31:08.192120 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:08.191939    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d" event={"ID":"cabd900e-00f4-4f50-8541-4de2472b5f86","Type":"ContainerStarted","Data":"bcda862cd9348f48809c5e466db23d7b51af788e543f87461ea6aa9a0cbdfd99"}
Jul 14 20:31:08.192120 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:08.192045    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:08.211569 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:08.211519    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d" podStartSLOduration=1.849735308 podStartE2EDuration="2.211500635s" totalImagesPullingTime="361.765327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:31:08.210653087 +0000 UTC m=+2362.344629186" watchObservedRunningTime="2026-07-14 20:31:08.211500635 +0000 UTC m=+2362.345476714"
Jul 14 20:31:11.125290 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:11.125257    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:11.696225 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:11.696175    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:12.104767 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:12.104671    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:12.427332 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:12.427240    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:14.201893 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:14.201843    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:15.601605 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.601575    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:15.721401 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.721368    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:15.732811 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.732775    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"]
Jul 14 20:31:15.736377 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.736354    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:15.741916 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.740863    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-ad0405-serving-cert\""
Jul 14 20:31:15.751516 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.751489    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"]
Jul 14 20:31:15.801677 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.801645    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb469c4a-b11d-4727-93f3-ac40521fdc51-openshift-service-ca\") pod \"maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:15.801862 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.801714    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99xsh\" (UniqueName: \"kubernetes.io/projected/fb469c4a-b11d-4727-93f3-ac40521fdc51-kube-api-access-99xsh\") pod \"maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:15.801862 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.801747    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb469c4a-b11d-4727-93f3-ac40521fdc51-maas-api-tls\") pod \"maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:15.878978 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.878882    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:15.902575 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.902542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99xsh\" (UniqueName: \"kubernetes.io/projected/fb469c4a-b11d-4727-93f3-ac40521fdc51-kube-api-access-99xsh\") pod \"maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:15.902727 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.902586    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb469c4a-b11d-4727-93f3-ac40521fdc51-maas-api-tls\") pod \"maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:15.902727 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:31:15.902684    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-serving-cert: secret "maas-api-e2e-api-b-ad0405-serving-cert" not found
Jul 14 20:31:15.902795 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:31:15.902729    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb469c4a-b11d-4727-93f3-ac40521fdc51-maas-api-tls podName:fb469c4a-b11d-4727-93f3-ac40521fdc51 nodeName:}" failed. No retries permitted until 2026-07-14 20:31:16.4027134 +0000 UTC m=+2370.536689458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fb469c4a-b11d-4727-93f3-ac40521fdc51-maas-api-tls") pod "maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr" (UID: "fb469c4a-b11d-4727-93f3-ac40521fdc51") : secret "maas-api-e2e-api-b-ad0405-serving-cert" not found
Jul 14 20:31:15.902795 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.902765    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb469c4a-b11d-4727-93f3-ac40521fdc51-openshift-service-ca\") pod \"maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:15.903393 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.903373    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb469c4a-b11d-4727-93f3-ac40521fdc51-openshift-service-ca\") pod \"maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:15.916923 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:15.916862    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99xsh\" (UniqueName: \"kubernetes.io/projected/fb469c4a-b11d-4727-93f3-ac40521fdc51-kube-api-access-99xsh\") pod \"maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:16.106459 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:16.106410    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:16.408524 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:16.408487    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb469c4a-b11d-4727-93f3-ac40521fdc51-maas-api-tls\") pod \"maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:16.411363 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:16.411330    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb469c4a-b11d-4727-93f3-ac40521fdc51-maas-api-tls\") pod \"maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:16.652566 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:16.652533    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:16.799383 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:16.799353    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"]
Jul 14 20:31:16.799771 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:16.799743    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:16.801565 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:31:16.801541    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb469c4a_b11d_4727_93f3_ac40521fdc51.slice/crio-85871b9408244123f94c8591be5c008916092b9a7abc680ac6b3b22fa9e2a8f9 WatchSource:0}: Error finding container 85871b9408244123f94c8591be5c008916092b9a7abc680ac6b3b22fa9e2a8f9: Status 404 returned error can't find the container with id 85871b9408244123f94c8591be5c008916092b9a7abc680ac6b3b22fa9e2a8f9
Jul 14 20:31:16.897255 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:16.897219    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:17.233894 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:17.233840    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr" event={"ID":"fb469c4a-b11d-4727-93f3-ac40521fdc51","Type":"ContainerStarted","Data":"85871b9408244123f94c8591be5c008916092b9a7abc680ac6b3b22fa9e2a8f9"}
Jul 14 20:31:18.239427 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:18.239395    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr" event={"ID":"fb469c4a-b11d-4727-93f3-ac40521fdc51","Type":"ContainerStarted","Data":"e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4"}
Jul 14 20:31:18.239849 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:18.239513    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:18.269343 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:18.269292    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr" podStartSLOduration=2.86720448 podStartE2EDuration="3.269276062s" totalImagesPullingTime="402.071582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:31:18.266738255 +0000 UTC m=+2372.400714335" watchObservedRunningTime="2026-07-14 20:31:18.269276062 +0000 UTC m=+2372.403252176"
Jul 14 20:31:20.124549 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:20.124515    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:24.249313 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:24.249283    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:31:25.075275 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:25.075245    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:28.271292 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:28.271264    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:28.371715 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:28.371678    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:37.749806 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:37.749773    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:37.851093 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:37.851057    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:39.300887 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.300842    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:39.401101 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.401054    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:39.567972 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.567894    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"]
Jul 14 20:31:39.568142 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.568116    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d" podUID="cabd900e-00f4-4f50-8541-4de2472b5f86" containerName="maas-api" containerID="cri-o://05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666" gracePeriod=30
Jul 14 20:31:39.601860 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.601832    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:39.810323 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.810298    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:39.922074 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.921981    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cabd900e-00f4-4f50-8541-4de2472b5f86-openshift-service-ca\") pod \"cabd900e-00f4-4f50-8541-4de2472b5f86\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") "
Jul 14 20:31:39.922074 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.922061    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7lq6\" (UniqueName: \"kubernetes.io/projected/cabd900e-00f4-4f50-8541-4de2472b5f86-kube-api-access-g7lq6\") pod \"cabd900e-00f4-4f50-8541-4de2472b5f86\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") "
Jul 14 20:31:39.922262 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.922093    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cabd900e-00f4-4f50-8541-4de2472b5f86-maas-api-tls\") pod \"cabd900e-00f4-4f50-8541-4de2472b5f86\" (UID: \"cabd900e-00f4-4f50-8541-4de2472b5f86\") "
Jul 14 20:31:39.922428 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.922391    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cabd900e-00f4-4f50-8541-4de2472b5f86-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cabd900e-00f4-4f50-8541-4de2472b5f86" (UID: "cabd900e-00f4-4f50-8541-4de2472b5f86"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:31:39.924370 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.924345    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cabd900e-00f4-4f50-8541-4de2472b5f86-kube-api-access-g7lq6" (OuterVolumeSpecName: "kube-api-access-g7lq6") pod "cabd900e-00f4-4f50-8541-4de2472b5f86" (UID: "cabd900e-00f4-4f50-8541-4de2472b5f86"). InnerVolumeSpecName "kube-api-access-g7lq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:31:39.924476 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:39.924378    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cabd900e-00f4-4f50-8541-4de2472b5f86-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cabd900e-00f4-4f50-8541-4de2472b5f86" (UID: "cabd900e-00f4-4f50-8541-4de2472b5f86"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:31:40.023700 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.023661    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cabd900e-00f4-4f50-8541-4de2472b5f86-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:31:40.023700 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.023691    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7lq6\" (UniqueName: \"kubernetes.io/projected/cabd900e-00f4-4f50-8541-4de2472b5f86-kube-api-access-g7lq6\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:31:40.023700 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.023704    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cabd900e-00f4-4f50-8541-4de2472b5f86-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:31:40.332109 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.332073    2584 generic.go:356] "Generic (PLEG): container finished" podID="cabd900e-00f4-4f50-8541-4de2472b5f86" containerID="05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666" exitCode=0
Jul 14 20:31:40.332600 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.332121    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"
Jul 14 20:31:40.332600 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.332163    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d" event={"ID":"cabd900e-00f4-4f50-8541-4de2472b5f86","Type":"ContainerDied","Data":"05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666"}
Jul 14 20:31:40.332600 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.332232    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d" event={"ID":"cabd900e-00f4-4f50-8541-4de2472b5f86","Type":"ContainerDied","Data":"bcda862cd9348f48809c5e466db23d7b51af788e543f87461ea6aa9a0cbdfd99"}
Jul 14 20:31:40.332600 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.332269    2584 scope.go:117] "RemoveContainer" containerID="05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666"
Jul 14 20:31:40.341070 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.341053    2584 scope.go:117] "RemoveContainer" containerID="05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666"
Jul 14 20:31:40.341317 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:31:40.341296    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666\": container with ID starting with 05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666 not found: ID does not exist" containerID="05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666"
Jul 14 20:31:40.341363 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.341327    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666"} err="failed to get container status \"05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666\": rpc error: code = NotFound desc = could not find container \"05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666\": container with ID starting with 05076c92db8e359c9c1ee36c6fb3e5ee66f33ab5d054492f34b5d98d9cac0666 not found: ID does not exist"
Jul 14 20:31:40.353510 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.353484    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"]
Jul 14 20:31:40.359062 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:40.359039    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-16b455-799db94c4f-c2q5d"]
Jul 14 20:31:42.359774 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:42.359739    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cabd900e-00f4-4f50-8541-4de2472b5f86" path="/var/lib/kubelet/pods/cabd900e-00f4-4f50-8541-4de2472b5f86/volumes"
Jul 14 20:31:43.293114 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:43.293080    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:43.394507 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:43.394467    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:43.665850 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:43.665763    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:46.407298 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:46.407268    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:31:46.413289 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:46.413268    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:31:49.587160 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:49.587129    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:49.686443 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:49.686407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:54.528854 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:54.528821    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:54.793112 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:54.793023    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:55.561230 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:55.561202    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:31:55.661394 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:31:55.661360    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:02.364662 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:02.364626    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:05.598804 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:05.598768    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"]
Jul 14 20:32:05.599275 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:05.598998    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr" podUID="fb469c4a-b11d-4727-93f3-ac40521fdc51" containerName="maas-api" containerID="cri-o://e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4" gracePeriod=30
Jul 14 20:32:05.634744 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:05.634710    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:05.841033 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:05.841003    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:32:05.948227 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:05.948200    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb469c4a-b11d-4727-93f3-ac40521fdc51-openshift-service-ca\") pod \"fb469c4a-b11d-4727-93f3-ac40521fdc51\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") "
Jul 14 20:32:05.948388 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:05.948267    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99xsh\" (UniqueName: \"kubernetes.io/projected/fb469c4a-b11d-4727-93f3-ac40521fdc51-kube-api-access-99xsh\") pod \"fb469c4a-b11d-4727-93f3-ac40521fdc51\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") "
Jul 14 20:32:05.948388 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:05.948374    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb469c4a-b11d-4727-93f3-ac40521fdc51-maas-api-tls\") pod \"fb469c4a-b11d-4727-93f3-ac40521fdc51\" (UID: \"fb469c4a-b11d-4727-93f3-ac40521fdc51\") "
Jul 14 20:32:05.948581 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:05.948559    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb469c4a-b11d-4727-93f3-ac40521fdc51-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb469c4a-b11d-4727-93f3-ac40521fdc51" (UID: "fb469c4a-b11d-4727-93f3-ac40521fdc51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:32:05.950505 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:05.950480    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb469c4a-b11d-4727-93f3-ac40521fdc51-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb469c4a-b11d-4727-93f3-ac40521fdc51" (UID: "fb469c4a-b11d-4727-93f3-ac40521fdc51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:32:05.950629 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:05.950529    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb469c4a-b11d-4727-93f3-ac40521fdc51-kube-api-access-99xsh" (OuterVolumeSpecName: "kube-api-access-99xsh") pod "fb469c4a-b11d-4727-93f3-ac40521fdc51" (UID: "fb469c4a-b11d-4727-93f3-ac40521fdc51"). InnerVolumeSpecName "kube-api-access-99xsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:32:06.049780 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.049741    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb469c4a-b11d-4727-93f3-ac40521fdc51-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:32:06.049780 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.049771    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb469c4a-b11d-4727-93f3-ac40521fdc51-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:32:06.049780 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.049781    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99xsh\" (UniqueName: \"kubernetes.io/projected/fb469c4a-b11d-4727-93f3-ac40521fdc51-kube-api-access-99xsh\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:32:06.453557 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.453516    2584 generic.go:356] "Generic (PLEG): container finished" podID="fb469c4a-b11d-4727-93f3-ac40521fdc51" containerID="e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4" exitCode=0
Jul 14 20:32:06.453764 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.453572    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"
Jul 14 20:32:06.453764 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.453603    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr" event={"ID":"fb469c4a-b11d-4727-93f3-ac40521fdc51","Type":"ContainerDied","Data":"e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4"}
Jul 14 20:32:06.453764 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.453668    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr" event={"ID":"fb469c4a-b11d-4727-93f3-ac40521fdc51","Type":"ContainerDied","Data":"85871b9408244123f94c8591be5c008916092b9a7abc680ac6b3b22fa9e2a8f9"}
Jul 14 20:32:06.453764 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.453691    2584 scope.go:117] "RemoveContainer" containerID="e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4"
Jul 14 20:32:06.461841 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.461819    2584 scope.go:117] "RemoveContainer" containerID="e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4"
Jul 14 20:32:06.462119 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:32:06.462102    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4\": container with ID starting with e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4 not found: ID does not exist" containerID="e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4"
Jul 14 20:32:06.462173 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.462126    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4"} err="failed to get container status \"e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4\": rpc error: code = NotFound desc = could not find container \"e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4\": container with ID starting with e9da31df6e44f59c20e59addb70a452ef510d7f028c791e6bce174a5b0e7bad4 not found: ID does not exist"
Jul 14 20:32:06.471025 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.471000    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"]
Jul 14 20:32:06.475781 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:06.475762    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-ad0405-7c59cdf487-5gfwr"]
Jul 14 20:32:08.358945 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:08.358916    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb469c4a-b11d-4727-93f3-ac40521fdc51" path="/var/lib/kubelet/pods/fb469c4a-b11d-4727-93f3-ac40521fdc51/volumes"
Jul 14 20:32:10.040588 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:10.040556    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:16.309581 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:16.309543    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:17.535769 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:17.535740    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:20.837737 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:20.837705    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:21.095458 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:21.095380    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:21.570645 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:21.570612    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:21.903707 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:21.903620    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:22.260684 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:22.260653    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:25.009355 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.009322    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:25.099224 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.099192    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"]
Jul 14 20:32:25.099504 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.099491    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb469c4a-b11d-4727-93f3-ac40521fdc51" containerName="maas-api"
Jul 14 20:32:25.099504 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.099504    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb469c4a-b11d-4727-93f3-ac40521fdc51" containerName="maas-api"
Jul 14 20:32:25.099596 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.099520    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabd900e-00f4-4f50-8541-4de2472b5f86" containerName="maas-api"
Jul 14 20:32:25.099596 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.099525    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabd900e-00f4-4f50-8541-4de2472b5f86" containerName="maas-api"
Jul 14 20:32:25.099596 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.099579    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="cabd900e-00f4-4f50-8541-4de2472b5f86" containerName="maas-api"
Jul 14 20:32:25.099596 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.099587    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb469c4a-b11d-4727-93f3-ac40521fdc51" containerName="maas-api"
Jul 14 20:32:25.102564 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.102548    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:25.108282 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.108263    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-e55cd3-serving-cert\""
Jul 14 20:32:25.109195 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.108972    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75ebca2a-b6a0-43d9-98df-059920d4ee0f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:25.109195 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.109046    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75ebca2a-b6a0-43d9-98df-059920d4ee0f-maas-api-tls\") pod \"maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:25.109195 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.109082    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htdds\" (UniqueName: \"kubernetes.io/projected/75ebca2a-b6a0-43d9-98df-059920d4ee0f-kube-api-access-htdds\") pod \"maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:25.128267 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.128233    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"]
Jul 14 20:32:25.151672 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.151642    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:25.209635 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.209606    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75ebca2a-b6a0-43d9-98df-059920d4ee0f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:25.209635 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.209645    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75ebca2a-b6a0-43d9-98df-059920d4ee0f-maas-api-tls\") pod \"maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:25.209852 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.209661    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htdds\" (UniqueName: \"kubernetes.io/projected/75ebca2a-b6a0-43d9-98df-059920d4ee0f-kube-api-access-htdds\") pod \"maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:25.209852 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:32:25.209769    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-serving-cert: secret "maas-api-e2e-shared-a-e55cd3-serving-cert" not found
Jul 14 20:32:25.209852 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:32:25.209827    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75ebca2a-b6a0-43d9-98df-059920d4ee0f-maas-api-tls podName:75ebca2a-b6a0-43d9-98df-059920d4ee0f nodeName:}" failed. No retries permitted until 2026-07-14 20:32:25.709812955 +0000 UTC m=+2439.843789016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/75ebca2a-b6a0-43d9-98df-059920d4ee0f-maas-api-tls") pod "maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn" (UID: "75ebca2a-b6a0-43d9-98df-059920d4ee0f") : secret "maas-api-e2e-shared-a-e55cd3-serving-cert" not found
Jul 14 20:32:25.210306 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.210289    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75ebca2a-b6a0-43d9-98df-059920d4ee0f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:25.227905 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.227854    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htdds\" (UniqueName: \"kubernetes.io/projected/75ebca2a-b6a0-43d9-98df-059920d4ee0f-kube-api-access-htdds\") pod \"maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:25.249101 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.249072    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:25.423102 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.423019    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:25.712453 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.712418    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75ebca2a-b6a0-43d9-98df-059920d4ee0f-maas-api-tls\") pod \"maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:25.714979 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.714958    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75ebca2a-b6a0-43d9-98df-059920d4ee0f-maas-api-tls\") pod \"maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:25.726954 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.726927    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:25.828775 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:25.828742    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:26.013034 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:26.012945    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:26.156540 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:26.156506    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"]
Jul 14 20:32:26.160893 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:32:26.160848    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ebca2a_b6a0_43d9_98df_059920d4ee0f.slice/crio-f7138be2f5c32530c53da5c3929d11bbfdd51338368f3f2fd6922c2c27ce9890 WatchSource:0}: Error finding container f7138be2f5c32530c53da5c3929d11bbfdd51338368f3f2fd6922c2c27ce9890: Status 404 returned error can't find the container with id f7138be2f5c32530c53da5c3929d11bbfdd51338368f3f2fd6922c2c27ce9890
Jul 14 20:32:26.539930 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:26.539892    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn" event={"ID":"75ebca2a-b6a0-43d9-98df-059920d4ee0f","Type":"ContainerStarted","Data":"f7138be2f5c32530c53da5c3929d11bbfdd51338368f3f2fd6922c2c27ce9890"}
Jul 14 20:32:27.544981 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:27.544945    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn" event={"ID":"75ebca2a-b6a0-43d9-98df-059920d4ee0f","Type":"ContainerStarted","Data":"23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31"}
Jul 14 20:32:27.545361 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:27.545136    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:27.568859 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:27.568813    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn" podStartSLOduration=1.952068905 podStartE2EDuration="2.568797666s" totalImagesPullingTime="616.728761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:27.566541883 +0000 UTC m=+2441.700517962" watchObservedRunningTime="2026-07-14 20:32:27.568797666 +0000 UTC m=+2441.702773746"
Jul 14 20:32:29.583726 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:29.583693    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:29.953668 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:29.953635    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:30.329755 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:30.329676    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:30.656051 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:30.655963    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:33.156315 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.156284    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:33.227608 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.227579    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"]
Jul 14 20:32:33.231145 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.231124    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:33.234314 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.234294    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-d4143c-serving-cert\""
Jul 14 20:32:33.258300 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.258272    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"]
Jul 14 20:32:33.275133 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.275103    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a191718-aabb-47aa-93e1-8be21595b49a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:33.275297 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.275150    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88nhd\" (UniqueName: \"kubernetes.io/projected/3a191718-aabb-47aa-93e1-8be21595b49a-kube-api-access-88nhd\") pod \"maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:33.275297 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.275176    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a191718-aabb-47aa-93e1-8be21595b49a-maas-api-tls\") pod \"maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:33.315294 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.315265    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:33.376174 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.376144    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a191718-aabb-47aa-93e1-8be21595b49a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:33.376323 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.376183    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88nhd\" (UniqueName: \"kubernetes.io/projected/3a191718-aabb-47aa-93e1-8be21595b49a-kube-api-access-88nhd\") pod \"maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:33.376323 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.376210    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a191718-aabb-47aa-93e1-8be21595b49a-maas-api-tls\") pod \"maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:33.376394 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:32:33.376326    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-serving-cert: secret "maas-api-e2e-shared-b-d4143c-serving-cert" not found
Jul 14 20:32:33.376394 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:32:33.376382    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a191718-aabb-47aa-93e1-8be21595b49a-maas-api-tls podName:3a191718-aabb-47aa-93e1-8be21595b49a nodeName:}" failed. No retries permitted until 2026-07-14 20:32:33.87636534 +0000 UTC m=+2448.010341410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3a191718-aabb-47aa-93e1-8be21595b49a-maas-api-tls") pod "maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb" (UID: "3a191718-aabb-47aa-93e1-8be21595b49a") : secret "maas-api-e2e-shared-b-d4143c-serving-cert" not found
Jul 14 20:32:33.376755 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.376736    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a191718-aabb-47aa-93e1-8be21595b49a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:33.385280 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.385251    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88nhd\" (UniqueName: \"kubernetes.io/projected/3a191718-aabb-47aa-93e1-8be21595b49a-kube-api-access-88nhd\") pod \"maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:33.421092 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.421018    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:33.555436 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.555403    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:32:33.699129 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.699086    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:33.881435 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.881396    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a191718-aabb-47aa-93e1-8be21595b49a-maas-api-tls\") pod \"maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:33.883942 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:33.883910    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a191718-aabb-47aa-93e1-8be21595b49a-maas-api-tls\") pod \"maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:34.140993 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:34.140901    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:34.286010 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:34.285980    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"]
Jul 14 20:32:34.290339 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:32:34.290312    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a191718_aabb_47aa_93e1_8be21595b49a.slice/crio-5f1b315e48a2dbc56d28de9f2914a2ced80346b9b92cb011ac98d1a0325ecc02 WatchSource:0}: Error finding container 5f1b315e48a2dbc56d28de9f2914a2ced80346b9b92cb011ac98d1a0325ecc02: Status 404 returned error can't find the container with id 5f1b315e48a2dbc56d28de9f2914a2ced80346b9b92cb011ac98d1a0325ecc02
Jul 14 20:32:34.374570 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:34.374538    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:34.491740 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:34.491706    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:34.575511 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:34.575477    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb" event={"ID":"3a191718-aabb-47aa-93e1-8be21595b49a","Type":"ContainerStarted","Data":"5f1b315e48a2dbc56d28de9f2914a2ced80346b9b92cb011ac98d1a0325ecc02"}
Jul 14 20:32:35.581538 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:35.581506    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb" event={"ID":"3a191718-aabb-47aa-93e1-8be21595b49a","Type":"ContainerStarted","Data":"f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee"}
Jul 14 20:32:35.582013 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:35.581590    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:35.607264 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:35.607217    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb" podStartSLOduration=1.966044981 podStartE2EDuration="2.607201491s" totalImagesPullingTime="641.15651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:35.605829313 +0000 UTC m=+2449.739805407" watchObservedRunningTime="2026-07-14 20:32:35.607201491 +0000 UTC m=+2449.741177571"
Jul 14 20:32:37.671009 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:37.670975    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:41.591544 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:41.591514    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:32:48.043708 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:48.043672    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:48.118923 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:48.118888    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:50.310136 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.310105    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:50.318447 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.318419    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"]
Jul 14 20:32:50.323133 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.323113    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.326427 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.326407    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"openshift-service-ca.crt\""
Jul 14 20:32:50.326552 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.326423    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"default-dockercfg-4hzc6\""
Jul 14 20:32:50.326552 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.326436    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"auth-test-model-e55cd3-kserve-self-signed-certs\""
Jul 14 20:32:50.326552 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.326464    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"kube-root-ca.crt\""
Jul 14 20:32:50.331514 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.331489    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"]
Jul 14 20:32:50.424347 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.424318    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-dshm\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.424347 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.424350    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-model-cache\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.424574 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.424464    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3972dbb7-ebd7-4e18-98ce-0921063b8492-tls-certs\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.424627 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.424567    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-home\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.424627 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.424618    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-tmp-dir\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.424726 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.424666    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhzrz\" (UniqueName: \"kubernetes.io/projected/3972dbb7-ebd7-4e18-98ce-0921063b8492-kube-api-access-mhzrz\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.525393 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.525355    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-home\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.525591 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.525407    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-tmp-dir\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.525591 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.525425    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhzrz\" (UniqueName: \"kubernetes.io/projected/3972dbb7-ebd7-4e18-98ce-0921063b8492-kube-api-access-mhzrz\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.525591 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.525454    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-dshm\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.525591 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.525474    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-model-cache\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.525591 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.525526    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3972dbb7-ebd7-4e18-98ce-0921063b8492-tls-certs\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.525849 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.525813    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-home\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.525935 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.525845    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-tmp-dir\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.525935 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.525907    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-model-cache\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.527983 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.527961    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-dshm\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.528217 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.528199    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3972dbb7-ebd7-4e18-98ce-0921063b8492-tls-certs\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.533756 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.533737    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhzrz\" (UniqueName: \"kubernetes.io/projected/3972dbb7-ebd7-4e18-98ce-0921063b8492-kube-api-access-mhzrz\") pod \"auth-test-model-e55cd3-kserve-6d4b4488c-xnb24\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") " pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.632989 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.632865    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:32:50.770671 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:50.770648    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"]
Jul 14 20:32:50.772492 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:32:50.772453    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3972dbb7_ebd7_4e18_98ce_0921063b8492.slice/crio-20b9a19a6ef02c5530c0f9fc330de3268f74ea1eeff0fd814c1c913d819c9c1d WatchSource:0}: Error finding container 20b9a19a6ef02c5530c0f9fc330de3268f74ea1eeff0fd814c1c913d819c9c1d: Status 404 returned error can't find the container with id 20b9a19a6ef02c5530c0f9fc330de3268f74ea1eeff0fd814c1c913d819c9c1d
Jul 14 20:32:51.650251 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:51.650215    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24" event={"ID":"3972dbb7-ebd7-4e18-98ce-0921063b8492","Type":"ContainerStarted","Data":"90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f"}
Jul 14 20:32:51.650251 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:51.650257    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24" event={"ID":"3972dbb7-ebd7-4e18-98ce-0921063b8492","Type":"ContainerStarted","Data":"20b9a19a6ef02c5530c0f9fc330de3268f74ea1eeff0fd814c1c913d819c9c1d"}
Jul 14 20:32:55.321057 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:55.321020    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:32:55.426657 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:32:55.426630    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:33:00.634035 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:33:00.633978    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:33:00.634035 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:33:00.634049    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:33:00.646403 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:33:00.646358    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:33:00.666096 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:33:00.666042    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24" podStartSLOduration=10.665999332 podStartE2EDuration="10.665999332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:51.675220534 +0000 UTC m=+2465.809196614" watchObservedRunningTime="2026-07-14 20:33:00.665999332 +0000 UTC m=+2474.799975415"
Jul 14 20:33:00.701000 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:33:00.700973    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:33:06.532297 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:33:06.532262    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:33:21.283838 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:33:21.283804    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:35:25.652626 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:25.652551    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"]
Jul 14 20:35:25.705271 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:25.705238    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:35:26.504033 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:26.503997    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:35:33.880272 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:33.880230    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:35:34.367577 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:34.367544    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:35:34.468926 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:34.468900    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:35:40.672637 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.672591    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24" podUID="3972dbb7-ebd7-4e18-98ce-0921063b8492" containerName="main" containerID="cri-o://90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f" gracePeriod=45
Jul 14 20:35:40.690411 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.690368    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24" podUID="3972dbb7-ebd7-4e18-98ce-0921063b8492" containerName="main" probeResult="failure" output="Get \"https://10.134.0.43:8000/ready\": dial tcp 10.134.0.43:8000: connect: connection refused"
Jul 14 20:35:40.925666 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.925606    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:35:40.968511 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.968475    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-dshm\") pod \"3972dbb7-ebd7-4e18-98ce-0921063b8492\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") "
Jul 14 20:35:40.968687 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.968543    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-model-cache\") pod \"3972dbb7-ebd7-4e18-98ce-0921063b8492\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") "
Jul 14 20:35:40.968687 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.968569    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhzrz\" (UniqueName: \"kubernetes.io/projected/3972dbb7-ebd7-4e18-98ce-0921063b8492-kube-api-access-mhzrz\") pod \"3972dbb7-ebd7-4e18-98ce-0921063b8492\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") "
Jul 14 20:35:40.968687 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.968607    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3972dbb7-ebd7-4e18-98ce-0921063b8492-tls-certs\") pod \"3972dbb7-ebd7-4e18-98ce-0921063b8492\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") "
Jul 14 20:35:40.968687 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.968666    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-tmp-dir\") pod \"3972dbb7-ebd7-4e18-98ce-0921063b8492\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") "
Jul 14 20:35:40.968922 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.968712    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-home\") pod \"3972dbb7-ebd7-4e18-98ce-0921063b8492\" (UID: \"3972dbb7-ebd7-4e18-98ce-0921063b8492\") "
Jul 14 20:35:40.968922 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.968859    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-model-cache" (OuterVolumeSpecName: "model-cache") pod "3972dbb7-ebd7-4e18-98ce-0921063b8492" (UID: "3972dbb7-ebd7-4e18-98ce-0921063b8492"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:35:40.969094 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.969010    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3972dbb7-ebd7-4e18-98ce-0921063b8492" (UID: "3972dbb7-ebd7-4e18-98ce-0921063b8492"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:35:40.969094 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.969031    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-model-cache\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:35:40.969272 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.969099    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-home" (OuterVolumeSpecName: "home") pod "3972dbb7-ebd7-4e18-98ce-0921063b8492" (UID: "3972dbb7-ebd7-4e18-98ce-0921063b8492"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:35:40.971047 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.971015    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3972dbb7-ebd7-4e18-98ce-0921063b8492-kube-api-access-mhzrz" (OuterVolumeSpecName: "kube-api-access-mhzrz") pod "3972dbb7-ebd7-4e18-98ce-0921063b8492" (UID: "3972dbb7-ebd7-4e18-98ce-0921063b8492"). InnerVolumeSpecName "kube-api-access-mhzrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:35:40.971047 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.971039    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3972dbb7-ebd7-4e18-98ce-0921063b8492-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3972dbb7-ebd7-4e18-98ce-0921063b8492" (UID: "3972dbb7-ebd7-4e18-98ce-0921063b8492"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:35:40.971194 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:40.971164    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-dshm" (OuterVolumeSpecName: "dshm") pod "3972dbb7-ebd7-4e18-98ce-0921063b8492" (UID: "3972dbb7-ebd7-4e18-98ce-0921063b8492"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:35:41.070290 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.070255    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3972dbb7-ebd7-4e18-98ce-0921063b8492-tls-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:35:41.070290 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.070281    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-tmp-dir\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:35:41.070290 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.070289    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-home\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:35:41.070290 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.070297    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3972dbb7-ebd7-4e18-98ce-0921063b8492-dshm\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:35:41.070557 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.070307    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhzrz\" (UniqueName: \"kubernetes.io/projected/3972dbb7-ebd7-4e18-98ce-0921063b8492-kube-api-access-mhzrz\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:35:41.389933 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.389893    2584 generic.go:356] "Generic (PLEG): container finished" podID="3972dbb7-ebd7-4e18-98ce-0921063b8492" containerID="90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f" exitCode=0
Jul 14 20:35:41.389933 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.389931    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"
Jul 14 20:35:41.390185 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.389946    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24" event={"ID":"3972dbb7-ebd7-4e18-98ce-0921063b8492","Type":"ContainerDied","Data":"90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f"}
Jul 14 20:35:41.390185 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.389977    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24" event={"ID":"3972dbb7-ebd7-4e18-98ce-0921063b8492","Type":"ContainerDied","Data":"20b9a19a6ef02c5530c0f9fc330de3268f74ea1eeff0fd814c1c913d819c9c1d"}
Jul 14 20:35:41.390185 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.389993    2584 scope.go:117] "RemoveContainer" containerID="90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f"
Jul 14 20:35:41.398439 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.398421    2584 scope.go:117] "RemoveContainer" containerID="90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f"
Jul 14 20:35:41.398685 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:35:41.398668    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f\": container with ID starting with 90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f not found: ID does not exist" containerID="90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f"
Jul 14 20:35:41.398733 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.398695    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f"} err="failed to get container status \"90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f\": rpc error: code = NotFound desc = could not find container \"90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f\": container with ID starting with 90187d87c902d4ff097d470e697e44e2c7bece76f00de203fa8225632b5c0b5f not found: ID does not exist"
Jul 14 20:35:41.412517 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.412490    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"]
Jul 14 20:35:41.420278 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:41.420256    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/auth-test-model-e55cd3-kserve-6d4b4488c-xnb24"]
Jul 14 20:35:42.359659 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:42.359621    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3972dbb7-ebd7-4e18-98ce-0921063b8492" path="/var/lib/kubelet/pods/3972dbb7-ebd7-4e18-98ce-0921063b8492/volumes"
Jul 14 20:35:52.966529 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:52.966496    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:35:53.113518 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:53.113487    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:35:56.704046 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.704007    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"]
Jul 14 20:35:56.704504 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.704420    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3972dbb7-ebd7-4e18-98ce-0921063b8492" containerName="main"
Jul 14 20:35:56.704504 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.704433    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3972dbb7-ebd7-4e18-98ce-0921063b8492" containerName="main"
Jul 14 20:35:56.704504 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.704484    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3972dbb7-ebd7-4e18-98ce-0921063b8492" containerName="main"
Jul 14 20:35:56.707283 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.707263    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.711801 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.711777    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"openshift-service-ca.crt\""
Jul 14 20:35:56.711801 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.711793    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"kube-root-ca.crt\""
Jul 14 20:35:56.711984 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.711801    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"default-dockercfg-fslzx\""
Jul 14 20:35:56.711984 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.711822    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d4143c\"/\"sub-test-model-d4143c-kserve-self-signed-certs\""
Jul 14 20:35:56.721199 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.721178    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"]
Jul 14 20:35:56.747934 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.747905    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:35:56.804481 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.804455    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rsfp\" (UniqueName: \"kubernetes.io/projected/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-kube-api-access-9rsfp\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.804622 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.804496    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tls-certs\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.804622 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.804524    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-model-cache\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.804622 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.804584    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-home\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.804622 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.804613    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-dshm\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.804756 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.804636    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tmp-dir\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.905796 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.905760    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-model-cache\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.906007 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.905810    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-home\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.906007 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.905831    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-dshm\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.906007 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.905850    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tmp-dir\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.906007 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.905938    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rsfp\" (UniqueName: \"kubernetes.io/projected/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-kube-api-access-9rsfp\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.906007 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.905985    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tls-certs\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.906554 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.906531    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-home\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.906656 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.906577    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-model-cache\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.906656 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.906637    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tmp-dir\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.908545 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.908525    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-dshm\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.908655 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.908581    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tls-certs\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:56.915666 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:56.915630    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rsfp\" (UniqueName: \"kubernetes.io/projected/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-kube-api-access-9rsfp\") pod \"sub-test-model-d4143c-kserve-794db8587c-m76fk\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") " pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:57.016779 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:57.016665    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:35:57.152554 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:57.152528    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"]
Jul 14 20:35:57.155186 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:35:57.155158    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2895289_7bb1_4061_9e6f_bb68d1dcbc96.slice/crio-113f9f6d451582a9d0b8c0df0fb5b363ff6f9be0b8c77a73e340a959d7608b56 WatchSource:0}: Error finding container 113f9f6d451582a9d0b8c0df0fb5b363ff6f9be0b8c77a73e340a959d7608b56: Status 404 returned error can't find the container with id 113f9f6d451582a9d0b8c0df0fb5b363ff6f9be0b8c77a73e340a959d7608b56
Jul 14 20:35:57.458149 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:57.458115    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk" event={"ID":"a2895289-7bb1-4061-9e6f-bb68d1dcbc96","Type":"ContainerStarted","Data":"1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f"}
Jul 14 20:35:57.458149 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:57.458154    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk" event={"ID":"a2895289-7bb1-4061-9e6f-bb68d1dcbc96","Type":"ContainerStarted","Data":"113f9f6d451582a9d0b8c0df0fb5b363ff6f9be0b8c77a73e340a959d7608b56"}
Jul 14 20:35:57.477669 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:35:57.477618    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk" podStartSLOduration=1.477601133 podStartE2EDuration="1.477601133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:35:57.476650374 +0000 UTC m=+2651.610626458" watchObservedRunningTime="2026-07-14 20:35:57.477601133 +0000 UTC m=+2651.611577213"
Jul 14 20:36:07.017619 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:07.017557    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:36:07.018160 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:07.017632    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:36:07.030505 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:07.030478    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:36:07.512105 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:07.512066    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:36:32.946771 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:32.946729    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:36:33.798756 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:33.798722    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"]
Jul 14 20:36:33.830515 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:33.830485    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:36:45.895837 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:45.895742    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"]
Jul 14 20:36:45.898753 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:45.898731    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:45.902559 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:45.902532    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"kube-root-ca.crt\""
Jul 14 20:36:45.902698 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:45.902532    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"openshift-service-ca.crt\""
Jul 14 20:36:45.902698 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:45.902569    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"default-dockercfg-4hzc6\""
Jul 14 20:36:45.902698 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:45.902590    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e55cd3\"/\"rate-test-model-e55cd3-kserve-self-signed-certs\""
Jul 14 20:36:45.910683 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:45.910660    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"]
Jul 14 20:36:45.935260 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:45.935230    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:36:46.032461 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.032432    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-model-cache\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.032610 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.032469    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-home\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.032610 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.032502    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-dshm\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.032610 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.032585    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-tmp-dir\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.032721 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.032613    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac414897-bcf7-4364-ad09-2dda4df0956f-tls-certs\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.032721 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.032650    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qmnq\" (UniqueName: \"kubernetes.io/projected/ac414897-bcf7-4364-ad09-2dda4df0956f-kube-api-access-5qmnq\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.134052 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.134017    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-home\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.134203 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.134061    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-dshm\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.134203 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.134112    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-tmp-dir\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.134203 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.134136    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac414897-bcf7-4364-ad09-2dda4df0956f-tls-certs\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.134313 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.134289    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qmnq\" (UniqueName: \"kubernetes.io/projected/ac414897-bcf7-4364-ad09-2dda4df0956f-kube-api-access-5qmnq\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.134434 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.134387    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-model-cache\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.134510 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.134490    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-home\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.134702 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.134670    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-tmp-dir\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.134702 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.134683    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-model-cache\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.136636 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.136610    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-dshm\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.136922 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.136903    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac414897-bcf7-4364-ad09-2dda4df0956f-tls-certs\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.143794 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.143772    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qmnq\" (UniqueName: \"kubernetes.io/projected/ac414897-bcf7-4364-ad09-2dda4df0956f-kube-api-access-5qmnq\") pod \"rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") " pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.210039 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.210018    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:46.346558 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.346523    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"]
Jul 14 20:36:46.349326 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:36:46.349296    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac414897_bcf7_4364_ad09_2dda4df0956f.slice/crio-c3d290e754fc1d934da84089f759b7e28559bd6f00193911d4c692c4443338d7 WatchSource:0}: Error finding container c3d290e754fc1d934da84089f759b7e28559bd6f00193911d4c692c4443338d7: Status 404 returned error can't find the container with id c3d290e754fc1d934da84089f759b7e28559bd6f00193911d4c692c4443338d7
Jul 14 20:36:46.436057 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.436030    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:36:46.440172 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.440146    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nzhmm_5d52b149-467b-48ce-b1eb-d1f3933d3931/ovn-acl-logging/0.log"
Jul 14 20:36:46.674497 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.674404    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm" event={"ID":"ac414897-bcf7-4364-ad09-2dda4df0956f","Type":"ContainerStarted","Data":"9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327"}
Jul 14 20:36:46.674497 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.674447    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm" event={"ID":"ac414897-bcf7-4364-ad09-2dda4df0956f","Type":"ContainerStarted","Data":"c3d290e754fc1d934da84089f759b7e28559bd6f00193911d4c692c4443338d7"}
Jul 14 20:36:46.699177 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:46.699074    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm" podStartSLOduration=1.699055145 podStartE2EDuration="1.699055145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:36:46.693156523 +0000 UTC m=+2700.827132613" watchObservedRunningTime="2026-07-14 20:36:46.699055145 +0000 UTC m=+2700.833031229"
Jul 14 20:36:48.819165 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:48.819124    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk" podUID="a2895289-7bb1-4061-9e6f-bb68d1dcbc96" containerName="main" containerID="cri-o://1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f" gracePeriod=45
Jul 14 20:36:49.074533 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.074471    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:36:49.259755 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.259722    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-dshm\") pod \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") "
Jul 14 20:36:49.259955 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.259814    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tmp-dir\") pod \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") "
Jul 14 20:36:49.259955 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.259841    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-model-cache\") pod \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") "
Jul 14 20:36:49.259955 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.259899    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rsfp\" (UniqueName: \"kubernetes.io/projected/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-kube-api-access-9rsfp\") pod \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") "
Jul 14 20:36:49.259955 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.259924    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-home\") pod \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") "
Jul 14 20:36:49.260180 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.259967    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tls-certs\") pod \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\" (UID: \"a2895289-7bb1-4061-9e6f-bb68d1dcbc96\") "
Jul 14 20:36:49.260180 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.260113    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a2895289-7bb1-4061-9e6f-bb68d1dcbc96" (UID: "a2895289-7bb1-4061-9e6f-bb68d1dcbc96"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:36:49.260287 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.260174    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-model-cache" (OuterVolumeSpecName: "model-cache") pod "a2895289-7bb1-4061-9e6f-bb68d1dcbc96" (UID: "a2895289-7bb1-4061-9e6f-bb68d1dcbc96"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:36:49.260348 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.260283    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-home" (OuterVolumeSpecName: "home") pod "a2895289-7bb1-4061-9e6f-bb68d1dcbc96" (UID: "a2895289-7bb1-4061-9e6f-bb68d1dcbc96"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:36:49.260348 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.260290    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tmp-dir\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:36:49.260348 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.260333    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-model-cache\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:36:49.262274 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.262251    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-dshm" (OuterVolumeSpecName: "dshm") pod "a2895289-7bb1-4061-9e6f-bb68d1dcbc96" (UID: "a2895289-7bb1-4061-9e6f-bb68d1dcbc96"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:36:49.262362 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.262271    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a2895289-7bb1-4061-9e6f-bb68d1dcbc96" (UID: "a2895289-7bb1-4061-9e6f-bb68d1dcbc96"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:36:49.262362 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.262306    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-kube-api-access-9rsfp" (OuterVolumeSpecName: "kube-api-access-9rsfp") pod "a2895289-7bb1-4061-9e6f-bb68d1dcbc96" (UID: "a2895289-7bb1-4061-9e6f-bb68d1dcbc96"). InnerVolumeSpecName "kube-api-access-9rsfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:36:49.361481 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.361394    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-tls-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:36:49.361481 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.361425    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-dshm\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:36:49.361481 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.361435    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rsfp\" (UniqueName: \"kubernetes.io/projected/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-kube-api-access-9rsfp\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:36:49.361481 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.361444    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2895289-7bb1-4061-9e6f-bb68d1dcbc96-home\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:36:49.688066 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.687984    2584 generic.go:356] "Generic (PLEG): container finished" podID="a2895289-7bb1-4061-9e6f-bb68d1dcbc96" containerID="1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f" exitCode=0
Jul 14 20:36:49.688066 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.688028    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"
Jul 14 20:36:49.688238 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.688065    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk" event={"ID":"a2895289-7bb1-4061-9e6f-bb68d1dcbc96","Type":"ContainerDied","Data":"1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f"}
Jul 14 20:36:49.688238 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.688107    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk" event={"ID":"a2895289-7bb1-4061-9e6f-bb68d1dcbc96","Type":"ContainerDied","Data":"113f9f6d451582a9d0b8c0df0fb5b363ff6f9be0b8c77a73e340a959d7608b56"}
Jul 14 20:36:49.688238 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.688125    2584 scope.go:117] "RemoveContainer" containerID="1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f"
Jul 14 20:36:49.696841 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.696819    2584 scope.go:117] "RemoveContainer" containerID="1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f"
Jul 14 20:36:49.697145 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:36:49.697125    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f\": container with ID starting with 1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f not found: ID does not exist" containerID="1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f"
Jul 14 20:36:49.697234 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.697153    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f"} err="failed to get container status \"1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f\": rpc error: code = NotFound desc = could not find container \"1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f\": container with ID starting with 1e76b483700f9df2ae4ad3a8e52f2338a6905df7186bb3506fc71d239d1b2c7f not found: ID does not exist"
Jul 14 20:36:49.715992 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.715965    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"]
Jul 14 20:36:49.722731 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:49.722705    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d4143c/sub-test-model-d4143c-kserve-794db8587c-m76fk"]
Jul 14 20:36:50.359735 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:50.359702    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2895289-7bb1-4061-9e6f-bb68d1dcbc96" path="/var/lib/kubelet/pods/a2895289-7bb1-4061-9e6f-bb68d1dcbc96/volumes"
Jul 14 20:36:56.210367 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:56.210335    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:56.210787 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:56.210381    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:56.222696 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:56.222666    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:36:56.729046 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:36:56.729024    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:37:20.426099 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:37:20.426067    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:37:25.120415 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:37:25.120382    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:37:29.028429 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:37:29.028389    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:37:36.463453 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:37:36.463420    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:37:47.842682 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:37:47.842644    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:37:47.941534 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:37:47.941499    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:37:56.258640 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:37:56.258603    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:37:56.356376 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:37:56.356342    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:14.062612 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:14.062537    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"]
Jul 14 20:38:14.101557 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:14.101519    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:15.082369 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:15.082334    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:18.732524 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:18.732486    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8524-140590132648368"]
Jul 14 20:38:18.732934 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:18.732798    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2895289-7bb1-4061-9e6f-bb68d1dcbc96" containerName="main"
Jul 14 20:38:18.732934 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:18.732808    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2895289-7bb1-4061-9e6f-bb68d1dcbc96" containerName="main"
Jul 14 20:38:18.732934 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:18.732888    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2895289-7bb1-4061-9e6f-bb68d1dcbc96" containerName="main"
Jul 14 20:38:18.735777 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:18.735758    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132648368"
Jul 14 20:38:18.738268 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:18.738250    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7zqjm\""
Jul 14 20:38:18.741481 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:18.741458    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132648368"]
Jul 14 20:38:18.835585 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:18.835552    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn2tg\" (UniqueName: \"kubernetes.io/projected/aa1ef5f6-dcba-45ca-b657-640dfe4221b8-kube-api-access-dn2tg\") pod \"test-curl-8524-140590132648368\" (UID: \"aa1ef5f6-dcba-45ca-b657-640dfe4221b8\") " pod="opendatahub/test-curl-8524-140590132648368"
Jul 14 20:38:18.936152 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:18.936112    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn2tg\" (UniqueName: \"kubernetes.io/projected/aa1ef5f6-dcba-45ca-b657-640dfe4221b8-kube-api-access-dn2tg\") pod \"test-curl-8524-140590132648368\" (UID: \"aa1ef5f6-dcba-45ca-b657-640dfe4221b8\") " pod="opendatahub/test-curl-8524-140590132648368"
Jul 14 20:38:18.945174 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:18.945149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn2tg\" (UniqueName: \"kubernetes.io/projected/aa1ef5f6-dcba-45ca-b657-640dfe4221b8-kube-api-access-dn2tg\") pod \"test-curl-8524-140590132648368\" (UID: \"aa1ef5f6-dcba-45ca-b657-640dfe4221b8\") " pod="opendatahub/test-curl-8524-140590132648368"
Jul 14 20:38:19.045128 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:19.045050    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132648368"
Jul 14 20:38:19.388318 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:19.388162    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132648368"]
Jul 14 20:38:19.391040 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:38:19.391011    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa1ef5f6_dcba_45ca_b657_640dfe4221b8.slice/crio-dc92813114fec1197179d25392d9a95411219c833d175e1bcb002a54e2eb5246 WatchSource:0}: Error finding container dc92813114fec1197179d25392d9a95411219c833d175e1bcb002a54e2eb5246: Status 404 returned error can't find the container with id dc92813114fec1197179d25392d9a95411219c833d175e1bcb002a54e2eb5246
Jul 14 20:38:19.392221 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:19.392200    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:38:20.071440 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:20.071410    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132648368" event={"ID":"aa1ef5f6-dcba-45ca-b657-640dfe4221b8","Type":"ContainerStarted","Data":"dc92813114fec1197179d25392d9a95411219c833d175e1bcb002a54e2eb5246"}
Jul 14 20:38:21.077303 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:21.077269    2584 generic.go:356] "Generic (PLEG): container finished" podID="aa1ef5f6-dcba-45ca-b657-640dfe4221b8" containerID="a8fa93af3dd056eb7da32238ecc29746a7dc2e097938aebd0d194437c0bce700" exitCode=0
Jul 14 20:38:21.077686 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:21.077365    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132648368" event={"ID":"aa1ef5f6-dcba-45ca-b657-640dfe4221b8","Type":"ContainerDied","Data":"a8fa93af3dd056eb7da32238ecc29746a7dc2e097938aebd0d194437c0bce700"}
Jul 14 20:38:22.215319 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:22.215293    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132648368"
Jul 14 20:38:22.235768 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:22.235747    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8524-140590132648368_aa1ef5f6-dcba-45ca-b657-640dfe4221b8/test-curl-8524-140590132648368/0.log"
Jul 14 20:38:22.259994 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:22.259964    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8524-140590132648368"]
Jul 14 20:38:22.264274 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:22.264252    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8524-140590132648368"]
Jul 14 20:38:22.369935 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:22.369842    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn2tg\" (UniqueName: \"kubernetes.io/projected/aa1ef5f6-dcba-45ca-b657-640dfe4221b8-kube-api-access-dn2tg\") pod \"aa1ef5f6-dcba-45ca-b657-640dfe4221b8\" (UID: \"aa1ef5f6-dcba-45ca-b657-640dfe4221b8\") "
Jul 14 20:38:22.372073 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:22.372052    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa1ef5f6-dcba-45ca-b657-640dfe4221b8-kube-api-access-dn2tg" (OuterVolumeSpecName: "kube-api-access-dn2tg") pod "aa1ef5f6-dcba-45ca-b657-640dfe4221b8" (UID: "aa1ef5f6-dcba-45ca-b657-640dfe4221b8"). InnerVolumeSpecName "kube-api-access-dn2tg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:38:22.470991 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:22.470961    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn2tg\" (UniqueName: \"kubernetes.io/projected/aa1ef5f6-dcba-45ca-b657-640dfe4221b8-kube-api-access-dn2tg\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:38:23.086561 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:23.086530    2584 scope.go:117] "RemoveContainer" containerID="a8fa93af3dd056eb7da32238ecc29746a7dc2e097938aebd0d194437c0bce700"
Jul 14 20:38:23.086561 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:23.086545    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132648368"
Jul 14 20:38:23.294491 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:23.294460    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:23.894740 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:23.894700    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:24.358769 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:24.358737    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa1ef5f6-dcba-45ca-b657-640dfe4221b8" path="/var/lib/kubelet/pods/aa1ef5f6-dcba-45ca-b657-640dfe4221b8/volumes"
Jul 14 20:38:27.756302 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:27.756270    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8524-140590132511776"]
Jul 14 20:38:27.756785 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:27.756589    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa1ef5f6-dcba-45ca-b657-640dfe4221b8" containerName="test-curl-8524-140590132648368"
Jul 14 20:38:27.756785 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:27.756599    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa1ef5f6-dcba-45ca-b657-640dfe4221b8" containerName="test-curl-8524-140590132648368"
Jul 14 20:38:27.756785 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:27.756664    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa1ef5f6-dcba-45ca-b657-640dfe4221b8" containerName="test-curl-8524-140590132648368"
Jul 14 20:38:27.760701 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:27.760682    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:27.765580 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:27.765562    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7zqjm\""
Jul 14 20:38:27.768223 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:27.768198    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132511776"]
Jul 14 20:38:27.918682 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:27.918648    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7f68\" (UniqueName: \"kubernetes.io/projected/d5e54776-9b6d-4bc2-97ee-3634c8bb9f55-kube-api-access-z7f68\") pod \"test-curl-8524-140590132511776\" (UID: \"d5e54776-9b6d-4bc2-97ee-3634c8bb9f55\") " pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:28.019183 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:28.019096    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7f68\" (UniqueName: \"kubernetes.io/projected/d5e54776-9b6d-4bc2-97ee-3634c8bb9f55-kube-api-access-z7f68\") pod \"test-curl-8524-140590132511776\" (UID: \"d5e54776-9b6d-4bc2-97ee-3634c8bb9f55\") " pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:28.028058 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:28.028035    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7f68\" (UniqueName: \"kubernetes.io/projected/d5e54776-9b6d-4bc2-97ee-3634c8bb9f55-kube-api-access-z7f68\") pod \"test-curl-8524-140590132511776\" (UID: \"d5e54776-9b6d-4bc2-97ee-3634c8bb9f55\") " pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:28.070039 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:28.070007    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:28.204720 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:28.204690    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8524-140590132511776"]
Jul 14 20:38:28.208444 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:38:28.208416    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5e54776_9b6d_4bc2_97ee_3634c8bb9f55.slice/crio-1eb6eadac6ead477b88d3b6cf01fa8bdd17717e3301f8324b736cb3f07051f9d WatchSource:0}: Error finding container 1eb6eadac6ead477b88d3b6cf01fa8bdd17717e3301f8324b736cb3f07051f9d: Status 404 returned error can't find the container with id 1eb6eadac6ead477b88d3b6cf01fa8bdd17717e3301f8324b736cb3f07051f9d
Jul 14 20:38:29.082360 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.082294    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm" podUID="ac414897-bcf7-4364-ad09-2dda4df0956f" containerName="main" containerID="cri-o://9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327" gracePeriod=45
Jul 14 20:38:29.116173 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.116143    2584 generic.go:356] "Generic (PLEG): container finished" podID="d5e54776-9b6d-4bc2-97ee-3634c8bb9f55" containerID="c4d2934a55c76eb6b338eec6fe2093a97d3042de7ccf5236930507ffe483cc12" exitCode=0
Jul 14 20:38:29.116304 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.116218    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132511776" event={"ID":"d5e54776-9b6d-4bc2-97ee-3634c8bb9f55","Type":"ContainerDied","Data":"c4d2934a55c76eb6b338eec6fe2093a97d3042de7ccf5236930507ffe483cc12"}
Jul 14 20:38:29.116304 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.116256    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8524-140590132511776" event={"ID":"d5e54776-9b6d-4bc2-97ee-3634c8bb9f55","Type":"ContainerStarted","Data":"1eb6eadac6ead477b88d3b6cf01fa8bdd17717e3301f8324b736cb3f07051f9d"}
Jul 14 20:38:29.326386 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.326362    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:38:29.430716 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.430686    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qmnq\" (UniqueName: \"kubernetes.io/projected/ac414897-bcf7-4364-ad09-2dda4df0956f-kube-api-access-5qmnq\") pod \"ac414897-bcf7-4364-ad09-2dda4df0956f\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") "
Jul 14 20:38:29.430943 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.430724    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-tmp-dir\") pod \"ac414897-bcf7-4364-ad09-2dda4df0956f\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") "
Jul 14 20:38:29.430943 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.430754    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-home\") pod \"ac414897-bcf7-4364-ad09-2dda4df0956f\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") "
Jul 14 20:38:29.430943 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.430771    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-model-cache\") pod \"ac414897-bcf7-4364-ad09-2dda4df0956f\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") "
Jul 14 20:38:29.430943 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.430785    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-dshm\") pod \"ac414897-bcf7-4364-ad09-2dda4df0956f\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") "
Jul 14 20:38:29.430943 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.430837    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac414897-bcf7-4364-ad09-2dda4df0956f-tls-certs\") pod \"ac414897-bcf7-4364-ad09-2dda4df0956f\" (UID: \"ac414897-bcf7-4364-ad09-2dda4df0956f\") "
Jul 14 20:38:29.431212 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.431086    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-home" (OuterVolumeSpecName: "home") pod "ac414897-bcf7-4364-ad09-2dda4df0956f" (UID: "ac414897-bcf7-4364-ad09-2dda4df0956f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:38:29.431212 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.431077    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-model-cache" (OuterVolumeSpecName: "model-cache") pod "ac414897-bcf7-4364-ad09-2dda4df0956f" (UID: "ac414897-bcf7-4364-ad09-2dda4df0956f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:38:29.431212 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.431102    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ac414897-bcf7-4364-ad09-2dda4df0956f" (UID: "ac414897-bcf7-4364-ad09-2dda4df0956f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:38:29.433073 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.433034    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-dshm" (OuterVolumeSpecName: "dshm") pod "ac414897-bcf7-4364-ad09-2dda4df0956f" (UID: "ac414897-bcf7-4364-ad09-2dda4df0956f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:38:29.433205 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.433137    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac414897-bcf7-4364-ad09-2dda4df0956f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ac414897-bcf7-4364-ad09-2dda4df0956f" (UID: "ac414897-bcf7-4364-ad09-2dda4df0956f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:38:29.433205 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.433158    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac414897-bcf7-4364-ad09-2dda4df0956f-kube-api-access-5qmnq" (OuterVolumeSpecName: "kube-api-access-5qmnq") pod "ac414897-bcf7-4364-ad09-2dda4df0956f" (UID: "ac414897-bcf7-4364-ad09-2dda4df0956f"). InnerVolumeSpecName "kube-api-access-5qmnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:38:29.531793 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.531757    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qmnq\" (UniqueName: \"kubernetes.io/projected/ac414897-bcf7-4364-ad09-2dda4df0956f-kube-api-access-5qmnq\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:38:29.531793 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.531787    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-tmp-dir\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:38:29.531793 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.531801    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-home\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:38:29.532058 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.531812    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-model-cache\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:38:29.532058 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.531823    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac414897-bcf7-4364-ad09-2dda4df0956f-dshm\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:38:29.532058 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:29.531834    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac414897-bcf7-4364-ad09-2dda4df0956f-tls-certs\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:38:30.122158 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.122124    2584 generic.go:356] "Generic (PLEG): container finished" podID="ac414897-bcf7-4364-ad09-2dda4df0956f" containerID="9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327" exitCode=0
Jul 14 20:38:30.122635 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.122166    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"
Jul 14 20:38:30.122635 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.122210    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm" event={"ID":"ac414897-bcf7-4364-ad09-2dda4df0956f","Type":"ContainerDied","Data":"9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327"}
Jul 14 20:38:30.122635 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.122259    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm" event={"ID":"ac414897-bcf7-4364-ad09-2dda4df0956f","Type":"ContainerDied","Data":"c3d290e754fc1d934da84089f759b7e28559bd6f00193911d4c692c4443338d7"}
Jul 14 20:38:30.122635 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.122277    2584 scope.go:117] "RemoveContainer" containerID="9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327"
Jul 14 20:38:30.132117 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.132099    2584 scope.go:117] "RemoveContainer" containerID="9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327"
Jul 14 20:38:30.132407 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:38:30.132369    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327\": container with ID starting with 9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327 not found: ID does not exist" containerID="9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327"
Jul 14 20:38:30.132520 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.132418    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327"} err="failed to get container status \"9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327\": rpc error: code = NotFound desc = could not find container \"9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327\": container with ID starting with 9571df4905a7bd34f0323a046a0ff13c686047c51ab29fa6e4f2228a6cb29327 not found: ID does not exist"
Jul 14 20:38:30.146069 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.146044    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"]
Jul 14 20:38:30.154738 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.154712    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e55cd3/rate-test-model-e55cd3-kserve-7bf5568bc-hp9pm"]
Jul 14 20:38:30.259066 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.259042    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:30.282812 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.282782    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-8524-140590132511776_d5e54776-9b6d-4bc2-97ee-3634c8bb9f55/test-curl-8524-140590132511776/0.log"
Jul 14 20:38:30.316150 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.316120    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8524-140590132511776"]
Jul 14 20:38:30.322923 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.322901    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8524-140590132511776"]
Jul 14 20:38:30.358971 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.358942    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac414897-bcf7-4364-ad09-2dda4df0956f" path="/var/lib/kubelet/pods/ac414897-bcf7-4364-ad09-2dda4df0956f/volumes"
Jul 14 20:38:30.440507 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.440423    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7f68\" (UniqueName: \"kubernetes.io/projected/d5e54776-9b6d-4bc2-97ee-3634c8bb9f55-kube-api-access-z7f68\") pod \"d5e54776-9b6d-4bc2-97ee-3634c8bb9f55\" (UID: \"d5e54776-9b6d-4bc2-97ee-3634c8bb9f55\") "
Jul 14 20:38:30.442625 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.442595    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5e54776-9b6d-4bc2-97ee-3634c8bb9f55-kube-api-access-z7f68" (OuterVolumeSpecName: "kube-api-access-z7f68") pod "d5e54776-9b6d-4bc2-97ee-3634c8bb9f55" (UID: "d5e54776-9b6d-4bc2-97ee-3634c8bb9f55"). InnerVolumeSpecName "kube-api-access-z7f68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:38:30.541251 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:30.541219    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7f68\" (UniqueName: \"kubernetes.io/projected/d5e54776-9b6d-4bc2-97ee-3634c8bb9f55-kube-api-access-z7f68\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:38:31.127987 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:31.127959    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8524-140590132511776"
Jul 14 20:38:31.128492 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:31.128017    2584 scope.go:117] "RemoveContainer" containerID="c4d2934a55c76eb6b338eec6fe2093a97d3042de7ccf5236930507ffe483cc12"
Jul 14 20:38:32.359137 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:32.359095    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5e54776-9b6d-4bc2-97ee-3634c8bb9f55" path="/var/lib/kubelet/pods/d5e54776-9b6d-4bc2-97ee-3634c8bb9f55/volumes"
Jul 14 20:38:33.542156 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:33.542117    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:33.644245 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:33.644205    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:43.624447 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:43.624412    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"]
Jul 14 20:38:43.624841 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:43.624616    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn" podUID="75ebca2a-b6a0-43d9-98df-059920d4ee0f" containerName="maas-api" containerID="cri-o://23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31" gracePeriod=30
Jul 14 20:38:43.657044 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:43.657015    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:43.868230 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:43.868202    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:38:43.948072 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:43.948047    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htdds\" (UniqueName: \"kubernetes.io/projected/75ebca2a-b6a0-43d9-98df-059920d4ee0f-kube-api-access-htdds\") pod \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") "
Jul 14 20:38:43.948248 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:43.948095    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75ebca2a-b6a0-43d9-98df-059920d4ee0f-openshift-service-ca\") pod \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") "
Jul 14 20:38:43.948248 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:43.948169    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75ebca2a-b6a0-43d9-98df-059920d4ee0f-maas-api-tls\") pod \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\" (UID: \"75ebca2a-b6a0-43d9-98df-059920d4ee0f\") "
Jul 14 20:38:43.948426 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:43.948403    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75ebca2a-b6a0-43d9-98df-059920d4ee0f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "75ebca2a-b6a0-43d9-98df-059920d4ee0f" (UID: "75ebca2a-b6a0-43d9-98df-059920d4ee0f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:38:43.950239 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:43.950209    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ebca2a-b6a0-43d9-98df-059920d4ee0f-kube-api-access-htdds" (OuterVolumeSpecName: "kube-api-access-htdds") pod "75ebca2a-b6a0-43d9-98df-059920d4ee0f" (UID: "75ebca2a-b6a0-43d9-98df-059920d4ee0f"). InnerVolumeSpecName "kube-api-access-htdds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:38:43.950345 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:43.950250    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ebca2a-b6a0-43d9-98df-059920d4ee0f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "75ebca2a-b6a0-43d9-98df-059920d4ee0f" (UID: "75ebca2a-b6a0-43d9-98df-059920d4ee0f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:38:44.049186 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.049157    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75ebca2a-b6a0-43d9-98df-059920d4ee0f-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:38:44.049186 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.049182    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htdds\" (UniqueName: \"kubernetes.io/projected/75ebca2a-b6a0-43d9-98df-059920d4ee0f-kube-api-access-htdds\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:38:44.049186 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.049192    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75ebca2a-b6a0-43d9-98df-059920d4ee0f-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:38:44.185998 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.185963    2584 generic.go:356] "Generic (PLEG): container finished" podID="75ebca2a-b6a0-43d9-98df-059920d4ee0f" containerID="23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31" exitCode=0
Jul 14 20:38:44.185998 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.185999    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn" event={"ID":"75ebca2a-b6a0-43d9-98df-059920d4ee0f","Type":"ContainerDied","Data":"23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31"}
Jul 14 20:38:44.186233 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.186012    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"
Jul 14 20:38:44.186233 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.186038    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn" event={"ID":"75ebca2a-b6a0-43d9-98df-059920d4ee0f","Type":"ContainerDied","Data":"f7138be2f5c32530c53da5c3929d11bbfdd51338368f3f2fd6922c2c27ce9890"}
Jul 14 20:38:44.186233 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.186059    2584 scope.go:117] "RemoveContainer" containerID="23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31"
Jul 14 20:38:44.196937 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.196890    2584 scope.go:117] "RemoveContainer" containerID="23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31"
Jul 14 20:38:44.197343 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:38:44.197324    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31\": container with ID starting with 23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31 not found: ID does not exist" containerID="23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31"
Jul 14 20:38:44.197417 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.197355    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31"} err="failed to get container status \"23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31\": rpc error: code = NotFound desc = could not find container \"23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31\": container with ID starting with 23b8f82c893cb7858c01e89582fedcc7ab695b39d27fc71106a3048e2a618d31 not found: ID does not exist"
Jul 14 20:38:44.209185 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.209129    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"]
Jul 14 20:38:44.214074 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.214051    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-e55cd3-799bdc489b-q7zgn"]
Jul 14 20:38:44.359841 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:44.359809    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75ebca2a-b6a0-43d9-98df-059920d4ee0f" path="/var/lib/kubelet/pods/75ebca2a-b6a0-43d9-98df-059920d4ee0f/volumes"
Jul 14 20:38:48.001774 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:48.001723    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:54.249905 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:54.249837    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:54.340646 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:54.340609    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:58.735700 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:58.735666    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:58.972005 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:58.971970    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:59.743333 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:59.743301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:38:59.846034 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:38:59.846001    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:39:09.891471 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:09.891429    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"]
Jul 14 20:39:09.891892 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:09.891669    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb" podUID="3a191718-aabb-47aa-93e1-8be21595b49a" containerName="maas-api" containerID="cri-o://f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee" gracePeriod=30
Jul 14 20:39:09.933620 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:09.933587    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:39:10.139659 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.139635    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:39:10.259258 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.259226    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88nhd\" (UniqueName: \"kubernetes.io/projected/3a191718-aabb-47aa-93e1-8be21595b49a-kube-api-access-88nhd\") pod \"3a191718-aabb-47aa-93e1-8be21595b49a\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") "
Jul 14 20:39:10.259455 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.259285    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a191718-aabb-47aa-93e1-8be21595b49a-openshift-service-ca\") pod \"3a191718-aabb-47aa-93e1-8be21595b49a\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") "
Jul 14 20:39:10.259455 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.259309    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a191718-aabb-47aa-93e1-8be21595b49a-maas-api-tls\") pod \"3a191718-aabb-47aa-93e1-8be21595b49a\" (UID: \"3a191718-aabb-47aa-93e1-8be21595b49a\") "
Jul 14 20:39:10.259717 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.259694    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a191718-aabb-47aa-93e1-8be21595b49a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3a191718-aabb-47aa-93e1-8be21595b49a" (UID: "3a191718-aabb-47aa-93e1-8be21595b49a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:39:10.261447 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.261425    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a191718-aabb-47aa-93e1-8be21595b49a-kube-api-access-88nhd" (OuterVolumeSpecName: "kube-api-access-88nhd") pod "3a191718-aabb-47aa-93e1-8be21595b49a" (UID: "3a191718-aabb-47aa-93e1-8be21595b49a"). InnerVolumeSpecName "kube-api-access-88nhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:39:10.261522 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.261497    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a191718-aabb-47aa-93e1-8be21595b49a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3a191718-aabb-47aa-93e1-8be21595b49a" (UID: "3a191718-aabb-47aa-93e1-8be21595b49a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:39:10.297487 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.297457    2584 generic.go:356] "Generic (PLEG): container finished" podID="3a191718-aabb-47aa-93e1-8be21595b49a" containerID="f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee" exitCode=0
Jul 14 20:39:10.297627 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.297494    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"
Jul 14 20:39:10.297627 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.297502    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb" event={"ID":"3a191718-aabb-47aa-93e1-8be21595b49a","Type":"ContainerDied","Data":"f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee"}
Jul 14 20:39:10.297627 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.297555    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb" event={"ID":"3a191718-aabb-47aa-93e1-8be21595b49a","Type":"ContainerDied","Data":"5f1b315e48a2dbc56d28de9f2914a2ced80346b9b92cb011ac98d1a0325ecc02"}
Jul 14 20:39:10.297627 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.297578    2584 scope.go:117] "RemoveContainer" containerID="f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee"
Jul 14 20:39:10.308288 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.308271    2584 scope.go:117] "RemoveContainer" containerID="f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee"
Jul 14 20:39:10.308556 ip-10-0-142-56 kubenswrapper[2584]: E0714 20:39:10.308538    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee\": container with ID starting with f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee not found: ID does not exist" containerID="f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee"
Jul 14 20:39:10.308617 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.308570    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee"} err="failed to get container status \"f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee\": rpc error: code = NotFound desc = could not find container \"f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee\": container with ID starting with f774c69aa543836914ce621dbb43ac70ab7bd2c0ac4ede188aa170c2e132c7ee not found: ID does not exist"
Jul 14 20:39:10.321293 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.321267    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"]
Jul 14 20:39:10.327896 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.327856    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d4143c-759f9b89bc-csqjb"]
Jul 14 20:39:10.358981 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.358956    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a191718-aabb-47aa-93e1-8be21595b49a" path="/var/lib/kubelet/pods/3a191718-aabb-47aa-93e1-8be21595b49a/volumes"
Jul 14 20:39:10.360311 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.360296    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88nhd\" (UniqueName: \"kubernetes.io/projected/3a191718-aabb-47aa-93e1-8be21595b49a-kube-api-access-88nhd\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:39:10.360360 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.360315    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a191718-aabb-47aa-93e1-8be21595b49a-openshift-service-ca\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:39:10.360360 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:10.360325    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a191718-aabb-47aa-93e1-8be21595b49a-maas-api-tls\") on node \"ip-10-0-142-56.ec2.internal\" DevicePath \"\""
Jul 14 20:39:14.199168 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:14.199131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:39:20.508546 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:20.508510    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:39:20.572371 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:20.572330    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:39:25.003123 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:25.003087    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:39:25.651194 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:25.651163    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-654758fb5f-hb2x6_75c6fd5a-227c-4050-ae8b-b42e769365ae/authorino/0.log"
Jul 14 20:39:26.812544 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:26.812512    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:39:31.471596 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:31.471568    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-2rsr6_14f05a4f-2459-4fdd-a341-c6ac0594454e/copy-manifests/0.log"
Jul 14 20:39:31.479655 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:31.479635    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-2rsr6_14f05a4f-2459-4fdd-a341-c6ac0594454e/manager/0.log"
Jul 14 20:39:32.155964 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:32.155936    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6cf85b6845-496rp_3a0bc4a3-7509-4c4a-994f-349430e22327/maas-api/0.log"
Jul 14 20:39:35.435580 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:35.435548    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-654758fb5f-hb2x6_75c6fd5a-227c-4050-ae8b-b42e769365ae/authorino/0.log"
Jul 14 20:39:35.852573 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:35.852545    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6bpsq_23b9aed2-db8c-4ea6-b859-9da269edac8f/kuadrant-console-plugin/0.log"
Jul 14 20:39:37.153243 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:37.153159    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df779c5f-hd2qp_3409785f-0f87-4bad-aa10-95e4167084f7/kube-auth-proxy/0.log"
Jul 14 20:39:37.413707 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:37.413630    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xghbs_42c60b58-2d2c-42f8-a110-92bb83b69f75/payload-pre-processing/0.log"
Jul 14 20:39:37.657716 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:37.657684    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79969f9494-rw7n6_7f80533b-d0ec-4684-9a75-2dc53eae9b4d/router/0.log"
Jul 14 20:39:38.024106 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:38.024062    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hkb5t_00b15c47-6582-4577-b564-b4a1c5498211/main/0.log"
Jul 14 20:39:38.270176 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:38.270148    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-kltt5_6596456d-8e0a-45b3-8221-8cac65393f55/main/0.log"
Jul 14 20:39:38.637211 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:38.637182    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-n857p_031cbe24-5bcf-4117-9318-ab50dd55936a/main/0.log"
Jul 14 20:39:43.337469 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337434    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6mzxq/must-gather-jwl8g"]
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337739    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5e54776-9b6d-4bc2-97ee-3634c8bb9f55" containerName="test-curl-8524-140590132511776"
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337750    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5e54776-9b6d-4bc2-97ee-3634c8bb9f55" containerName="test-curl-8524-140590132511776"
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337761    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ebca2a-b6a0-43d9-98df-059920d4ee0f" containerName="maas-api"
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337767    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ebca2a-b6a0-43d9-98df-059920d4ee0f" containerName="maas-api"
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337779    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac414897-bcf7-4364-ad09-2dda4df0956f" containerName="main"
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337785    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac414897-bcf7-4364-ad09-2dda4df0956f" containerName="main"
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337795    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a191718-aabb-47aa-93e1-8be21595b49a" containerName="maas-api"
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337800    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a191718-aabb-47aa-93e1-8be21595b49a" containerName="maas-api"
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337850    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ebca2a-b6a0-43d9-98df-059920d4ee0f" containerName="maas-api"
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337859    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a191718-aabb-47aa-93e1-8be21595b49a" containerName="maas-api"
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337879    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac414897-bcf7-4364-ad09-2dda4df0956f" containerName="main"
Jul 14 20:39:43.337902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.337885    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5e54776-9b6d-4bc2-97ee-3634c8bb9f55" containerName="test-curl-8524-140590132511776"
Jul 14 20:39:43.340901 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.340861    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mzxq/must-gather-jwl8g"
Jul 14 20:39:43.343770 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.343742    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6mzxq\"/\"default-dockercfg-w8ncr\""
Jul 14 20:39:43.344064 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.344046    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6mzxq\"/\"openshift-service-ca.crt\""
Jul 14 20:39:43.344629 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.344610    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6mzxq\"/\"kube-root-ca.crt\""
Jul 14 20:39:43.352930 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.352906    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mzxq/must-gather-jwl8g"]
Jul 14 20:39:43.365967 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.365943    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:39:43.439725 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.439696    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/53419a68-2cb9-4dc1-8cb5-6bbe1d33013d-must-gather-output\") pod \"must-gather-jwl8g\" (UID: \"53419a68-2cb9-4dc1-8cb5-6bbe1d33013d\") " pod="openshift-must-gather-6mzxq/must-gather-jwl8g"
Jul 14 20:39:43.439934 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.439758    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsx25\" (UniqueName: \"kubernetes.io/projected/53419a68-2cb9-4dc1-8cb5-6bbe1d33013d-kube-api-access-wsx25\") pod \"must-gather-jwl8g\" (UID: \"53419a68-2cb9-4dc1-8cb5-6bbe1d33013d\") " pod="openshift-must-gather-6mzxq/must-gather-jwl8g"
Jul 14 20:39:43.456330 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.456301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log" limit=1024
Jul 14 20:39:43.540668 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.540636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsx25\" (UniqueName: \"kubernetes.io/projected/53419a68-2cb9-4dc1-8cb5-6bbe1d33013d-kube-api-access-wsx25\") pod \"must-gather-jwl8g\" (UID: \"53419a68-2cb9-4dc1-8cb5-6bbe1d33013d\") " pod="openshift-must-gather-6mzxq/must-gather-jwl8g"
Jul 14 20:39:43.540902 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.540722    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/53419a68-2cb9-4dc1-8cb5-6bbe1d33013d-must-gather-output\") pod \"must-gather-jwl8g\" (UID: \"53419a68-2cb9-4dc1-8cb5-6bbe1d33013d\") " pod="openshift-must-gather-6mzxq/must-gather-jwl8g"
Jul 14 20:39:43.541037 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.541019    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/53419a68-2cb9-4dc1-8cb5-6bbe1d33013d-must-gather-output\") pod \"must-gather-jwl8g\" (UID: \"53419a68-2cb9-4dc1-8cb5-6bbe1d33013d\") " pod="openshift-must-gather-6mzxq/must-gather-jwl8g"
Jul 14 20:39:43.549365 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.549342    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsx25\" (UniqueName: \"kubernetes.io/projected/53419a68-2cb9-4dc1-8cb5-6bbe1d33013d-kube-api-access-wsx25\") pod \"must-gather-jwl8g\" (UID: \"53419a68-2cb9-4dc1-8cb5-6bbe1d33013d\") " pod="openshift-must-gather-6mzxq/must-gather-jwl8g"
Jul 14 20:39:43.650408 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.650320    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mzxq/must-gather-jwl8g"
Jul 14 20:39:43.785699 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:43.785666    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mzxq/must-gather-jwl8g"]
Jul 14 20:39:43.788733 ip-10-0-142-56 kubenswrapper[2584]: W0714 20:39:43.788703    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53419a68_2cb9_4dc1_8cb5_6bbe1d33013d.slice/crio-b4e547874f2b78c5832a8f94f8e6bdbe8be132916923b0482dab02f1df2143fb WatchSource:0}: Error finding container b4e547874f2b78c5832a8f94f8e6bdbe8be132916923b0482dab02f1df2143fb: Status 404 returned error can't find the container with id b4e547874f2b78c5832a8f94f8e6bdbe8be132916923b0482dab02f1df2143fb
Jul 14 20:39:44.439293 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:44.439254    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mzxq/must-gather-jwl8g" event={"ID":"53419a68-2cb9-4dc1-8cb5-6bbe1d33013d","Type":"ContainerStarted","Data":"b4e547874f2b78c5832a8f94f8e6bdbe8be132916923b0482dab02f1df2143fb"}
Jul 14 20:39:45.446732 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:45.446701    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mzxq/must-gather-jwl8g" event={"ID":"53419a68-2cb9-4dc1-8cb5-6bbe1d33013d","Type":"ContainerStarted","Data":"f97f7b01e771a6bf181290bc7fc4e1c4f896ff6991aa4a34306e781776ac21ee"}
Jul 14 20:39:45.447131 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:45.446741    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mzxq/must-gather-jwl8g" event={"ID":"53419a68-2cb9-4dc1-8cb5-6bbe1d33013d","Type":"ContainerStarted","Data":"95c13e592d651651be4a7ea9ac73ccf3befad6db7f488a3a1b486727064cb58d"}
Jul 14 20:39:45.465248 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:45.465185    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6mzxq/must-gather-jwl8g" podStartSLOduration=1.418082064 podStartE2EDuration="2.465163115s" totalImagesPullingTime="1.047081051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:39:45.463112229 +0000 UTC m=+2879.597088308" watchObservedRunningTime="2026-07-14 20:39:45.465163115 +0000 UTC m=+2879.599139199"
Jul 14 20:39:46.444627 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:46.444580    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2zwms_63c3ab45-2ab8-47ba-9445-8aff47b1c703/global-pull-secret-syncer/0.log"
Jul 14 20:39:46.595424 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:46.595390    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-248mb_aa216295-dac1-426e-b86e-3f5245643aa5/konnectivity-agent/0.log"
Jul 14 20:39:46.760721 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:46.760637    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-56.ec2.internal_3f5c3c9fa324c8535ea8803ceb4a7bd1/haproxy/0.log"
Jul 14 20:39:51.796527 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:51.796487    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-654758fb5f-hb2x6_75c6fd5a-227c-4050-ae8b-b42e769365ae/authorino/0.log"
Jul 14 20:39:51.895190 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:51.895160    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6bpsq_23b9aed2-db8c-4ea6-b859-9da269edac8f/kuadrant-console-plugin/0.log"
Jul 14 20:39:54.259124 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:54.259082    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kxvsj_caa4dc4b-017c-4513-a286-6ccdba79dca2/kube-state-metrics/0.log"
Jul 14 20:39:54.286634 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:54.286607    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kxvsj_caa4dc4b-017c-4513-a286-6ccdba79dca2/kube-rbac-proxy-main/0.log"
Jul 14 20:39:54.322598 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:54.322574    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kxvsj_caa4dc4b-017c-4513-a286-6ccdba79dca2/kube-rbac-proxy-self/0.log"
Jul 14 20:39:54.514594 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:54.514466    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lxh5b_6286f237-d319-4e06-b9dc-ce90ed493b77/node-exporter/0.log"
Jul 14 20:39:54.537369 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:54.537329    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lxh5b_6286f237-d319-4e06-b9dc-ce90ed493b77/kube-rbac-proxy/0.log"
Jul 14 20:39:54.566192 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:54.566165    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lxh5b_6286f237-d319-4e06-b9dc-ce90ed493b77/init-textfile/0.log"
Jul 14 20:39:56.511271 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.511235    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"]
Jul 14 20:39:56.517585 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.517554    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.530103 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.530072    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"]
Jul 14 20:39:56.573757 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.573711    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-podres\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.573969 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.573799    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-lib-modules\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.573969 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.573834    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpr4z\" (UniqueName: \"kubernetes.io/projected/17a44223-ef66-497e-a5d6-ac9880356270-kube-api-access-qpr4z\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.573969 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.573909    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-proc\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.573969 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.573936    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-sys\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.674650 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.674601    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-lib-modules\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.674949 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.674916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpr4z\" (UniqueName: \"kubernetes.io/projected/17a44223-ef66-497e-a5d6-ac9880356270-kube-api-access-qpr4z\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.675148 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.675134    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-proc\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.675273 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.675260    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-sys\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.675388 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.675355    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-lib-modules\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.675543 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.675525    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-podres\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.675616 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.675490    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-proc\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.675678 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.675612    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-sys\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.675678 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.675392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/17a44223-ef66-497e-a5d6-ac9880356270-podres\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.687119 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.687084    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpr4z\" (UniqueName: \"kubernetes.io/projected/17a44223-ef66-497e-a5d6-ac9880356270-kube-api-access-qpr4z\") pod \"perf-node-gather-daemonset-zr4cb\" (UID: \"17a44223-ef66-497e-a5d6-ac9880356270\") " pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:56.835108 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:56.835022    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:57.032029 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:57.031995    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"]
Jul 14 20:39:57.522383 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:57.522346    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb" event={"ID":"17a44223-ef66-497e-a5d6-ac9880356270","Type":"ContainerStarted","Data":"e32b3da51ca845666ff7dd7e34a755a7e18a618b660f2d6a024b4a7a912ca59f"}
Jul 14 20:39:57.522947 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:57.522410    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb" event={"ID":"17a44223-ef66-497e-a5d6-ac9880356270","Type":"ContainerStarted","Data":"354da4917ca5afe26b03a51c13215d395d8618054f8e8983f88559b8c28c2c7e"}
Jul 14 20:39:57.522947 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:57.522454    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:39:57.546651 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:57.546589    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb" podStartSLOduration=1.546553657 podStartE2EDuration="1.546553657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:39:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:39:57.543408556 +0000 UTC m=+2891.677384637" watchObservedRunningTime="2026-07-14 20:39:57.546553657 +0000 UTC m=+2891.680529737"
Jul 14 20:39:59.487344 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:59.487315    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5x95s_8331d2d1-30c1-41d2-b28c-60d91153001c/dns/0.log"
Jul 14 20:39:59.516923 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:59.516897    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5x95s_8331d2d1-30c1-41d2-b28c-60d91153001c/kube-rbac-proxy/0.log"
Jul 14 20:39:59.708332 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:39:59.708307    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mhgfv_29243480-09bb-4c97-9d5a-4a2d4623c3a9/dns-node-resolver/0.log"
Jul 14 20:40:00.314259 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:00.314227    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5pd6v_8c0fca7e-9658-43b2-8208-4edce8612b34/node-ca/0.log"
Jul 14 20:40:01.650641 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:01.650614    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df779c5f-hd2qp_3409785f-0f87-4bad-aa10-95e4167084f7/kube-auth-proxy/0.log"
Jul 14 20:40:01.780282 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:01.780247    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xghbs_42c60b58-2d2c-42f8-a110-92bb83b69f75/payload-pre-processing/0.log"
Jul 14 20:40:01.836922 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:01.836893    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79969f9494-rw7n6_7f80533b-d0ec-4684-9a75-2dc53eae9b4d/router/0.log"
Jul 14 20:40:02.557098 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:02.557069    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-59msp_5475f6af-72c5-4ef5-8dde-4e5cc5840a9f/serve-healthcheck-canary/0.log"
Jul 14 20:40:03.127846 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:03.127821    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6vqc4_e6a7866b-ab51-4474-a131-cb252860f008/kube-rbac-proxy/0.log"
Jul 14 20:40:03.153697 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:03.153670    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6vqc4_e6a7866b-ab51-4474-a131-cb252860f008/exporter/0.log"
Jul 14 20:40:03.178248 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:03.178216    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6vqc4_e6a7866b-ab51-4474-a131-cb252860f008/extractor/0.log"
Jul 14 20:40:03.540318 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:03.540293    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6mzxq/perf-node-gather-daemonset-zr4cb"
Jul 14 20:40:06.139458 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:06.139369    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-2rsr6_14f05a4f-2459-4fdd-a341-c6ac0594454e/manager/0.log"
Jul 14 20:40:06.164755 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:06.164721    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786799b55c-2rsr6_14f05a4f-2459-4fdd-a341-c6ac0594454e/copy-manifests/0.log"
Jul 14 20:40:07.500259 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:07.500202    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df779c5f-hd2qp_3409785f-0f87-4bad-aa10-95e4167084f7/kube-auth-proxy/0.log"
Jul 14 20:40:07.594434 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:07.594401    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fb95d5d68-m52l5_1bb4d04f-a3a0-40e6-823e-edb6c8a9669f/manager/0.log"
Jul 14 20:40:07.611361 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:07.611256    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xghbs_42c60b58-2d2c-42f8-a110-92bb83b69f75/payload-pre-processing/0.log"
Jul 14 20:40:07.653087 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:07.653034    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79969f9494-rw7n6_7f80533b-d0ec-4684-9a75-2dc53eae9b4d/router/0.log"
Jul 14 20:40:09.120757 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:09.120729    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59df779c5f-hd2qp_3409785f-0f87-4bad-aa10-95e4167084f7/kube-auth-proxy/0.log"
Jul 14 20:40:09.234077 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:09.234048    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-xghbs_42c60b58-2d2c-42f8-a110-92bb83b69f75/payload-pre-processing/0.log"
Jul 14 20:40:09.271714 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:09.271682    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79969f9494-rw7n6_7f80533b-d0ec-4684-9a75-2dc53eae9b4d/router/0.log"
Jul 14 20:40:12.721221 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:12.721150    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-9pvmr_4ea1791d-9b0a-4acb-92bb-78875202f3a9/migrator/0.log"
Jul 14 20:40:12.742180 ip-10-0-142-56 kubenswrapper[2584]: I0714 20:40:12.742149    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-9pvmr_4ea1791d-9b0a-4acb-92bb-78875202f3a9/graceful-termination/0.log"