Jul 09 13:27:23.335677 ip-10-0-134-240 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 13:27:23.335690 ip-10-0-134-240 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 13:27:23.335701 ip-10-0-134-240 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 13:27:23.336018 ip-10-0-134-240 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 13:27:33.337886 ip-10-0-134-240 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 13:27:33.337902 ip-10-0-134-240 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dac66bfa8e564c9ca1ffc87e4757e659 --
Jul 09 13:29:11.996509 ip-10-0-134-240 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 13:29:12.407325 ip-10-0-134-240 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 13:29:12.407325 ip-10-0-134-240 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 13:29:12.407325 ip-10-0-134-240 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 13:29:12.407325 ip-10-0-134-240 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 13:29:12.407325 ip-10-0-134-240 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 13:29:12.408366 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.408284    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 13:29:12.412797 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412781    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:12.412797 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412797    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412800    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412803    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412807    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412810    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412812    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412815    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412818    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412820    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412823    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412826    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412829    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412835    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412838    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412840    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412843    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412846    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412848    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412852    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412855    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:12.412863 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412857    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412859    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412862    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412886    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412891    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412894    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412897    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412900    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412903    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412905    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412908    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412911    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412913    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412916    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412919    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412921    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412924    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412927    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412929    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412932    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:12.413346 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412935    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412937    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412940    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412942    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412946    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412949    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412952    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412955    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412957    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412960    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412962    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412965    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412967    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412969    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412973    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412976    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412978    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412981    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412983    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412986    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:12.413845 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412989    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412991    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412994    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412996    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.412998    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413001    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413003    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413006    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413008    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413013    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413017    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413020    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413023    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413026    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413028    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413031    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413034    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413036    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413039    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413042    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:12.414351 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413045    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413047    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413050    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413054    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413057    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413060    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413064    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413067    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413069    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413072    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413074    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413077    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413079    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413082    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413085    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413087    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413090    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413092    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413847    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:12.415103 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413855    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413858    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413861    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413866    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413868    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413872    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413874    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413878    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413882    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413886    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413888    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413892    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413895    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413898    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413901    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413904    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413906    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413909    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413911    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:12.415707 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413915    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413917    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413920    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413923    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413926    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413929    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413931    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413934    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413936    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413939    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413941    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413944    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413946    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413949    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413951    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413954    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413956    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413959    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413962    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413964    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:12.416212 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413967    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413969    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413972    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413974    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413977    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413980    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413982    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413986    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413988    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413991    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413993    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413996    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.413999    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414001    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414004    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414006    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414009    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414011    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414014    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:12.416754 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414016    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414019    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414021    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414024    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414027    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414029    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414032    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414035    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414037    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414040    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414042    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414045    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414047    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414050    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414052    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414055    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414057    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414059    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414062    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414065    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:12.417206 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414068    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414071    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414073    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414076    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414078    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414081    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414083    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414086    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414088    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414091    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414093    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414097    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414100    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414103    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414106    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414110    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414114    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414118    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414120    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.414123    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:12.417716 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415324    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415337    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415342    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415352    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415358    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415370    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415375    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415379    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415384    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415388    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415397    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415403    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415407    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415411    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415414    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415417    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415420    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415424    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415426    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:12.418194 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415446    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415468    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415554    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415558    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415561    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415563    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415566    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415569    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415572    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415574    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415577    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415580    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415583    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415586    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415589    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415591    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415594    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415596    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415599    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415602    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:12.418669 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415604    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415607    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415609    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415612    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415614    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415617    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415621    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415625    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415627    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415630    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415633    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415635    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415638    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415641    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415644    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415646    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415649    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415651    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415654    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415656    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:12.419144 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415659    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415662    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415664    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415667    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415672    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415675    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415678    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415680    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415685    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415689    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415692    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415695    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415699    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415702    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415704    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415707    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415709    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415712    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415717    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:12.419631 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415720    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415722    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415725    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415728    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415731    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415733    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415736    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415738    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415741    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415743    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415746    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415748    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415752    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415755    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415758    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415762    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415765    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415768    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415771    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415774    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:12.420080 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.415776    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415848    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415855    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415861    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415865    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415870    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415873    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415877    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415881    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415884    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415887    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415891    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415894    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415897    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415900    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415902    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415905    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415908    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415911    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415915    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415918    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415921    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415924    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415927    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 13:29:12.420558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415930    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415933    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415936    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415939    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415942    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415946    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415948    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415952    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415954    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415958    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415961    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415964    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415966    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415969    2583 flags.go:64] FLAG: --enable-server="true"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415972    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415977    2583 flags.go:64] FLAG: --event-burst="100"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415979    2583 flags.go:64] FLAG: --event-qps="50"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415982    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415985    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415988    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415992    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415995    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.415998    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416001    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416004    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 13:29:12.421153 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416007    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416009    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416013    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416016    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416019    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416022    2583 flags.go:64] FLAG: --feature-gates=""
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416026    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416028    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416031    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416034    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416038    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416041    2583 flags.go:64] FLAG: --help="false"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416043    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-134-240.ec2.internal"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416046    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416049    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416052    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416055    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416058    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416061    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416064    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416067    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416070    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416072    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416075    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 13:29:12.421809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416078    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416081    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416084    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416087    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416091    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416094    2583 flags.go:64] FLAG: --lock-file=""
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416096    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416099    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416102    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416107    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416110    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416113    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416116    2583 flags.go:64] FLAG: --logging-format="text"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416118    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416122    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416124    2583 flags.go:64] FLAG: --manifest-url=""
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416127    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416131    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416134    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416138    2583 flags.go:64] FLAG: --max-pods="110"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416141    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416144    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416147    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416150    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416152    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 13:29:12.422679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416155    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416158    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416166    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416168    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416171    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416174    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416177    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416183    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416186    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416188    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416191    2583 flags.go:64] FLAG: --port="10250"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416196    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416198    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05cd52b439d6d2a2c"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416201    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416204    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416207    2583 flags.go:64] FLAG: --register-node="true"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416210    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416213    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416216    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416220    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416223    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416227    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416230    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416232    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416235    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 13:29:12.423752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416238    2583 flags.go:64] FLAG: --runonce="false"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416240    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416258    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416261    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416264    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416267    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416270    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416273    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416276    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416279    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416281    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416284    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416287    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416290    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416293    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416295    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416301    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416305    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416310    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416313    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416316    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416319    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416322    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416325    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416328    2583 flags.go:64] FLAG: --v="2"
Jul 09 13:29:12.424816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416332    2583 flags.go:64] FLAG: --version="false"
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416335    2583 flags.go:64] FLAG: --vmodule=""
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416340    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416343    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416452    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416457    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416460    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416463    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416467    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416471    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416475    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416478    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416481    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416484    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416486    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416489    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416491    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416494    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416496    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416499    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:12.425853 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416502    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416504    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416507    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416509    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416513    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416517    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416520    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416523    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416525    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416528    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416530    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416533    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416535    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416538    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416540    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416543    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416546    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416548    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416551    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416553    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:12.426510 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416556    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416559    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416561    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416564    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416566    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416569    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416571    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416574    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416577    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416579    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416581    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416584    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416586    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416590    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416594    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416596    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416601    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416607    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416610    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:12.427397 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416613    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416616    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416618    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416621    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416624    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416626    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416629    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416632    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416634    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416637    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416640    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416642    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416645    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416647    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416650    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416652    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416655    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416657    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416660    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416662    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:12.427999 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416665    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416667    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416670    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416672    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416675    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416677    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416679    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416682    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416684    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416688    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416693    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416695    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416697    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416700    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416703    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416705    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416708    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416710    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416713    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416716    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:12.428637 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416718    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416721    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416724    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.416726    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.416734    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.424206    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.424224    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.424267    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.424282    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424365    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424375    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424380    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424385    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424389    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424393    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:12.429148 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424398    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424402    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424406    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424410    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424415    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424420    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424424    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424428    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424432    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424437    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424441    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424445    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424449    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424454    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424460    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424465    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424469    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424474    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424478    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424483    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:12.429558 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424487    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424491    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424496    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424502    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424506    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424511    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424515    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424519    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424524    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424528    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424532    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424537    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424541    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424545    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424549    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424553    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424557    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424562    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424566    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424571    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:12.430092 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424575    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424579    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424583    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424587    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424591    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424596    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424599    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424604    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424607    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424612    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424616    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424621    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424625    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424632    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424637    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424642    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424649    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424654    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424658    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:12.430613 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424663    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424668    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424672    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424676    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424680    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424684    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424688    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424692    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424697    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424701    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424705    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424710    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424714    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424718    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424722    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424727    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424730    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424734    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424739    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424743    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:12.431102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424747    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424751    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424755    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424760    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424764    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424771    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424777    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424782    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424788    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424792    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424798    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424803    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424808    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.424812    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:12.431618 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.424820    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425006    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425015    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425020    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425025    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425029    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425034    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425038    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425042    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425047    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425050    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425055    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425059    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425066    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425072    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425077    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425081    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425085    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425090    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 13:29:12.432011 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425094    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425098    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425102    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425107    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425111    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425115    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425120    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425124    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425131    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425135    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425141    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425145    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425149    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425153    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425158    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425162    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425166    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425170    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425174    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425178    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 13:29:12.432803 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425182    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425186    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425191    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425195    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425199    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425203    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425208    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425212    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425216    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425220    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425224    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425229    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425233    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425237    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425241    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425266    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425270    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425275    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425279    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425283    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 13:29:12.433553 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425289    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425293    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425297    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425302    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425306    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425310    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425321    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425325    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425330    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425334    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425338    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425341    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425345    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425349    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425353    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425357    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425361    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425366    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425369    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 13:29:12.434061 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425373    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425378    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425381    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425385    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425389    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425393    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425397    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425401    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425406    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425411    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425415    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425420    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425424    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425428    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425432    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425438    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425444    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425449    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425453    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425458    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 13:29:12.434532 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425462    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 13:29:12.435264 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:12.425466    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 13:29:12.435264 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.425473    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 13:29:12.435264 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.425633    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 13:29:12.435264 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.428276    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 13:29:12.435264 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.429722    2583 server.go:1019] "Starting client certificate rotation"
Jul 09 13:29:12.435264 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.429824    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 13:29:12.435264 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.429853    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 13:29:12.435264 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.432574    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 13:29:12.435954 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.435937    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 13:29:12.448031 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.448015    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 09 13:29:12.449964 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.449950    2583 log.go:25] "Validated CRI v1 image API"
Jul 09 13:29:12.451604 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.451583    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 13:29:12.454443 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.454419    2583 fs.go:135] Filesystem UUIDs: map[240d7d46-0d84-4a6a-961f-779f7807ffba:/dev/nvme0n1p4 5972eb25-1fb7-4f1b-89bd-1d46a4f28560:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 09 13:29:12.454516 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.454444    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 13:29:12.458592 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.458568    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 13:29:12.460704 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.460603    2583 manager.go:216] Machine: {Timestamp:2026-07-09 13:29:12.459242233 +0000 UTC m=+0.344272793 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100266 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d7ebec0fefa64e3693d4a1ca82427 SystemUUID:ec2d7ebe-c0fe-fa64-e369-3d4a1ca82427 BootID:dac66bfa-8e56-4c9c-a1ff-c87e4757e659 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0f:34:bc:bb:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0f:34:bc:bb:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:59:20:44:11:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 13:29:12.460704 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.460700    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 13:29:12.460805 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.460774    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 13:29:12.464263 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.464228    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 13:29:12.464421 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.464267    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 13:29:12.464955 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.464945    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 13:29:12.464984 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.464958    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 13:29:12.464984 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.464966    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 13:29:12.465714 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.465703    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 13:29:12.466954 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.466945    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 13:29:12.470037 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.470026    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 13:29:12.470183 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.470174    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 13:29:12.470218 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.470203    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 13:29:12.470218 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.470213    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 13:29:12.470289 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.470227    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 13:29:12.470289 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.470236    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 09 13:29:12.470289 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.470256    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 13:29:12.470607 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.470596    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 13:29:12.470641 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.470614    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 13:29:12.473322 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.473301    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 13:29:12.475104 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.475091    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 13:29:12.475161 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.475121    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 13:29:12.476224 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476212    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 13:29:12.476285 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476227    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 13:29:12.476285 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476234    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 13:29:12.476285 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476239    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 13:29:12.476285 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476263    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 13:29:12.476285 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476269    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 13:29:12.476285 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476278    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 13:29:12.476469 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476290    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 13:29:12.476469 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476298    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 13:29:12.476469 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476304    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 13:29:12.476469 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476312    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 13:29:12.476469 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.476318    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 13:29:12.477855 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.477841    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 13:29:12.477890 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.477856    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 13:29:12.481111 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.481097    2583 server.go:1268] "Started kubelet"
Jul 09 13:29:12.481276 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.481237    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 13:29:12.481442 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.481206    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 13:29:12.481580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.481557    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 13:29:12.481905 ip-10-0-134-240 systemd[1]: Started Kubernetes Kubelet.
Jul 09 13:29:12.482881 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.482746    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 13:29:12.483220 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.483177    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 13:29:12.483319 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.483229    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 13:29:12.483432 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.483407    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 13:29:12.483769 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.483758    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 13:29:12.488292 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.488270    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 13:29:12.490284 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.489497    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-240.ec2.internal.18c0a229b6b0217c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-240.ec2.internal,UID:ip-10-0-134-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-240.ec2.internal,},FirstTimestamp:2026-07-09 13:29:12.481071484 +0000 UTC m=+0.366102043,LastTimestamp:2026-07-09 13:29:12.481071484 +0000 UTC m=+0.366102043,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-240.ec2.internal,}"
Jul 09 13:29:12.491722 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.491696    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 13:29:12.491722 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.491697    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 13:29:12.492394 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.492376    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:12.492482 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492449    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 13:29:12.492536 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492514    2583 factory.go:55] Registering systemd factory
Jul 09 13:29:12.492536 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492529    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 09 13:29:12.492638 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492607    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 13:29:12.492638 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492625    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 13:29:12.492734 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492714    2583 factory.go:153] Registering CRI-O factory
Jul 09 13:29:12.492734 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492726    2583 factory.go:223] Registration of the crio container factory successfully
Jul 09 13:29:12.492823 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492736    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 13:29:12.492823 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492748    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 13:29:12.492823 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492793    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 13:29:12.492823 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492817    2583 factory.go:103] Registering Raw factory
Jul 09 13:29:12.492989 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.492832    2583 manager.go:1196] Started watching for new ooms in manager
Jul 09 13:29:12.493346 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.493332    2583 manager.go:349] Starting recovery of all containers
Jul 09 13:29:12.500371 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.500291    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 13:29:12.500450 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.500435    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 13:29:12.501091 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.501053    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 13:29:12.504678 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.504664    2583 manager.go:354] Recovery completed
Jul 09 13:29:12.508560 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.508548    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:12.512098 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.511978    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:12.512174 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.512118    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:12.512174 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.512134    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:12.512695 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.512680    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 13:29:12.512695 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.512693    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 13:29:12.512821 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.512707    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 13:29:12.512821 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.512686    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:12.513531 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.513514    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:12.513612 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.513541    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:12.513612 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.513550    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:12.513783 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.513768    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wxrlf"
Jul 09 13:29:12.513946 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.513933    2583 policy_none.go:49] "None policy: Start"
Jul 09 13:29:12.513997 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.513953    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 13:29:12.513997 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.513967    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 13:29:12.514877 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.514805    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-240.ec2.internal.18c0a229b8899374  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-240.ec2.internal,UID:ip-10-0-134-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-240.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-240.ec2.internal,},FirstTimestamp:2026-07-09 13:29:12.512099188 +0000 UTC m=+0.397129751,LastTimestamp:2026-07-09 13:29:12.512099188 +0000 UTC m=+0.397129751,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-240.ec2.internal,}"
Jul 09 13:29:12.515135 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.515124    2583 policy_none.go:47] "Start"
Jul 09 13:29:12.520904 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.520889    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wxrlf"
Jul 09 13:29:12.522424 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.522363    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-240.ec2.internal.18c0a229b889fc4a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-240.ec2.internal,UID:ip-10-0-134-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-240.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-240.ec2.internal,},FirstTimestamp:2026-07-09 13:29:12.512126026 +0000 UTC m=+0.397156589,LastTimestamp:2026-07-09 13:29:12.512126026 +0000 UTC m=+0.397156589,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-240.ec2.internal,}"
Jul 09 13:29:12.547818 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.547804    2583 manager.go:337] "Starting Device Plugin manager"
Jul 09 13:29:12.558739 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.547832    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 13:29:12.558739 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.547842    2583 server.go:87] "Starting device plugin registration server"
Jul 09 13:29:12.558739 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.548096    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 13:29:12.558739 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.548108    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 13:29:12.558739 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.548220    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 13:29:12.558739 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.548314    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 13:29:12.558739 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:12.548324    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 13:29:12.558739 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.548859    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 13:29:12.558739 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:12.548898    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:14.309668 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.309645    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 13:29:14.309736 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.309683    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 13:29:14.309736 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.309701    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 13:29:14.309823 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:14.309730    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 13:29:14.311931 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.311910    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:14.321335 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.321322    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:14.322131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.322117    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:14.322187 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.322148    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:14.322187 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.322158    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:14.322187 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.322180    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.332296 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.332250    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.332296 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:14.332270    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-240.ec2.internal\": node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:14.357185 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:14.357166    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:14.410023 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.410002    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal"]
Jul 09 13:29:14.410085 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.410076    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:14.410886 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.410873    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:14.410952 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.410898    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:14.410952 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.410908    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:14.412238 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.412227    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:14.412362 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.412349    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.412401 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.412376    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:14.412940 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.412924    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:14.412995 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.412951    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:14.412995 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.412965    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:14.413077 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.413020    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:14.413077 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.413048    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:14.413077 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.413060    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:14.414168 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.414153    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.414281 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.414175    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:14.414817 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.414804    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:14.414902 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.414833    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:14.414902 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.414847    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:14.444849 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:14.444825    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-240.ec2.internal\" not found" node="ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.449142 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:14.449125    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-240.ec2.internal\" not found" node="ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.458040 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:14.458024    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:14.467702 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.467677    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ed27b0a868858a938334dd603a1333d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"3ed27b0a868858a938334dd603a1333d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.467785 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.467705    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ed27b0a868858a938334dd603a1333d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"3ed27b0a868858a938334dd603a1333d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.467785 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.467727    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c553ed147be170fceaedd3bc0f04636c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-240.ec2.internal\" (UID: \"c553ed147be170fceaedd3bc0f04636c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.558766 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:14.558740    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:14.568083 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.568068    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ed27b0a868858a938334dd603a1333d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"3ed27b0a868858a938334dd603a1333d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.568158 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.568091    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ed27b0a868858a938334dd603a1333d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"3ed27b0a868858a938334dd603a1333d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.568158 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.568107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c553ed147be170fceaedd3bc0f04636c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-240.ec2.internal\" (UID: \"c553ed147be170fceaedd3bc0f04636c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.568158 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.568145    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c553ed147be170fceaedd3bc0f04636c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-240.ec2.internal\" (UID: \"c553ed147be170fceaedd3bc0f04636c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.568276 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.568164    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ed27b0a868858a938334dd603a1333d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"3ed27b0a868858a938334dd603a1333d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.568276 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.568184    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ed27b0a868858a938334dd603a1333d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"3ed27b0a868858a938334dd603a1333d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.659512 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:14.659460    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:14.747949 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.747931    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.752774 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:14.752756    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:14.760273 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:14.760259    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:14.860797 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:14.860772    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:14.961315 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:14.961237    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:15.061938 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:15.061905    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:15.093771 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.093749    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:15.101815 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.101795    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 13:29:15.101916 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.101900    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 13:29:15.101959 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.101939    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 13:29:15.162419 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:15.162392    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:15.196296 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.196264    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 13:24:14 +0000 UTC" deadline="2028-03-26 13:11:28.039535754 +0000 UTC"
Jul 09 13:29:15.196389 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.196303    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15023h42m12.843235874s"
Jul 09 13:29:15.251543 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.251491    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 13:29:15.253096 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.253081    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 13:29:15.253183 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.253111    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 13:29:15.253183 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.253121    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID"
Jul 09 13:29:15.262989 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:15.262970    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:15.343520 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:15.343480    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed27b0a868858a938334dd603a1333d.slice/crio-7c430960d0cec14366181daea6718ea1549114153ec9e76c4710290b269329aa WatchSource:0}: Error finding container 7c430960d0cec14366181daea6718ea1549114153ec9e76c4710290b269329aa: Status 404 returned error can't find the container with id 7c430960d0cec14366181daea6718ea1549114153ec9e76c4710290b269329aa
Jul 09 13:29:15.345333 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:15.345310    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc553ed147be170fceaedd3bc0f04636c.slice/crio-5ed1d96624a8baaf50d45c73c8cc67f00206cd2c2e88da1a031e561eb372e0ef WatchSource:0}: Error finding container 5ed1d96624a8baaf50d45c73c8cc67f00206cd2c2e88da1a031e561eb372e0ef: Status 404 returned error can't find the container with id 5ed1d96624a8baaf50d45c73c8cc67f00206cd2c2e88da1a031e561eb372e0ef
Jul 09 13:29:15.349011 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.348996    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 13:29:15.363088 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:15.363070    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:15.463538 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:15.463516    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found"
Jul 09 13:29:15.500543 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.500521    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:15.503259 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.503218    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:15.566226 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.566208    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:15.581075 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.581058    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 13:29:15.582092 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.582081    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal"
Jul 09 13:29:15.589269 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:15.589257    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 13:29:16.144465 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.144430    2583 apiserver.go:52] "Watching apiserver"
Jul 09 13:29:16.156965 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.156939    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 13:29:16.158068 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.158037    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-88cjg","openshift-ovn-kubernetes/ovnkube-node-t8stv","kube-system/global-pull-secret-syncer-p74l4","kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal","openshift-dns/node-resolver-q57s8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal","openshift-multus/multus-8dls8","openshift-multus/multus-additional-cni-plugins-7m769","openshift-network-diagnostics/network-check-target-n2fg9","kube-system/konnectivity-agent-fgk2q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq","openshift-cluster-node-tuning-operator/tuned-dmq4v","openshift-image-registry/node-ca-9ww7d","openshift-multus/network-metrics-daemon-c9kpx"]
Jul 09 13:29:16.159513 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.159485    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:16.160695 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.160674    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9ww7d"
Jul 09 13:29:16.161810 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.161793    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:16.161916 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.161874    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:16.162488 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.162440    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 13:29:16.162610 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.162488    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v57kt\""
Jul 09 13:29:16.162610 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.162488    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 13:29:16.163102 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.163084    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:16.163178 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.163156    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:16.163503 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.163478    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 13:29:16.163831 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.163811    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 13:29:16.164683 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.164161    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5svrk\""
Jul 09 13:29:16.164683 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.164225    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 13:29:16.164986 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.164784    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q57s8"
Jul 09 13:29:16.165605 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.165586    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 13:29:16.166203 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.166186    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.167405 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.167346    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:16.167496 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.167403    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:16.167591 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.167497    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qjv59\""
Jul 09 13:29:16.167591 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.167498    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 13:29:16.167693 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.167514    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 13:29:16.168618 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.168582    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.169208 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.169189    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 13:29:16.169427 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.169407    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 13:29:16.169610 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.169591    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 13:29:16.169699 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.169641    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m77sp\""
Jul 09 13:29:16.169751 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.169590    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 13:29:16.170278 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.170237    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 13:29:16.170495 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.170479    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.171379 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.171073    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 13:29:16.171379 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.171128    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88cjg"
Jul 09 13:29:16.171735 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.171715    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xlfqp\""
Jul 09 13:29:16.173208 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.172786    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.175382 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.174086    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.175382 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.174963    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.175830    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d8h2x\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.176365    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.176546    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.176836    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177097    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177124    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nxw6r\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177222    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177394    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177490    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177496    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c64940d7-a293-4b8a-97fe-ddc2be44d36b-serviceca\") pod \"node-ca-9ww7d\" (UID: \"c64940d7-a293-4b8a-97fe-ddc2be44d36b\") " pod="openshift-image-registry/node-ca-9ww7d"
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177702    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177734    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt9wb\" (UniqueName: \"kubernetes.io/projected/1e955a6c-b988-42c5-be21-74f5a9ea2e69-kube-api-access-zt9wb\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177863    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01-agent-certs\") pod \"konnectivity-agent-fgk2q\" (UID: \"c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01\") " pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177902    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkbq8\" (UniqueName: \"kubernetes.io/projected/c64940d7-a293-4b8a-97fe-ddc2be44d36b-kube-api-access-kkbq8\") pod \"node-ca-9ww7d\" (UID: \"c64940d7-a293-4b8a-97fe-ddc2be44d36b\") " pod="openshift-image-registry/node-ca-9ww7d"
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b444150-17be-4f6b-99a1-7dd33396c270-hosts-file\") pod \"node-resolver-q57s8\" (UID: \"3b444150-17be-4f6b-99a1-7dd33396c270\") " pod="openshift-dns/node-resolver-q57s8"
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.177972    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwxcx\" (UniqueName: \"kubernetes.io/projected/3b444150-17be-4f6b-99a1-7dd33396c270-kube-api-access-qwxcx\") pod \"node-resolver-q57s8\" (UID: \"3b444150-17be-4f6b-99a1-7dd33396c270\") " pod="openshift-dns/node-resolver-q57s8"
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-cnibin\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178018    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-92tr2\""
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178037    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-os-release\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.178797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178076    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e955a6c-b988-42c5-be21-74f5a9ea2e69-cni-binary-copy\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178103    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e955a6c-b988-42c5-be21-74f5a9ea2e69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c64940d7-a293-4b8a-97fe-ddc2be44d36b-host\") pod \"node-ca-9ww7d\" (UID: \"c64940d7-a293-4b8a-97fe-ddc2be44d36b\") " pod="openshift-image-registry/node-ca-9ww7d"
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b444150-17be-4f6b-99a1-7dd33396c270-tmp-dir\") pod \"node-resolver-q57s8\" (UID: \"3b444150-17be-4f6b-99a1-7dd33396c270\") " pod="openshift-dns/node-resolver-q57s8"
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-system-cni-dir\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178301    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e955a6c-b988-42c5-be21-74f5a9ea2e69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178340    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa325c9d-9516-4389-9b8c-b2727a6724b7-kubelet-config\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178377    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa325c9d-9516-4389-9b8c-b2727a6724b7-dbus\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178411    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjjm6\" (UniqueName: \"kubernetes.io/projected/64ff7bd1-e900-488f-89e0-a5a8b096751f-kube-api-access-bjjm6\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.178531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01-konnectivity-ca\") pod \"konnectivity-agent-fgk2q\" (UID: \"c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01\") " pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.179778    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.179814    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.179956    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 13:29:16.180131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.180054    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nz8br\""
Jul 09 13:29:16.182756 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.182539    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 13:29:16.182869 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.182756    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 13:29:16.201546 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.201502    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f82fk"
Jul 09 13:29:16.210340 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.210138    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f82fk"
Jul 09 13:29:16.259632 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.259606    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:16.266482 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.266464    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 13:29:16.278991 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.278964    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjjm6\" (UniqueName: \"kubernetes.io/projected/64ff7bd1-e900-488f-89e0-a5a8b096751f-kube-api-access-bjjm6\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:16.279111 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c64940d7-a293-4b8a-97fe-ddc2be44d36b-serviceca\") pod \"node-ca-9ww7d\" (UID: \"c64940d7-a293-4b8a-97fe-ddc2be44d36b\") " pod="openshift-image-registry/node-ca-9ww7d"
Jul 09 13:29:16.279111 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279034    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n6st\" (UniqueName: \"kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st\") pod \"network-check-target-n2fg9\" (UID: \"c68fccbd-cc3e-48f8-a091-1670b97da9ea\") " pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:16.279111 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279060    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-multus-socket-dir-parent\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.279268 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279172    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-tuned\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.279268 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279200    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-ovnkube-script-lib\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.279268 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279238    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01-agent-certs\") pod \"konnectivity-agent-fgk2q\" (UID: \"c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01\") " pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:16.279268 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-system-cni-dir\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.279478 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279300    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-host\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.279478 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-log-socket\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.279478 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-os-release\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.279478 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279414    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e955a6c-b988-42c5-be21-74f5a9ea2e69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.279652 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c64940d7-a293-4b8a-97fe-ddc2be44d36b-host\") pod \"node-ca-9ww7d\" (UID: \"c64940d7-a293-4b8a-97fe-ddc2be44d36b\") " pod="openshift-image-registry/node-ca-9ww7d"
Jul 09 13:29:16.279652 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-system-cni-dir\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.279652 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa325c9d-9516-4389-9b8c-b2727a6724b7-kubelet-config\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:16.279652 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279552    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c64940d7-a293-4b8a-97fe-ddc2be44d36b-serviceca\") pod \"node-ca-9ww7d\" (UID: \"c64940d7-a293-4b8a-97fe-ddc2be44d36b\") " pod="openshift-image-registry/node-ca-9ww7d"
Jul 09 13:29:16.279652 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279560    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67t97\" (UniqueName: \"kubernetes.io/projected/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-kube-api-access-67t97\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.279652 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279592    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.279652 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279612    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 13:29:16.279652 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279634    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c64940d7-a293-4b8a-97fe-ddc2be44d36b-host\") pod \"node-ca-9ww7d\" (UID: \"c64940d7-a293-4b8a-97fe-ddc2be44d36b\") " pod="openshift-image-registry/node-ca-9ww7d"
Jul 09 13:29:16.279971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279713    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-sysctl-d\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.279971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279738    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-kubelet\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.279971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279738    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa325c9d-9516-4389-9b8c-b2727a6724b7-kubelet-config\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:16.279971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279761    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-os-release\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.279971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279780    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-run-ovn\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.279971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279793    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-system-cni-dir\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.279971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.279971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279863    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt9wb\" (UniqueName: \"kubernetes.io/projected/1e955a6c-b988-42c5-be21-74f5a9ea2e69-kube-api-access-zt9wb\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.279971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/738268ca-40be-4311-b212-0854eb8d6bfc-cni-binary-copy\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.279971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279932    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-var-lib-kubelet\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.279971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279962    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-ovnkube-config\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.279980    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280037    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwxcx\" (UniqueName: \"kubernetes.io/projected/3b444150-17be-4f6b-99a1-7dd33396c270-kube-api-access-qwxcx\") pod \"node-resolver-q57s8\" (UID: \"3b444150-17be-4f6b-99a1-7dd33396c270\") " pod="openshift-dns/node-resolver-q57s8"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280075    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-cnibin\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280147    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e955a6c-b988-42c5-be21-74f5a9ea2e69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280200    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e955a6c-b988-42c5-be21-74f5a9ea2e69-cnibin\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280208    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-var-lib-cni-bin\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-lib-modules\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280264    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-run-systemd\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280303    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-cni-bin\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b444150-17be-4f6b-99a1-7dd33396c270-tmp-dir\") pod \"node-resolver-q57s8\" (UID: \"3b444150-17be-4f6b-99a1-7dd33396c270\") " pod="openshift-dns/node-resolver-q57s8"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-run-k8s-cni-cncf-io\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-multus-conf-dir\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-device-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280459    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-systemd\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4hsz\" (UniqueName: \"kubernetes.io/projected/4e34f19d-74ae-4034-a3f1-9022747a8953-kube-api-access-m4hsz\") pod \"iptables-alerter-88cjg\" (UID: \"4e34f19d-74ae-4034-a3f1-9022747a8953\") " pod="openshift-network-operator/iptables-alerter-88cjg"
Jul 09 13:29:16.280541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280532    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/738268ca-40be-4311-b212-0854eb8d6bfc-multus-daemon-config\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280570    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-systemd-units\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280607    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e34f19d-74ae-4034-a3f1-9022747a8953-host-slash\") pod \"iptables-alerter-88cjg\" (UID: \"4e34f19d-74ae-4034-a3f1-9022747a8953\") " pod="openshift-network-operator/iptables-alerter-88cjg"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280624    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b444150-17be-4f6b-99a1-7dd33396c270-tmp-dir\") pod \"node-resolver-q57s8\" (UID: \"3b444150-17be-4f6b-99a1-7dd33396c270\") " pod="openshift-dns/node-resolver-q57s8"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-socket-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280666    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-sysconfig\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280702    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-kubernetes\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4e34f19d-74ae-4034-a3f1-9022747a8953-iptables-alerter-script\") pod \"iptables-alerter-88cjg\" (UID: \"4e34f19d-74ae-4034-a3f1-9022747a8953\") " pod="openshift-network-operator/iptables-alerter-88cjg"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280750    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-multus-cni-dir\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b444150-17be-4f6b-99a1-7dd33396c270-hosts-file\") pod \"node-resolver-q57s8\" (UID: \"3b444150-17be-4f6b-99a1-7dd33396c270\") " pod="openshift-dns/node-resolver-q57s8"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280822    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b444150-17be-4f6b-99a1-7dd33396c270-hosts-file\") pod \"node-resolver-q57s8\" (UID: \"3b444150-17be-4f6b-99a1-7dd33396c270\") " pod="openshift-dns/node-resolver-q57s8"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280832    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e955a6c-b988-42c5-be21-74f5a9ea2e69-cni-binary-copy\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280862    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-run-multus-certs\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280897    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4n7t\" (UniqueName: \"kubernetes.io/projected/738268ca-40be-4311-b212-0854eb8d6bfc-kube-api-access-z4n7t\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280930    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280960    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-var-lib-kubelet\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.280992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e955a6c-b988-42c5-be21-74f5a9ea2e69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.281204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa325c9d-9516-4389-9b8c-b2727a6724b7-dbus\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-run-netns\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281063    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3eb424c-82a0-4276-949c-95c3e35341bd-tmp\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4scbn\" (UniqueName: \"kubernetes.io/projected/f3eb424c-82a0-4276-949c-95c3e35341bd-kube-api-access-4scbn\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-node-log\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281174    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281191    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa325c9d-9516-4389-9b8c-b2727a6724b7-dbus\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01-konnectivity-ca\") pod \"konnectivity-agent-fgk2q\" (UID: \"c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01\") " pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-etc-kubernetes\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-sys-fs\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281268    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-sys\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281300    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-slash\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281335    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-run-openvswitch\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281366    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-cni-netd\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281365    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e955a6c-b988-42c5-be21-74f5a9ea2e69-cni-binary-copy\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281397    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-ovn-node-metrics-cert\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:16.281988 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkbq8\" (UniqueName: \"kubernetes.io/projected/c64940d7-a293-4b8a-97fe-ddc2be44d36b-kube-api-access-kkbq8\") pod \"node-ca-9ww7d\" (UID: \"c64940d7-a293-4b8a-97fe-ddc2be44d36b\") " pod="openshift-image-registry/node-ca-9ww7d"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.281543    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281592    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-registration-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.281615    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs podName:64ff7bd1-e900-488f-89e0-a5a8b096751f nodeName:}" failed. No retries permitted until 2026-07-09 13:29:16.781594331 +0000 UTC m=+2.993584727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs") pod "network-metrics-daemon-c9kpx" (UID: "64ff7bd1-e900-488f-89e0-a5a8b096751f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281649    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e955a6c-b988-42c5-be21-74f5a9ea2e69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-var-lib-openvswitch\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281791    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-run\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281849    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01-konnectivity-ca\") pod \"konnectivity-agent-fgk2q\" (UID: \"c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01\") " pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281861    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-os-release\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281887    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-etc-selinux\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-modprobe-d\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281936    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-sysctl-conf\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.281942    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.281957    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-run-netns\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.281988    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret podName:fa325c9d-9516-4389-9b8c-b2727a6724b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:16.781974274 +0000 UTC m=+2.993964672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret") pod "global-pull-secret-syncer-p74l4" (UID: "fa325c9d-9516-4389-9b8c-b2727a6724b7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:16.282689 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.282007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-298xx\" (UniqueName: \"kubernetes.io/projected/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-kube-api-access-298xx\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.283477 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.282046    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-cnibin\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.283477 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.282069    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-var-lib-cni-multus\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.283477 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.282093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-hostroot\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.283477 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.282109    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-etc-openvswitch\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.283477 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.282133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-env-overrides\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.283686 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.283571    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01-agent-certs\") pod \"konnectivity-agent-fgk2q\" (UID: \"c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01\") " pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:16.289482 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.289447    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt9wb\" (UniqueName: \"kubernetes.io/projected/1e955a6c-b988-42c5-be21-74f5a9ea2e69-kube-api-access-zt9wb\") pod \"multus-additional-cni-plugins-7m769\" (UID: \"1e955a6c-b988-42c5-be21-74f5a9ea2e69\") " pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.290024 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.289976    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjjm6\" (UniqueName: \"kubernetes.io/projected/64ff7bd1-e900-488f-89e0-a5a8b096751f-kube-api-access-bjjm6\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:16.290024 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.289990    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwxcx\" (UniqueName: \"kubernetes.io/projected/3b444150-17be-4f6b-99a1-7dd33396c270-kube-api-access-qwxcx\") pod \"node-resolver-q57s8\" (UID: \"3b444150-17be-4f6b-99a1-7dd33396c270\") " pod="openshift-dns/node-resolver-q57s8"
Jul 09 13:29:16.291940 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.291900    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkbq8\" (UniqueName: \"kubernetes.io/projected/c64940d7-a293-4b8a-97fe-ddc2be44d36b-kube-api-access-kkbq8\") pod \"node-ca-9ww7d\" (UID: \"c64940d7-a293-4b8a-97fe-ddc2be44d36b\") " pod="openshift-image-registry/node-ca-9ww7d"
Jul 09 13:29:16.314873 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.314823    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" event={"ID":"c553ed147be170fceaedd3bc0f04636c","Type":"ContainerStarted","Data":"5ed1d96624a8baaf50d45c73c8cc67f00206cd2c2e88da1a031e561eb372e0ef"}
Jul 09 13:29:16.316699 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.316669    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" event={"ID":"3ed27b0a868858a938334dd603a1333d","Type":"ContainerStarted","Data":"7c430960d0cec14366181daea6718ea1549114153ec9e76c4710290b269329aa"}
Jul 09 13:29:16.382420 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382387    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6st\" (UniqueName: \"kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st\") pod \"network-check-target-n2fg9\" (UID: \"c68fccbd-cc3e-48f8-a091-1670b97da9ea\") " pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:16.382597 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-multus-socket-dir-parent\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.382597 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-tuned\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.382597 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382518    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-multus-socket-dir-parent\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.382597 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-ovnkube-script-lib\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.382597 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-system-cni-dir\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.382844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382626    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-system-cni-dir\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.382844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382650    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-host\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.382844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-log-socket\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.382844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67t97\" (UniqueName: \"kubernetes.io/projected/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-kube-api-access-67t97\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.382844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.382844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382760    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-host\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.382844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-sysctl-d\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.382844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382782    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-log-socket\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.382844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382805    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-kubelet\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.382844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382830    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-run-ovn\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.382844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382842    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/738268ca-40be-4311-b212-0854eb8d6bfc-cni-binary-copy\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382887    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-sysctl-d\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-var-lib-kubelet\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-ovnkube-config\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382959    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-kubelet\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-var-lib-cni-bin\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382976    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-run-ovn\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-lib-modules\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382990    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-var-lib-cni-bin\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.382926    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-var-lib-kubelet\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-run-systemd\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383114    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-lib-modules\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-cni-bin\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-run-k8s-cni-cncf-io\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-multus-conf-dir\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383186    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-cni-bin\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383158    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-run-systemd\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.383262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383196    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-ovnkube-script-lib\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383206    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-device-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383237    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-run-k8s-cni-cncf-io\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383244    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-multus-conf-dir\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383245    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-systemd\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383277    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4hsz\" (UniqueName: \"kubernetes.io/projected/4e34f19d-74ae-4034-a3f1-9022747a8953-kube-api-access-m4hsz\") pod \"iptables-alerter-88cjg\" (UID: \"4e34f19d-74ae-4034-a3f1-9022747a8953\") " pod="openshift-network-operator/iptables-alerter-88cjg"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383298    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-device-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383313    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-systemd\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/738268ca-40be-4311-b212-0854eb8d6bfc-multus-daemon-config\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383368    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/738268ca-40be-4311-b212-0854eb8d6bfc-cni-binary-copy\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383393    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-systemd-units\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383419    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e34f19d-74ae-4034-a3f1-9022747a8953-host-slash\") pod \"iptables-alerter-88cjg\" (UID: \"4e34f19d-74ae-4034-a3f1-9022747a8953\") " pod="openshift-network-operator/iptables-alerter-88cjg"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-socket-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383450    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-ovnkube-config\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-sysconfig\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-kubernetes\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383520    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4e34f19d-74ae-4034-a3f1-9022747a8953-iptables-alerter-script\") pod \"iptables-alerter-88cjg\" (UID: \"4e34f19d-74ae-4034-a3f1-9022747a8953\") " pod="openshift-network-operator/iptables-alerter-88cjg"
Jul 09 13:29:16.384147 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383528    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-systemd-units\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383544    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-multus-cni-dir\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383497    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e34f19d-74ae-4034-a3f1-9022747a8953-host-slash\") pod \"iptables-alerter-88cjg\" (UID: \"4e34f19d-74ae-4034-a3f1-9022747a8953\") " pod="openshift-network-operator/iptables-alerter-88cjg"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383551    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-sysconfig\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383551    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-socket-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-run-multus-certs\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383610    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4n7t\" (UniqueName: \"kubernetes.io/projected/738268ca-40be-4311-b212-0854eb8d6bfc-kube-api-access-z4n7t\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383617    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-kubernetes\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383621    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-multus-cni-dir\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383642    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-run-multus-certs\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383657    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-var-lib-kubelet\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383676    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-run-netns\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383696    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-var-lib-kubelet\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3eb424c-82a0-4276-949c-95c3e35341bd-tmp\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4scbn\" (UniqueName: \"kubernetes.io/projected/f3eb424c-82a0-4276-949c-95c3e35341bd-kube-api-access-4scbn\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383734    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-run-netns\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.385009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-node-log\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383800    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-etc-kubernetes\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-sys-fs\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383838    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-node-log\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383843    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/738268ca-40be-4311-b212-0854eb8d6bfc-multus-daemon-config\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383847    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-sys\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383893    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-sys\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383884    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-etc-kubernetes\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383907    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-slash\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-run-openvswitch\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383956    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-run-ovn-kubernetes\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383974    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-cni-netd\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383985    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-run-openvswitch\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-ovn-node-metrics-cert\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384004    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-slash\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.383949    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-sys-fs\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384026    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-cni-netd\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.385770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384020    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4e34f19d-74ae-4034-a3f1-9022747a8953-iptables-alerter-script\") pod \"iptables-alerter-88cjg\" (UID: \"4e34f19d-74ae-4034-a3f1-9022747a8953\") " pod="openshift-network-operator/iptables-alerter-88cjg"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-registration-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-var-lib-openvswitch\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-run\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384115    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-os-release\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384136    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-registration-dir\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384142    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-var-lib-openvswitch\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-etc-selinux\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-modprobe-d\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384188    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-run\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-sysctl-conf\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384214    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-os-release\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384219    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-etc-selinux\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-run-netns\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384271    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-modprobe-d\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384303    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-host-run-netns\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384318    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-298xx\" (UniqueName: \"kubernetes.io/projected/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-kube-api-access-298xx\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.386677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384348    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-sysctl-conf\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-cnibin\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384391    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-var-lib-cni-multus\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384406    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-cnibin\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384436    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-hostroot\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384444    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-host-var-lib-cni-multus\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384480    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/738268ca-40be-4311-b212-0854eb8d6bfc-hostroot\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384463    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-etc-openvswitch\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-env-overrides\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.384605    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-etc-openvswitch\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.385027    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-env-overrides\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.385632    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f3eb424c-82a0-4276-949c-95c3e35341bd-etc-tuned\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.386614    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-ovn-node-metrics-cert\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.387518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.386697    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3eb424c-82a0-4276-949c-95c3e35341bd-tmp\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.391114 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.391095    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:16.391114 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.391116    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:16.391232 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.391126    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5n6st for pod openshift-network-diagnostics/network-check-target-n2fg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:16.391232 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.391185    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st podName:c68fccbd-cc3e-48f8-a091-1670b97da9ea nodeName:}" failed. No retries permitted until 2026-07-09 13:29:16.891167423 +0000 UTC m=+3.103157829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6st" (UniqueName: "kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st") pod "network-check-target-n2fg9" (UID: "c68fccbd-cc3e-48f8-a091-1670b97da9ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:16.394056 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.394012    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4n7t\" (UniqueName: \"kubernetes.io/projected/738268ca-40be-4311-b212-0854eb8d6bfc-kube-api-access-z4n7t\") pod \"multus-8dls8\" (UID: \"738268ca-40be-4311-b212-0854eb8d6bfc\") " pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.394854 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.394798    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67t97\" (UniqueName: \"kubernetes.io/projected/dae3e2b7-00a6-4aae-b7b7-7bb639bef016-kube-api-access-67t97\") pod \"aws-ebs-csi-driver-node-p48rq\" (UID: \"dae3e2b7-00a6-4aae-b7b7-7bb639bef016\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.395362 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.395342    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4hsz\" (UniqueName: \"kubernetes.io/projected/4e34f19d-74ae-4034-a3f1-9022747a8953-kube-api-access-m4hsz\") pod \"iptables-alerter-88cjg\" (UID: \"4e34f19d-74ae-4034-a3f1-9022747a8953\") " pod="openshift-network-operator/iptables-alerter-88cjg"
Jul 09 13:29:16.395993 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.395968    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4scbn\" (UniqueName: \"kubernetes.io/projected/f3eb424c-82a0-4276-949c-95c3e35341bd-kube-api-access-4scbn\") pod \"tuned-dmq4v\" (UID: \"f3eb424c-82a0-4276-949c-95c3e35341bd\") " pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.396256 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.396238    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-298xx\" (UniqueName: \"kubernetes.io/projected/dd348cbe-6b10-4521-9d9e-e5822e19d8c6-kube-api-access-298xx\") pod \"ovnkube-node-t8stv\" (UID: \"dd348cbe-6b10-4521-9d9e-e5822e19d8c6\") " pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.473112 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.473080    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:16.483246 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:16.483218    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1df3745_9cba_4b05_a2dc_2d5a2d2c3c01.slice/crio-dcaf4741677937a0f6615af4cb0d539c125ab612501a6884cb2c08eebcbda371 WatchSource:0}: Error finding container dcaf4741677937a0f6615af4cb0d539c125ab612501a6884cb2c08eebcbda371: Status 404 returned error can't find the container with id dcaf4741677937a0f6615af4cb0d539c125ab612501a6884cb2c08eebcbda371
Jul 09 13:29:16.484067 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.484049    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9ww7d"
Jul 09 13:29:16.493069 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.493052    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dmq4v"
Jul 09 13:29:16.493457 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:16.493433    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64940d7_a293_4b8a_97fe_ddc2be44d36b.slice/crio-ee45dd634cde6fc6c8da76d17c960be13635ce76c1e2c8e3bcac603f598341d9 WatchSource:0}: Error finding container ee45dd634cde6fc6c8da76d17c960be13635ce76c1e2c8e3bcac603f598341d9: Status 404 returned error can't find the container with id ee45dd634cde6fc6c8da76d17c960be13635ce76c1e2c8e3bcac603f598341d9
Jul 09 13:29:16.499123 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.499105    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q57s8"
Jul 09 13:29:16.501612 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:16.501588    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3eb424c_82a0_4276_949c_95c3e35341bd.slice/crio-638a84f1970df7c17b82164d23699af7d27c86061bd8373b596ea8a35a55b78f WatchSource:0}: Error finding container 638a84f1970df7c17b82164d23699af7d27c86061bd8373b596ea8a35a55b78f: Status 404 returned error can't find the container with id 638a84f1970df7c17b82164d23699af7d27c86061bd8373b596ea8a35a55b78f
Jul 09 13:29:16.507013 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.506993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7m769"
Jul 09 13:29:16.508026 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:16.508008    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b444150_17be_4f6b_99a1_7dd33396c270.slice/crio-4d5322faa05b7f58b4db237bed7740e4ed0908aacb980ec8530a40fbe5f7a256 WatchSource:0}: Error finding container 4d5322faa05b7f58b4db237bed7740e4ed0908aacb980ec8530a40fbe5f7a256: Status 404 returned error can't find the container with id 4d5322faa05b7f58b4db237bed7740e4ed0908aacb980ec8530a40fbe5f7a256
Jul 09 13:29:16.514110 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.514086    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8dls8"
Jul 09 13:29:16.514385 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:16.514364    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e955a6c_b988_42c5_be21_74f5a9ea2e69.slice/crio-46c3f075d2766e965a5ff0d6f7d7cd190ece406148156f97f82c8776426fa827 WatchSource:0}: Error finding container 46c3f075d2766e965a5ff0d6f7d7cd190ece406148156f97f82c8776426fa827: Status 404 returned error can't find the container with id 46c3f075d2766e965a5ff0d6f7d7cd190ece406148156f97f82c8776426fa827
Jul 09 13:29:16.521021 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:16.521001    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738268ca_40be_4311_b212_0854eb8d6bfc.slice/crio-77a560a00be8f31a3c65c255df57cf4d085ea495fc06fbce4580b269ecceb097 WatchSource:0}: Error finding container 77a560a00be8f31a3c65c255df57cf4d085ea495fc06fbce4580b269ecceb097: Status 404 returned error can't find the container with id 77a560a00be8f31a3c65c255df57cf4d085ea495fc06fbce4580b269ecceb097
Jul 09 13:29:16.521783 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.521765    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:16.528533 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:16.528516    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd348cbe_6b10_4521_9d9e_e5822e19d8c6.slice/crio-83b064ed0cc6703bf4956802f76d9bcfddd075b9287775c73c978338f79ca83d WatchSource:0}: Error finding container 83b064ed0cc6703bf4956802f76d9bcfddd075b9287775c73c978338f79ca83d: Status 404 returned error can't find the container with id 83b064ed0cc6703bf4956802f76d9bcfddd075b9287775c73c978338f79ca83d
Jul 09 13:29:16.529154 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.529135    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88cjg"
Jul 09 13:29:16.535979 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.535962    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq"
Jul 09 13:29:16.537467 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:16.537448    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e34f19d_74ae_4034_a3f1_9022747a8953.slice/crio-251dfcb4dc2914a7061d23fdba4d5a9c4519ce094308234f16fe29ab293f202b WatchSource:0}: Error finding container 251dfcb4dc2914a7061d23fdba4d5a9c4519ce094308234f16fe29ab293f202b: Status 404 returned error can't find the container with id 251dfcb4dc2914a7061d23fdba4d5a9c4519ce094308234f16fe29ab293f202b
Jul 09 13:29:16.543549 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:16.543524    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae3e2b7_00a6_4aae_b7b7_7bb639bef016.slice/crio-3c95faa6c9c02026188e9d837540e66ce9aef984874e6422586846d616733f26 WatchSource:0}: Error finding container 3c95faa6c9c02026188e9d837540e66ce9aef984874e6422586846d616733f26: Status 404 returned error can't find the container with id 3c95faa6c9c02026188e9d837540e66ce9aef984874e6422586846d616733f26
Jul 09 13:29:16.786602 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.786513    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:16.786602 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.786561    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:16.786804 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.786677    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:16.786804 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.786678    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:16.786804 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.786733    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret podName:fa325c9d-9516-4389-9b8c-b2727a6724b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:17.786715443 +0000 UTC m=+3.998705850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret") pod "global-pull-secret-syncer-p74l4" (UID: "fa325c9d-9516-4389-9b8c-b2727a6724b7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:16.786804 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.786749    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs podName:64ff7bd1-e900-488f-89e0-a5a8b096751f nodeName:}" failed. No retries permitted until 2026-07-09 13:29:17.786741872 +0000 UTC m=+3.998732264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs") pod "network-metrics-daemon-c9kpx" (UID: "64ff7bd1-e900-488f-89e0-a5a8b096751f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:16.987996 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:16.987964    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6st\" (UniqueName: \"kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st\") pod \"network-check-target-n2fg9\" (UID: \"c68fccbd-cc3e-48f8-a091-1670b97da9ea\") " pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:16.988142 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.988132    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:16.988201 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.988152    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:16.988201 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.988165    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5n6st for pod openshift-network-diagnostics/network-check-target-n2fg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:16.988263 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:16.988228    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st podName:c68fccbd-cc3e-48f8-a091-1670b97da9ea nodeName:}" failed. No retries permitted until 2026-07-09 13:29:17.988208124 +0000 UTC m=+4.200198522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6st" (UniqueName: "kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st") pod "network-check-target-n2fg9" (UID: "c68fccbd-cc3e-48f8-a091-1670b97da9ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:17.212644 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.212559    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:24:16 +0000 UTC" deadline="2028-01-14 23:29:48.022486494 +0000 UTC"
Jul 09 13:29:17.212644 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.212596    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13306h0m30.80989414s"
Jul 09 13:29:17.310826 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.310793    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:17.311004 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:17.310941    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:17.311367 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.311122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:17.311367 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:17.311250    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:17.319686 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.319565    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv" event={"ID":"dd348cbe-6b10-4521-9d9e-e5822e19d8c6","Type":"ContainerStarted","Data":"83b064ed0cc6703bf4956802f76d9bcfddd075b9287775c73c978338f79ca83d"}
Jul 09 13:29:17.321582 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.321505    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m769" event={"ID":"1e955a6c-b988-42c5-be21-74f5a9ea2e69","Type":"ContainerStarted","Data":"46c3f075d2766e965a5ff0d6f7d7cd190ece406148156f97f82c8776426fa827"}
Jul 09 13:29:17.323089 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.323068    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q57s8" event={"ID":"3b444150-17be-4f6b-99a1-7dd33396c270","Type":"ContainerStarted","Data":"4d5322faa05b7f58b4db237bed7740e4ed0908aacb980ec8530a40fbe5f7a256"}
Jul 09 13:29:17.324627 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.324568    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fgk2q" event={"ID":"c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01","Type":"ContainerStarted","Data":"dcaf4741677937a0f6615af4cb0d539c125ab612501a6884cb2c08eebcbda371"}
Jul 09 13:29:17.326271 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.326214    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88cjg" event={"ID":"4e34f19d-74ae-4034-a3f1-9022747a8953","Type":"ContainerStarted","Data":"251dfcb4dc2914a7061d23fdba4d5a9c4519ce094308234f16fe29ab293f202b"}
Jul 09 13:29:17.327913 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.327828    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8dls8" event={"ID":"738268ca-40be-4311-b212-0854eb8d6bfc","Type":"ContainerStarted","Data":"77a560a00be8f31a3c65c255df57cf4d085ea495fc06fbce4580b269ecceb097"}
Jul 09 13:29:17.329400 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.329368    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dmq4v" event={"ID":"f3eb424c-82a0-4276-949c-95c3e35341bd","Type":"ContainerStarted","Data":"638a84f1970df7c17b82164d23699af7d27c86061bd8373b596ea8a35a55b78f"}
Jul 09 13:29:17.330570 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.330551    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9ww7d" event={"ID":"c64940d7-a293-4b8a-97fe-ddc2be44d36b","Type":"ContainerStarted","Data":"ee45dd634cde6fc6c8da76d17c960be13635ce76c1e2c8e3bcac603f598341d9"}
Jul 09 13:29:17.331872 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.331821    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq" event={"ID":"dae3e2b7-00a6-4aae-b7b7-7bb639bef016","Type":"ContainerStarted","Data":"3c95faa6c9c02026188e9d837540e66ce9aef984874e6422586846d616733f26"}
Jul 09 13:29:17.564602 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.564506    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 13:29:17.798963 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.797592    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:17.798963 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.797854    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:17.798963 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:17.797990    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:17.798963 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:17.798082    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret podName:fa325c9d-9516-4389-9b8c-b2727a6724b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:19.798063414 +0000 UTC m=+6.010053825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret") pod "global-pull-secret-syncer-p74l4" (UID: "fa325c9d-9516-4389-9b8c-b2727a6724b7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:17.798963 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:17.798574    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:17.798963 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:17.798632    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs podName:64ff7bd1-e900-488f-89e0-a5a8b096751f nodeName:}" failed. No retries permitted until 2026-07-09 13:29:19.798615861 +0000 UTC m=+6.010606268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs") pod "network-metrics-daemon-c9kpx" (UID: "64ff7bd1-e900-488f-89e0-a5a8b096751f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:17.999512 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:17.999404    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6st\" (UniqueName: \"kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st\") pod \"network-check-target-n2fg9\" (UID: \"c68fccbd-cc3e-48f8-a091-1670b97da9ea\") " pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:17.999655 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:17.999591    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:17.999655 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:17.999617    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:17.999655 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:17.999630    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5n6st for pod openshift-network-diagnostics/network-check-target-n2fg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:17.999817 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:17.999692    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st podName:c68fccbd-cc3e-48f8-a091-1670b97da9ea nodeName:}" failed. No retries permitted until 2026-07-09 13:29:19.999672323 +0000 UTC m=+6.211662737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6st" (UniqueName: "kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st") pod "network-check-target-n2fg9" (UID: "c68fccbd-cc3e-48f8-a091-1670b97da9ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:18.212815 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:18.212755    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:24:16 +0000 UTC" deadline="2027-12-16 11:02:55.300924797 +0000 UTC"
Jul 09 13:29:18.212815 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:18.212813    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12597h33m37.088115836s"
Jul 09 13:29:18.311478 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:18.311405    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:18.311634 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:18.311543    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:18.338485 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:18.337831    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" event={"ID":"c553ed147be170fceaedd3bc0f04636c","Type":"ContainerStarted","Data":"926f34acd9c6fc22632963c64fc605be40b4c8d1b788e9539f036aa3f8c23318"}
Jul 09 13:29:18.343832 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:18.342770    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" event={"ID":"3ed27b0a868858a938334dd603a1333d","Type":"ContainerStarted","Data":"b980af6f924aaf6b2d7e7704b967c986b19d4f2f16a21c9e6cdf25a0dcc2434a"}
Jul 09 13:29:18.363623 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:18.363564    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" podStartSLOduration=3.363543711 podStartE2EDuration="3.363543711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:18.363018494 +0000 UTC m=+4.575008914" watchObservedRunningTime="2026-07-09 13:29:18.363543711 +0000 UTC m=+4.575534129"
Jul 09 13:29:19.309975 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:19.309939    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:19.310489 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:19.310085    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:19.310558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:19.310493    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:19.310616 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:19.310587    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:19.816444 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:19.816412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:19.816620 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:19.816462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:19.816684 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:19.816631    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:19.816731 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:19.816691    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret podName:fa325c9d-9516-4389-9b8c-b2727a6724b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:23.816671715 +0000 UTC m=+10.028662130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret") pod "global-pull-secret-syncer-p74l4" (UID: "fa325c9d-9516-4389-9b8c-b2727a6724b7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:19.817076 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:19.817059    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:19.817150 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:19.817115    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs podName:64ff7bd1-e900-488f-89e0-a5a8b096751f nodeName:}" failed. No retries permitted until 2026-07-09 13:29:23.817099868 +0000 UTC m=+10.029090261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs") pod "network-metrics-daemon-c9kpx" (UID: "64ff7bd1-e900-488f-89e0-a5a8b096751f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:20.017324 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:20.017263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6st\" (UniqueName: \"kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st\") pod \"network-check-target-n2fg9\" (UID: \"c68fccbd-cc3e-48f8-a091-1670b97da9ea\") " pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:20.017504 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:20.017492    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:20.017562 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:20.017510    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:20.017562 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:20.017524    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5n6st for pod openshift-network-diagnostics/network-check-target-n2fg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:20.017665 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:20.017583    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st podName:c68fccbd-cc3e-48f8-a091-1670b97da9ea nodeName:}" failed. No retries permitted until 2026-07-09 13:29:24.017565284 +0000 UTC m=+10.229555703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6st" (UniqueName: "kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st") pod "network-check-target-n2fg9" (UID: "c68fccbd-cc3e-48f8-a091-1670b97da9ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:20.310880 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:20.310807    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:20.311308 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:20.310941    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:21.310247 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:21.310161    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:21.310247 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:21.310214    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:21.310470 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:21.310335    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:21.310470 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:21.310437    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:21.354017 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:21.353981    2583 generic.go:356] "Generic (PLEG): container finished" podID="3ed27b0a868858a938334dd603a1333d" containerID="b980af6f924aaf6b2d7e7704b967c986b19d4f2f16a21c9e6cdf25a0dcc2434a" exitCode=0
Jul 09 13:29:21.354483 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:21.354039    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" event={"ID":"3ed27b0a868858a938334dd603a1333d","Type":"ContainerDied","Data":"b980af6f924aaf6b2d7e7704b967c986b19d4f2f16a21c9e6cdf25a0dcc2434a"}
Jul 09 13:29:22.310934 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:22.310907    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:22.311091 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:22.311042    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:23.310946 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:23.310911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:23.310946 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:23.310950    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:23.311504 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:23.311059    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:23.311504 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:23.311201    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:23.844417 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:23.844384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:23.844603 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:23.844428    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:23.844603 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:23.844558    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:23.844716 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:23.844625    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret podName:fa325c9d-9516-4389-9b8c-b2727a6724b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:31.844607122 +0000 UTC m=+18.056597516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret") pod "global-pull-secret-syncer-p74l4" (UID: "fa325c9d-9516-4389-9b8c-b2727a6724b7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:23.844716 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:23.844558    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:23.844716 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:23.844691    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs podName:64ff7bd1-e900-488f-89e0-a5a8b096751f nodeName:}" failed. No retries permitted until 2026-07-09 13:29:31.844678369 +0000 UTC m=+18.056668771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs") pod "network-metrics-daemon-c9kpx" (UID: "64ff7bd1-e900-488f-89e0-a5a8b096751f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:24.046159 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:24.046121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6st\" (UniqueName: \"kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st\") pod \"network-check-target-n2fg9\" (UID: \"c68fccbd-cc3e-48f8-a091-1670b97da9ea\") " pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:24.046408 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:24.046312    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:24.046408 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:24.046338    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:24.046408 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:24.046350    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5n6st for pod openshift-network-diagnostics/network-check-target-n2fg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:24.046408 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:24.046409    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st podName:c68fccbd-cc3e-48f8-a091-1670b97da9ea nodeName:}" failed. No retries permitted until 2026-07-09 13:29:32.046391071 +0000 UTC m=+18.258381477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6st" (UniqueName: "kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st") pod "network-check-target-n2fg9" (UID: "c68fccbd-cc3e-48f8-a091-1670b97da9ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:24.311081 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:24.310983    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:24.311539 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:24.311083    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:25.310345 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:25.310308    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:25.310527 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:25.310357    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:25.310527 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:25.310463    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:25.310647 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:25.310590    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:26.310745 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:26.310713    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:26.311215 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:26.310836    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:27.310093 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:27.310063    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:27.310259 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:27.310066    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:27.310259 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:27.310210    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:27.310392 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:27.310314    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:28.310179 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:28.310149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:28.310630 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:28.310297    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:29.310573 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:29.310542    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:29.311028 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:29.310670    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:29.311028 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:29.310724    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:29.311028 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:29.310819    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:30.310941 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:30.310913    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:30.311408 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:30.311044    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:31.310335 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:31.310278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:31.310335 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:31.310317    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:31.310584 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:31.310446    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:31.310584 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:31.310568    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:31.910847 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:31.910756    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:31.910847 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:31.910807    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:31.911371 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:31.910914    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:31.911371 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:31.910922    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:31.911371 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:31.910980    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret podName:fa325c9d-9516-4389-9b8c-b2727a6724b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:47.91096145 +0000 UTC m=+34.122951859 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret") pod "global-pull-secret-syncer-p74l4" (UID: "fa325c9d-9516-4389-9b8c-b2727a6724b7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:31.911371 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:31.911000    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs podName:64ff7bd1-e900-488f-89e0-a5a8b096751f nodeName:}" failed. No retries permitted until 2026-07-09 13:29:47.910990503 +0000 UTC m=+34.122980908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs") pod "network-metrics-daemon-c9kpx" (UID: "64ff7bd1-e900-488f-89e0-a5a8b096751f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:32.112332 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:32.112280    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6st\" (UniqueName: \"kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st\") pod \"network-check-target-n2fg9\" (UID: \"c68fccbd-cc3e-48f8-a091-1670b97da9ea\") " pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:32.112501 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:32.112443    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:32.112501 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:32.112465    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:32.112501 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:32.112474    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5n6st for pod openshift-network-diagnostics/network-check-target-n2fg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:32.112617 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:32.112533    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st podName:c68fccbd-cc3e-48f8-a091-1670b97da9ea nodeName:}" failed. No retries permitted until 2026-07-09 13:29:48.112516286 +0000 UTC m=+34.324506695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6st" (UniqueName: "kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st") pod "network-check-target-n2fg9" (UID: "c68fccbd-cc3e-48f8-a091-1670b97da9ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:32.310600 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:32.310520    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:32.310751 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:32.310656    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:33.310103 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:33.310068    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:33.310593 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:33.310068    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:33.310593 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:33.310215    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:33.310593 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:33.310316    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:34.311637 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:34.311585    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:34.312099 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:34.311694    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:35.309875 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:35.309843    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:35.310058 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:35.309849    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:35.310058 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:35.309975    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:35.310058 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:35.310035    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:36.310298 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.309909    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:36.310857 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:36.310413    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:36.383881 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.383857    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9ww7d" event={"ID":"c64940d7-a293-4b8a-97fe-ddc2be44d36b","Type":"ContainerStarted","Data":"377d63cc48f859ca56b09cb03f6477add9658c759aeeed6343cfbef245b670f6"}
Jul 09 13:29:36.385344 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.385320    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" event={"ID":"3ed27b0a868858a938334dd603a1333d","Type":"ContainerStarted","Data":"0bddaa77cf0eeb51b782b68769a061856da75c59a4bb0ac3602d50bf9c59a596"}
Jul 09 13:29:36.386491 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.386472    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq" event={"ID":"dae3e2b7-00a6-4aae-b7b7-7bb639bef016","Type":"ContainerStarted","Data":"eabe42b116cc83c650ba6c8997409a6f2616bf7b6d5e542302187d31889f6d78"}
Jul 09 13:29:36.388847 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.388826    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv" event={"ID":"dd348cbe-6b10-4521-9d9e-e5822e19d8c6","Type":"ContainerStarted","Data":"08c6591bc675e0af256ed2934de6205d085b8f9fb716767f7df4ad86eead65d6"}
Jul 09 13:29:36.388959 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.388888    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv" event={"ID":"dd348cbe-6b10-4521-9d9e-e5822e19d8c6","Type":"ContainerStarted","Data":"e1ddc64091aec03946679df989d92dcf51c0d53e978c0baadf1a809611ef5989"}
Jul 09 13:29:36.388959 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.388930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv" event={"ID":"dd348cbe-6b10-4521-9d9e-e5822e19d8c6","Type":"ContainerStarted","Data":"6cf03c9e0549b148ee0fc0a516c7103959f7a9db871bb8f06c8d238ba2233e22"}
Jul 09 13:29:36.388959 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.388960    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv" event={"ID":"dd348cbe-6b10-4521-9d9e-e5822e19d8c6","Type":"ContainerStarted","Data":"bb63952329bf71ebeb8b903f0631b0c756a8d372ecfd44134d9237e80679ca81"}
Jul 09 13:29:36.389084 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.388994    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv" event={"ID":"dd348cbe-6b10-4521-9d9e-e5822e19d8c6","Type":"ContainerStarted","Data":"985b7680d29cf33f00697998870bb4b1658df8ccddc4dc9ba7fcff55f5326ccf"}
Jul 09 13:29:36.390027 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.390007    2583 generic.go:356] "Generic (PLEG): container finished" podID="1e955a6c-b988-42c5-be21-74f5a9ea2e69" containerID="3602609927d15b4f2a8d4791a26f1d88ab06fbb338cbe6bbc69bdef5a0712ade" exitCode=0
Jul 09 13:29:36.390114 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.390074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m769" event={"ID":"1e955a6c-b988-42c5-be21-74f5a9ea2e69","Type":"ContainerDied","Data":"3602609927d15b4f2a8d4791a26f1d88ab06fbb338cbe6bbc69bdef5a0712ade"}
Jul 09 13:29:36.392648 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.392624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q57s8" event={"ID":"3b444150-17be-4f6b-99a1-7dd33396c270","Type":"ContainerStarted","Data":"6bc34ab87a27707a41248775e474ea9320c6f0786b9b71f5f210b183535307c9"}
Jul 09 13:29:36.394699 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.394670    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fgk2q" event={"ID":"c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01","Type":"ContainerStarted","Data":"9659bc6039fe9fd20285173e410b7ade529043669e54e1e6baf21c04890f2606"}
Jul 09 13:29:36.396029 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.396007    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8dls8" event={"ID":"738268ca-40be-4311-b212-0854eb8d6bfc","Type":"ContainerStarted","Data":"a5ccc4e9fe96ad0e2b7e82760cbb8c2aaa8a2f4277db5329b770968283212ebc"}
Jul 09 13:29:36.397359 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.397334    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dmq4v" event={"ID":"f3eb424c-82a0-4276-949c-95c3e35341bd","Type":"ContainerStarted","Data":"3b7efb3299fe7b3b2414164c96ac97182439db7c4b7cfe7892b8bcf62341df85"}
Jul 09 13:29:36.407065 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.407029    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9ww7d" podStartSLOduration=3.139091298 podStartE2EDuration="22.407016367s" totalImagesPullingTime="19.267925069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:36.406608258 +0000 UTC m=+22.618598674" watchObservedRunningTime="2026-07-09 13:29:36.407016367 +0000 UTC m=+22.619006782"
Jul 09 13:29:36.425048 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.425014    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dmq4v" podStartSLOduration=3.165735939 podStartE2EDuration="22.425001971s" totalImagesPullingTime="19.259266032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:36.424991612 +0000 UTC m=+22.636982041" watchObservedRunningTime="2026-07-09 13:29:36.425001971 +0000 UTC m=+22.636992385"
Jul 09 13:29:36.443300 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.443259    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" podStartSLOduration=21.443247847 podStartE2EDuration="21.443247847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:36.442836225 +0000 UTC m=+22.654826636" watchObservedRunningTime="2026-07-09 13:29:36.443247847 +0000 UTC m=+22.655238262"
Jul 09 13:29:36.491370 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.491327    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q57s8" podStartSLOduration=3.236860032 podStartE2EDuration="22.4913137s" totalImagesPullingTime="19.254453668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:36.467161854 +0000 UTC m=+22.679152287" watchObservedRunningTime="2026-07-09 13:29:36.4913137 +0000 UTC m=+22.703304151"
Jul 09 13:29:36.514240 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:36.514198    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8dls8" podStartSLOduration=3.237034986 podStartE2EDuration="22.51417755s" totalImagesPullingTime="19.277142564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:36.514076342 +0000 UTC m=+22.726066757" watchObservedRunningTime="2026-07-09 13:29:36.51417755 +0000 UTC m=+22.726167966"
Jul 09 13:29:37.102659 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:37.102591    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:37.103165 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:37.103143    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:37.121192 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:37.121153    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fgk2q" podStartSLOduration=8.435828631 podStartE2EDuration="23.121139857s" totalImagesPullingTime="14.685311226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:36.533541522 +0000 UTC m=+22.745531936" watchObservedRunningTime="2026-07-09 13:29:37.121139857 +0000 UTC m=+23.333130272"
Jul 09 13:29:37.309896 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:37.309870    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:37.310088 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:37.309961    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:37.310088 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:37.310015    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:37.310160 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:37.310098    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:37.400948 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:37.400873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88cjg" event={"ID":"4e34f19d-74ae-4034-a3f1-9022747a8953","Type":"ContainerStarted","Data":"3b9b1bc795bc8450cb3d2d404d513e71477fc046df10e40faef0beb39616cfe8"}
Jul 09 13:29:37.404215 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:37.404187    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv" event={"ID":"dd348cbe-6b10-4521-9d9e-e5822e19d8c6","Type":"ContainerStarted","Data":"2c60ca0054ea99055030b1d9785ff745a051024fe470f4a3dacb2e0f1e7eac51"}
Jul 09 13:29:37.419798 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:37.419763    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-88cjg" podStartSLOduration=4.195019374 podStartE2EDuration="23.419750043s" totalImagesPullingTime="19.224730669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:37.419749911 +0000 UTC m=+23.631740326" watchObservedRunningTime="2026-07-09 13:29:37.419750043 +0000 UTC m=+23.631740457"
Jul 09 13:29:37.556560 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:37.556541    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 13:29:38.234902 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:38.234728    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T13:29:37.556556717Z","UUID":"9b702d49-9eeb-4a26-8681-dd9ba4ca3c3a","Handler":null,"Name":"","Endpoint":""}
Jul 09 13:29:38.236571 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:38.236542    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 13:29:38.236718 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:38.236588    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 13:29:38.309990 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:38.309955    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:38.310154 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:38.310070    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:38.407479 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:38.407454    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 13:29:38.407479 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:38.407456    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq" event={"ID":"dae3e2b7-00a6-4aae-b7b7-7bb639bef016","Type":"ContainerStarted","Data":"8ccda1a04c9305ac2aea80fd16b33ab62ca31525aaf8d6b588d304f27de56dbc"}
Jul 09 13:29:39.310549 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:39.310376    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:39.310716 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:39.310427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:39.310716 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:39.310635    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:39.310813 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:39.310734    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:39.413062 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:39.413027    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq" event={"ID":"dae3e2b7-00a6-4aae-b7b7-7bb639bef016","Type":"ContainerStarted","Data":"2f0423b0eacd913c6a74fd67e38c8014f2b6ad1ee49ba7d1f0c773028b9ef426"}
Jul 09 13:29:39.416765 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:39.416738    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv" event={"ID":"dd348cbe-6b10-4521-9d9e-e5822e19d8c6","Type":"ContainerStarted","Data":"78239cce6f20b587aa949c12ba4c280af82ef47145ecfa0138ac34564825d6a0"}
Jul 09 13:29:39.435724 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:39.435683    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p48rq" podStartSLOduration=3.8108625529999998 podStartE2EDuration="25.435670665s" totalImagesPullingTime="21.624808112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:39.43554995 +0000 UTC m=+25.647540369" watchObservedRunningTime="2026-07-09 13:29:39.435670665 +0000 UTC m=+25.647661079"
Jul 09 13:29:40.310393 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:40.310354    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:40.310577 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:40.310488    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:41.310114 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:41.310082    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:41.310114 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:41.310082    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:41.310655 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:41.310244    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:41.310655 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:41.310399    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:42.310539 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:42.310374    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:42.311061 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:42.310609    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:42.425096 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:42.425062    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv" event={"ID":"dd348cbe-6b10-4521-9d9e-e5822e19d8c6","Type":"ContainerStarted","Data":"835d7eff8e76d660b3e143f5d1de06a6f2884904d09e9cb166dac71ff2243c10"}
Jul 09 13:29:42.425373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:42.425344    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:42.425483 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:42.425422    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:42.425483 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:42.425473    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:42.426982 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:42.426958    2583 generic.go:356] "Generic (PLEG): container finished" podID="1e955a6c-b988-42c5-be21-74f5a9ea2e69" containerID="d32c780af64eeb9bd9a8a8bdc7ac6ebbc4c3f8ba73fe52e93050e8ef8166656b" exitCode=0
Jul 09 13:29:42.427104 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:42.426995    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m769" event={"ID":"1e955a6c-b988-42c5-be21-74f5a9ea2e69","Type":"ContainerDied","Data":"d32c780af64eeb9bd9a8a8bdc7ac6ebbc4c3f8ba73fe52e93050e8ef8166656b"}
Jul 09 13:29:42.441160 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:42.441136    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:42.441330 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:42.441315    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:29:42.462780 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:42.462743    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv" podStartSLOduration=9.08175775 podStartE2EDuration="28.462731389s" totalImagesPullingTime="19.380973639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:42.46250599 +0000 UTC m=+28.674496443" watchObservedRunningTime="2026-07-09 13:29:42.462731389 +0000 UTC m=+28.674721804"
Jul 09 13:29:43.310755 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:43.310727    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:43.311243 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:43.310832    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:43.311243 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:43.310882    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:43.311243 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:43.310963    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:43.345122 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:43.345093    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:43.345259 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:43.345212    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 13:29:43.345708 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:43.345683    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fgk2q"
Jul 09 13:29:43.891803 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:43.891731    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2fg9"]
Jul 09 13:29:43.891936 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:43.891885    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:43.891995 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:43.891977    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:43.895330 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:43.895307    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p74l4"]
Jul 09 13:29:43.895442 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:43.895398    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:43.895485 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:43.895463    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:43.898679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:43.898655    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c9kpx"]
Jul 09 13:29:43.898788 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:43.898764    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:43.898896 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:43.898875    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:44.432276 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:44.432244    2583 generic.go:356] "Generic (PLEG): container finished" podID="1e955a6c-b988-42c5-be21-74f5a9ea2e69" containerID="b3aa65e37bd48274c2fdddea72ff08edce8c3c229af73b6aad0d458129a0f7a3" exitCode=0
Jul 09 13:29:44.432681 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:44.432335    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m769" event={"ID":"1e955a6c-b988-42c5-be21-74f5a9ea2e69","Type":"ContainerDied","Data":"b3aa65e37bd48274c2fdddea72ff08edce8c3c229af73b6aad0d458129a0f7a3"}
Jul 09 13:29:45.310345 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:45.310158    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:45.310473 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:45.310158    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:45.310473 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:45.310433    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:45.310554 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:45.310492    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:46.310752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:46.310720    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:46.311201 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:46.310827    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:46.439196 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:46.439162    2583 generic.go:356] "Generic (PLEG): container finished" podID="1e955a6c-b988-42c5-be21-74f5a9ea2e69" containerID="2186c2320fe87ab9ce824b0e17104b6f15154150ec16e1636935b6d83a638536" exitCode=0
Jul 09 13:29:46.439388 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:46.439217    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m769" event={"ID":"1e955a6c-b988-42c5-be21-74f5a9ea2e69","Type":"ContainerDied","Data":"2186c2320fe87ab9ce824b0e17104b6f15154150ec16e1636935b6d83a638536"}
Jul 09 13:29:47.310559 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:47.310489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:47.310745 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:47.310496    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:47.310745 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:47.310694    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9kpx" podUID="64ff7bd1-e900-488f-89e0-a5a8b096751f"
Jul 09 13:29:47.310745 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:47.310579    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2fg9" podUID="c68fccbd-cc3e-48f8-a091-1670b97da9ea"
Jul 09 13:29:47.936361 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:47.936320    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:47.936361 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:47.936367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:47.936585 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:47.936473    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:47.936585 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:47.936529    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret podName:fa325c9d-9516-4389-9b8c-b2727a6724b7 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:19.936516022 +0000 UTC m=+66.148506414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret") pod "global-pull-secret-syncer-p74l4" (UID: "fa325c9d-9516-4389-9b8c-b2727a6724b7") : object "kube-system"/"original-pull-secret" not registered
Jul 09 13:29:47.936585 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:47.936473    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:47.936724 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:47.936601    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs podName:64ff7bd1-e900-488f-89e0-a5a8b096751f nodeName:}" failed. No retries permitted until 2026-07-09 13:30:19.936589645 +0000 UTC m=+66.148580042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs") pod "network-metrics-daemon-c9kpx" (UID: "64ff7bd1-e900-488f-89e0-a5a8b096751f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 13:29:48.138088 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.138059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6st\" (UniqueName: \"kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st\") pod \"network-check-target-n2fg9\" (UID: \"c68fccbd-cc3e-48f8-a091-1670b97da9ea\") " pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:48.138256 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.138195    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 13:29:48.138256 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.138212    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 13:29:48.138256 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.138222    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5n6st for pod openshift-network-diagnostics/network-check-target-n2fg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:48.138392 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.138278    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st podName:c68fccbd-cc3e-48f8-a091-1670b97da9ea nodeName:}" failed. No retries permitted until 2026-07-09 13:30:20.138262181 +0000 UTC m=+66.350252588 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6st" (UniqueName: "kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st") pod "network-check-target-n2fg9" (UID: "c68fccbd-cc3e-48f8-a091-1670b97da9ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 13:29:48.310211 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.310135    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:48.310386 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.310240    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p74l4" podUID="fa325c9d-9516-4389-9b8c-b2727a6724b7"
Jul 09 13:29:48.577344 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.577267    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeReady"
Jul 09 13:29:48.577658 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.577385    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 13:29:48.617205 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.616934    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bdf8c7955-db7bb"]
Jul 09 13:29:48.618867 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.618852    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.621482 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.621073    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"]
Jul 09 13:29:48.623705 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.623605    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-shv5j"]
Jul 09 13:29:48.623837 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.623746    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 13:29:48.623837 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.623777    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"
Jul 09 13:29:48.627078 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.627029    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 13:29:48.628325 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.628305    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4rx22\""
Jul 09 13:29:48.629247 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.629226    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 13:29:48.629549 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.629528    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 09 13:29:48.629692 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.629533    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 09 13:29:48.629940 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.629923    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"]
Jul 09 13:29:48.630158 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.630139    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.631173 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.630891    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2pqz8\""
Jul 09 13:29:48.631664 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.631188    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 09 13:29:48.631664 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.631267    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 09 13:29:48.632713 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.632695    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 09 13:29:48.633361 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.633341    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 09 13:29:48.633463 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.633389    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sj5f4\""
Jul 09 13:29:48.635373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.634207    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"]
Jul 09 13:29:48.635373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.634790    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 09 13:29:48.635373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.634789    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 09 13:29:48.635373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.635094    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"
Jul 09 13:29:48.636983 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.636967    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"]
Jul 09 13:29:48.638044 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.638011    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:48.638728 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.638710    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 13:29:48.639510 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.639495    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-q8hsn"]
Jul 09 13:29:48.641624 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.641472    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 09 13:29:48.641714 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.639722    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:29:48.643783 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.643765    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 09 13:29:48.644037 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.644016    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 09 13:29:48.644174 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.644160    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 09 13:29:48.644491 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.644472    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ppbjs\""
Jul 09 13:29:48.644984 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.644968    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wxsmw"]
Jul 09 13:29:48.645322 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.645237    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 09 13:29:48.645593 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.645577    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 09 13:29:48.645765 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.645744    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-98g4s\""
Jul 09 13:29:48.646526 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.646503    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 13:29:48.647052 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.647034    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 09 13:29:48.647356 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.645626    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 13:29:48.647999 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.647981    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q8hsn"
Jul 09 13:29:48.648957 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.648936    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5nv4r"]
Jul 09 13:29:48.649987 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.649962    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 09 13:29:48.650381 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.650355    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 09 13:29:48.650734 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.650714    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cq4zm\""
Jul 09 13:29:48.650957 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.650939    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 09 13:29:48.651254 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.651238    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.652508 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.652487    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 13:29:48.652748 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.652731    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 13:29:48.653652 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.653636    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f4d4669b9-5pg7f"]
Jul 09 13:29:48.655194 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.653707    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5nv4r"
Jul 09 13:29:48.657005 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.655738    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 13:29:48.657005 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.656590    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-b5f7b\""
Jul 09 13:29:48.657005 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.656757    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 13:29:48.657005 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.656838    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 09 13:29:48.657356 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.657062    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 09 13:29:48.657650 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.657581    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2nfjp\""
Jul 09 13:29:48.658174 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.658154    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w5mx4"]
Jul 09 13:29:48.658359 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.658342    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.660123 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.659969    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 09 13:29:48.660123 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.660009    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 09 13:29:48.661802 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.661781    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bwdzm\""
Jul 09 13:29:48.663707 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.663692    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 09 13:29:48.664007 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.663988    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gs9sg\""
Jul 09 13:29:48.664140 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.664125    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 09 13:29:48.664782 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.664767    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4p62b"]
Jul 09 13:29:48.665114 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.665090    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w5mx4"
Jul 09 13:29:48.665782 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.664897    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 13:29:48.665782 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.664831    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 09 13:29:48.666250 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.666219    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 13:29:48.667445 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.667399    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 09 13:29:48.669033 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.668996    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"]
Jul 09 13:29:48.669154 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669105    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bdf8c7955-db7bb"]
Jul 09 13:29:48.669154 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669146    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"]
Jul 09 13:29:48.669313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669166    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-shv5j"]
Jul 09 13:29:48.669313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669184    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"]
Jul 09 13:29:48.669313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669206    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wxsmw"]
Jul 09 13:29:48.669313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669218    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f4d4669b9-5pg7f"]
Jul 09 13:29:48.669313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669230    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w5mx4"]
Jul 09 13:29:48.669313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669242    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4p62b"]
Jul 09 13:29:48.669313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669261    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-q8hsn"]
Jul 09 13:29:48.669313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669277    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5nv4r"]
Jul 09 13:29:48.669313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669310    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"]
Jul 09 13:29:48.669768 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.669768 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.669741    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 09 13:29:48.670239 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.670213    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 13:29:48.670858 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.670836    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 13:29:48.670936 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.670862    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6tscd\""
Jul 09 13:29:48.670936 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.670867    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 13:29:48.672114 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.672098    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 13:29:48.672215 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.672184    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 13:29:48.672530 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.672504    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vw8bp\""
Jul 09 13:29:48.742650 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2rx\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-kube-api-access-pj2rx\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.742776 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742668    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-serving-cert\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.742776 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kjwvz\" (UID: \"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"
Jul 09 13:29:48.742776 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-trusted-ca\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.742776 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16845078-45af-44da-848e-dc714f64b62f-serving-cert\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.742776 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742776    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-trusted-ca\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.743030 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742795    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlmgm\" (UniqueName: \"kubernetes.io/projected/b85f6197-0a67-4802-925c-fde765d61fd9-kube-api-access-jlmgm\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:48.743030 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742861    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40818561-d5c2-42c4-9b56-b30e9512ca61-config\") pod \"service-ca-operator-5d46d9ffd4-qsxms\" (UID: \"40818561-d5c2-42c4-9b56-b30e9512ca61\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"
Jul 09 13:29:48.743030 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742890    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/16845078-45af-44da-848e-dc714f64b62f-snapshots\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.743030 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742940    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40818561-d5c2-42c4-9b56-b30e9512ca61-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qsxms\" (UID: \"40818561-d5c2-42c4-9b56-b30e9512ca61\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"
Jul 09 13:29:48.743030 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742967    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsgnk\" (UniqueName: \"kubernetes.io/projected/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-kube-api-access-bsgnk\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.743030 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.742995    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr2vv\" (UniqueName: \"kubernetes.io/projected/f0492814-8e2d-489e-8da3-c41296ac13da-kube-api-access-tr2vv\") pod \"volume-data-source-validator-5d456fdbcd-5nv4r\" (UID: \"f0492814-8e2d-489e-8da3-c41296ac13da\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5nv4r"
Jul 09 13:29:48.743338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-image-registry-private-configuration\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.743338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13386fab-a140-4c47-b672-458b985a625b-ca-trust-extracted\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.743338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:29:48.743338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16845078-45af-44da-848e-dc714f64b62f-tmp\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.743338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4nxd\" (UniqueName: \"kubernetes.io/projected/f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd-kube-api-access-j4nxd\") pod \"kube-storage-version-migrator-operator-846bf668f7-kjwvz\" (UID: \"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"
Jul 09 13:29:48.743338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743203    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdzfb\" (UniqueName: \"kubernetes.io/projected/40818561-d5c2-42c4-9b56-b30e9512ca61-kube-api-access-xdzfb\") pod \"service-ca-operator-5d46d9ffd4-qsxms\" (UID: \"40818561-d5c2-42c4-9b56-b30e9512ca61\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"
Jul 09 13:29:48.743338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743245    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-registry-certificates\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.743338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743268    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-installation-pull-secrets\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.743338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743312    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-bound-sa-token\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.743338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743336    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h87r6\" (UniqueName: \"kubernetes.io/projected/8f62a98a-3c6b-4203-8fdc-8c24f816feae-kube-api-access-h87r6\") pod \"network-check-source-989f8b8dc-q8hsn\" (UID: \"8f62a98a-3c6b-4203-8fdc-8c24f816feae\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q8hsn"
Jul 09 13:29:48.743809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743359    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16845078-45af-44da-848e-dc714f64b62f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.743809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:48.743809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743412    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f574m\" (UniqueName: \"kubernetes.io/projected/16845078-45af-44da-848e-dc714f64b62f-kube-api-access-f574m\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.743809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743436    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-config\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.743809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743460    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b85f6197-0a67-4802-925c-fde765d61fd9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:48.743809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.743809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16845078-45af-44da-848e-dc714f64b62f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.743809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743535    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h64pz\" (UniqueName: \"kubernetes.io/projected/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-kube-api-access-h64pz\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:29:48.743809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.743622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kjwvz\" (UID: \"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"
Jul 09 13:29:48.833277 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.833182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:29:48.844240 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.844210    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:29:48.844376 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.844258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77178ab2-e7c2-4143-aaf3-d12ac523d265-tmp-dir\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.844376 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.844300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16845078-45af-44da-848e-dc714f64b62f-tmp\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.844376 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.844336    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd2d8\" (UniqueName: \"kubernetes.io/projected/214d0c91-8dca-4c29-ad16-0157626106a7-kube-api-access-vd2d8\") pod \"ingress-canary-w5mx4\" (UID: \"214d0c91-8dca-4c29-ad16-0157626106a7\") " pod="openshift-ingress-canary/ingress-canary-w5mx4"
Jul 09 13:29:48.844376 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.844357    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 13:29:48.844376 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.844361    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77178ab2-e7c2-4143-aaf3-d12ac523d265-config-volume\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.844600 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.844392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4nxd\" (UniqueName: \"kubernetes.io/projected/f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd-kube-api-access-j4nxd\") pod \"kube-storage-version-migrator-operator-846bf668f7-kjwvz\" (UID: \"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"
Jul 09 13:29:48.844600 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.844426    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls podName:323355e2-92c2-4dcc-aac9-0e4dc6d468d5 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:49.344405621 +0000 UTC m=+35.556396015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ht5kw" (UID: "323355e2-92c2-4dcc-aac9-0e4dc6d468d5") : secret "samples-operator-tls" not found
Jul 09 13:29:48.844849 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.844635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdzfb\" (UniqueName: \"kubernetes.io/projected/40818561-d5c2-42c4-9b56-b30e9512ca61-kube-api-access-xdzfb\") pod \"service-ca-operator-5d46d9ffd4-qsxms\" (UID: \"40818561-d5c2-42c4-9b56-b30e9512ca61\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"
Jul 09 13:29:48.844941 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.844924    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-registry-certificates\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.844990 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.844965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-installation-pull-secrets\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.845041 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.845001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-bound-sa-token\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.845041 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.845004    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16845078-45af-44da-848e-dc714f64b62f-tmp\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.845041 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.845035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h87r6\" (UniqueName: \"kubernetes.io/projected/8f62a98a-3c6b-4203-8fdc-8c24f816feae-kube-api-access-h87r6\") pod \"network-check-source-989f8b8dc-q8hsn\" (UID: \"8f62a98a-3c6b-4203-8fdc-8c24f816feae\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q8hsn"
Jul 09 13:29:48.845177 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.845080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16845078-45af-44da-848e-dc714f64b62f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.845177 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.845122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.845486    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.845551    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls podName:b85f6197-0a67-4802-925c-fde765d61fd9 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:49.345529209 +0000 UTC m=+35.557519606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-wnkbv" (UID: "b85f6197-0a67-4802-925c-fde765d61fd9") : secret "cluster-monitoring-operator-tls" not found
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.845883    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f574m\" (UniqueName: \"kubernetes.io/projected/16845078-45af-44da-848e-dc714f64b62f-kube-api-access-f574m\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.845943    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8h89\" (UniqueName: \"kubernetes.io/projected/77178ab2-e7c2-4143-aaf3-d12ac523d265-kube-api-access-n8h89\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.845985    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-config\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846019    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b85f6197-0a67-4802-925c-fde765d61fd9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846050    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/214d0c91-8dca-4c29-ad16-0157626106a7-cert\") pod \"ingress-canary-w5mx4\" (UID: \"214d0c91-8dca-4c29-ad16-0157626106a7\") " pod="openshift-ingress-canary/ingress-canary-w5mx4"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846051    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-registry-certificates\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846075    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16845078-45af-44da-848e-dc714f64b62f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h64pz\" (UniqueName: \"kubernetes.io/projected/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-kube-api-access-h64pz\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846154    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kjwvz\" (UID: \"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2rx\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-kube-api-access-pj2rx\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.847280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-serving-cert\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846692    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-config\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kjwvz\" (UID: \"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.846955    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.846970    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdf8c7955-db7bb: secret "image-registry-tls" not found
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.846996    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16845078-45af-44da-848e-dc714f64b62f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.847019    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls podName:13386fab-a140-4c47-b672-458b985a625b nodeName:}" failed. No retries permitted until 2026-07-09 13:29:49.34700431 +0000 UTC m=+35.558994703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls") pod "image-registry-6bdf8c7955-db7bb" (UID: "13386fab-a140-4c47-b672-458b985a625b") : secret "image-registry-tls" not found
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847231    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16845078-45af-44da-848e-dc714f64b62f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847273    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kjwvz\" (UID: \"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847305    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-trusted-ca\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847341    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16845078-45af-44da-848e-dc714f64b62f-serving-cert\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-trusted-ca\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847396    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlmgm\" (UniqueName: \"kubernetes.io/projected/b85f6197-0a67-4802-925c-fde765d61fd9-kube-api-access-jlmgm\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847425    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40818561-d5c2-42c4-9b56-b30e9512ca61-config\") pod \"service-ca-operator-5d46d9ffd4-qsxms\" (UID: \"40818561-d5c2-42c4-9b56-b30e9512ca61\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847455    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/16845078-45af-44da-848e-dc714f64b62f-snapshots\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847566    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b85f6197-0a67-4802-925c-fde765d61fd9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:48.848261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847724    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-stats-auth\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.849020 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847769    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.849020 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847800    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.849020 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40818561-d5c2-42c4-9b56-b30e9512ca61-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qsxms\" (UID: \"40818561-d5c2-42c4-9b56-b30e9512ca61\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"
Jul 09 13:29:48.849020 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-default-certificate\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.849020 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847892    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g8jl\" (UniqueName: \"kubernetes.io/projected/e5262aa7-786a-42c6-9e5b-274756d292b0-kube-api-access-5g8jl\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.849020 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsgnk\" (UniqueName: \"kubernetes.io/projected/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-kube-api-access-bsgnk\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.849020 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.847968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr2vv\" (UniqueName: \"kubernetes.io/projected/f0492814-8e2d-489e-8da3-c41296ac13da-kube-api-access-tr2vv\") pod \"volume-data-source-validator-5d456fdbcd-5nv4r\" (UID: \"f0492814-8e2d-489e-8da3-c41296ac13da\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5nv4r"
Jul 09 13:29:48.849020 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.848002    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-image-registry-private-configuration\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.849020 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.848052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13386fab-a140-4c47-b672-458b985a625b-ca-trust-extracted\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.849020 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.848664    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13386fab-a140-4c47-b672-458b985a625b-ca-trust-extracted\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.850225 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.849801    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/16845078-45af-44da-848e-dc714f64b62f-snapshots\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.850653 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.850410    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-trusted-ca\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.853228 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.851093    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40818561-d5c2-42c4-9b56-b30e9512ca61-config\") pod \"service-ca-operator-5d46d9ffd4-qsxms\" (UID: \"40818561-d5c2-42c4-9b56-b30e9512ca61\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"
Jul 09 13:29:48.853228 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.851582    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-trusted-ca\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.853228 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.852913    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16845078-45af-44da-848e-dc714f64b62f-serving-cert\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.853228 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.853148    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-serving-cert\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.853228 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.853168    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kjwvz\" (UID: \"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"
Jul 09 13:29:48.853549 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.853301    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-image-registry-private-configuration\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.853884 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.853624    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-installation-pull-secrets\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.854567 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.854523    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40818561-d5c2-42c4-9b56-b30e9512ca61-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qsxms\" (UID: \"40818561-d5c2-42c4-9b56-b30e9512ca61\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"
Jul 09 13:29:48.857758 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.857717    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdzfb\" (UniqueName: \"kubernetes.io/projected/40818561-d5c2-42c4-9b56-b30e9512ca61-kube-api-access-xdzfb\") pod \"service-ca-operator-5d46d9ffd4-qsxms\" (UID: \"40818561-d5c2-42c4-9b56-b30e9512ca61\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"
Jul 09 13:29:48.857842 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.857772    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4nxd\" (UniqueName: \"kubernetes.io/projected/f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd-kube-api-access-j4nxd\") pod \"kube-storage-version-migrator-operator-846bf668f7-kjwvz\" (UID: \"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"
Jul 09 13:29:48.857915 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.857875    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f574m\" (UniqueName: \"kubernetes.io/projected/16845078-45af-44da-848e-dc714f64b62f-kube-api-access-f574m\") pod \"insights-operator-5c847dcfc4-wxsmw\" (UID: \"16845078-45af-44da-848e-dc714f64b62f\") " pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:48.858650 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.858591    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-bound-sa-token\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.859838 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.859786    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h87r6\" (UniqueName: \"kubernetes.io/projected/8f62a98a-3c6b-4203-8fdc-8c24f816feae-kube-api-access-h87r6\") pod \"network-check-source-989f8b8dc-q8hsn\" (UID: \"8f62a98a-3c6b-4203-8fdc-8c24f816feae\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q8hsn"
Jul 09 13:29:48.860850 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.860827    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h64pz\" (UniqueName: \"kubernetes.io/projected/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-kube-api-access-h64pz\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:29:48.861430 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.861373    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2rx\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-kube-api-access-pj2rx\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:48.861653 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.861629    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr2vv\" (UniqueName: \"kubernetes.io/projected/f0492814-8e2d-489e-8da3-c41296ac13da-kube-api-access-tr2vv\") pod \"volume-data-source-validator-5d456fdbcd-5nv4r\" (UID: \"f0492814-8e2d-489e-8da3-c41296ac13da\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5nv4r"
Jul 09 13:29:48.862085 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.862055    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsgnk\" (UniqueName: \"kubernetes.io/projected/d3c0fd25-296e-46fd-9f20-852f09ce4dbd-kube-api-access-bsgnk\") pod \"console-operator-68b757fb67-shv5j\" (UID: \"d3c0fd25-296e-46fd-9f20-852f09ce4dbd\") " pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.862619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.862601    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlmgm\" (UniqueName: \"kubernetes.io/projected/b85f6197-0a67-4802-925c-fde765d61fd9-kube-api-access-jlmgm\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:48.927208 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.927172    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:29:48.949165 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949142    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"
Jul 09 13:29:48.949332 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949315    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77178ab2-e7c2-4143-aaf3-d12ac523d265-tmp-dir\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.949381 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd2d8\" (UniqueName: \"kubernetes.io/projected/214d0c91-8dca-4c29-ad16-0157626106a7-kube-api-access-vd2d8\") pod \"ingress-canary-w5mx4\" (UID: \"214d0c91-8dca-4c29-ad16-0157626106a7\") " pod="openshift-ingress-canary/ingress-canary-w5mx4"
Jul 09 13:29:48.949381 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77178ab2-e7c2-4143-aaf3-d12ac523d265-config-volume\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.949443 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8h89\" (UniqueName: \"kubernetes.io/projected/77178ab2-e7c2-4143-aaf3-d12ac523d265-kube-api-access-n8h89\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.949476 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/214d0c91-8dca-4c29-ad16-0157626106a7-cert\") pod \"ingress-canary-w5mx4\" (UID: \"214d0c91-8dca-4c29-ad16-0157626106a7\") " pod="openshift-ingress-canary/ingress-canary-w5mx4"
Jul 09 13:29:48.949518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949504    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.949680 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-stats-auth\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.949680 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949663    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77178ab2-e7c2-4143-aaf3-d12ac523d265-tmp-dir\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.949836 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.949684    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:49.449659459 +0000 UTC m=+35.661649853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : configmap references non-existent config key: service-ca.crt
Jul 09 13:29:48.949836 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.949836 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949745    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.949836 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949772    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-default-certificate\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.949836 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8jl\" (UniqueName: \"kubernetes.io/projected/e5262aa7-786a-42c6-9e5b-274756d292b0-kube-api-access-5g8jl\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.949836 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.949812    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 13:29:48.950138 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.949871    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls podName:77178ab2-e7c2-4143-aaf3-d12ac523d265 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:49.449856653 +0000 UTC m=+35.661847048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls") pod "dns-default-4p62b" (UID: "77178ab2-e7c2-4143-aaf3-d12ac523d265") : secret "dns-default-metrics-tls" not found
Jul 09 13:29:48.950138 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.949912    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 13:29:48.950138 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:48.949979    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:49.449963261 +0000 UTC m=+35.661953657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : secret "router-metrics-certs-default" not found
Jul 09 13:29:48.950138 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.949980    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77178ab2-e7c2-4143-aaf3-d12ac523d265-config-volume\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.952069 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.952030    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-default-certificate\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.952264 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.952250    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-stats-auth\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.952264 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.952255    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/214d0c91-8dca-4c29-ad16-0157626106a7-cert\") pod \"ingress-canary-w5mx4\" (UID: \"214d0c91-8dca-4c29-ad16-0157626106a7\") " pod="openshift-ingress-canary/ingress-canary-w5mx4"
Jul 09 13:29:48.962582 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.962563    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:29:48.963133 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.962885    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8h89\" (UniqueName: \"kubernetes.io/projected/77178ab2-e7c2-4143-aaf3-d12ac523d265-kube-api-access-n8h89\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:48.963133 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.962953    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd2d8\" (UniqueName: \"kubernetes.io/projected/214d0c91-8dca-4c29-ad16-0157626106a7-kube-api-access-vd2d8\") pod \"ingress-canary-w5mx4\" (UID: \"214d0c91-8dca-4c29-ad16-0157626106a7\") " pod="openshift-ingress-canary/ingress-canary-w5mx4"
Jul 09 13:29:48.963906 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.963886    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g8jl\" (UniqueName: \"kubernetes.io/projected/e5262aa7-786a-42c6-9e5b-274756d292b0-kube-api-access-5g8jl\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:48.973007 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.972988    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"
Jul 09 13:29:48.993327 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.993268    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q8hsn"
Jul 09 13:29:49.000102 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:48.999891    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw"
Jul 09 13:29:49.008444 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.008095    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5nv4r"
Jul 09 13:29:49.020901 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.020784    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w5mx4"
Jul 09 13:29:49.035547 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.033984    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:29:49.175637 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.175529    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz"]
Jul 09 13:29:49.187491 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:49.187448    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70c7e3f_a303_40b9_b0ac_f5cc3cbe61fd.slice/crio-67ec237da1c5b8b1af703b0eef93cca7b6800300069578db5f4b80b44f5453f5 WatchSource:0}: Error finding container 67ec237da1c5b8b1af703b0eef93cca7b6800300069578db5f4b80b44f5453f5: Status 404 returned error can't find the container with id 67ec237da1c5b8b1af703b0eef93cca7b6800300069578db5f4b80b44f5453f5
Jul 09 13:29:49.234475 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.234000    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms"]
Jul 09 13:29:49.235076 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.234948    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-shv5j"]
Jul 09 13:29:49.244590 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:49.243327    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c0fd25_296e_46fd_9f20_852f09ce4dbd.slice/crio-67a6bad918f75287818b35c45e211d961a41fdd2f844c239ffa28b622032aa8a WatchSource:0}: Error finding container 67a6bad918f75287818b35c45e211d961a41fdd2f844c239ffa28b622032aa8a: Status 404 returned error can't find the container with id 67a6bad918f75287818b35c45e211d961a41fdd2f844c239ffa28b622032aa8a
Jul 09 13:29:49.266131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.266104    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-q8hsn"]
Jul 09 13:29:49.268782 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:49.268757    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f62a98a_3c6b_4203_8fdc_8c24f816feae.slice/crio-50bba379ec88963bd1273af3fbf78ebc17ad862015584803449457b4740f5354 WatchSource:0}: Error finding container 50bba379ec88963bd1273af3fbf78ebc17ad862015584803449457b4740f5354: Status 404 returned error can't find the container with id 50bba379ec88963bd1273af3fbf78ebc17ad862015584803449457b4740f5354
Jul 09 13:29:49.273406 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.273381    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-wxsmw"]
Jul 09 13:29:49.277262 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:49.277236    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16845078_45af_44da_848e_dc714f64b62f.slice/crio-c38e8d68424a962bff582d010cea4df6e1c4e2b28b65535f5f475c18483da786 WatchSource:0}: Error finding container c38e8d68424a962bff582d010cea4df6e1c4e2b28b65535f5f475c18483da786: Status 404 returned error can't find the container with id c38e8d68424a962bff582d010cea4df6e1c4e2b28b65535f5f475c18483da786
Jul 09 13:29:49.288807 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.288786    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5nv4r"]
Jul 09 13:29:49.289913 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.289874    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w5mx4"]
Jul 09 13:29:49.292264 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:49.292239    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0492814_8e2d_489e_8da3_c41296ac13da.slice/crio-1f38cdc2be483a1c7f584ea5324d3615094015238981628ab50f4cdffc9e6f19 WatchSource:0}: Error finding container 1f38cdc2be483a1c7f584ea5324d3615094015238981628ab50f4cdffc9e6f19: Status 404 returned error can't find the container with id 1f38cdc2be483a1c7f584ea5324d3615094015238981628ab50f4cdffc9e6f19
Jul 09 13:29:49.293069 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:29:49.293047    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214d0c91_8dca_4c29_ad16_0157626106a7.slice/crio-ce71de6c5b6e740d607c73373a1060d7beefdd1e41f11300f8efdc74baad8bbc WatchSource:0}: Error finding container ce71de6c5b6e740d607c73373a1060d7beefdd1e41f11300f8efdc74baad8bbc: Status 404 returned error can't find the container with id ce71de6c5b6e740d607c73373a1060d7beefdd1e41f11300f8efdc74baad8bbc
Jul 09 13:29:49.310490 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.310468    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:29:49.310490 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.310482    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:29:49.313605 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.313586    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 13:29:49.313805 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.313790    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xg9bl\""
Jul 09 13:29:49.313867 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.313821    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmhp6\""
Jul 09 13:29:49.356965 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.356895    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:49.356965 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.356938    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:49.357130 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.357064    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 13:29:49.357130 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.357122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:29:49.357229 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.357131    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls podName:b85f6197-0a67-4802-925c-fde765d61fd9 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:50.357113744 +0000 UTC m=+36.569104140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-wnkbv" (UID: "b85f6197-0a67-4802-925c-fde765d61fd9") : secret "cluster-monitoring-operator-tls" not found
Jul 09 13:29:49.357229 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.357069    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 13:29:49.357229 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.357173    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdf8c7955-db7bb: secret "image-registry-tls" not found
Jul 09 13:29:49.357229 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.357229    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls podName:13386fab-a140-4c47-b672-458b985a625b nodeName:}" failed. No retries permitted until 2026-07-09 13:29:50.357211974 +0000 UTC m=+36.569202385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls") pod "image-registry-6bdf8c7955-db7bb" (UID: "13386fab-a140-4c47-b672-458b985a625b") : secret "image-registry-tls" not found
Jul 09 13:29:49.357420 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.357252    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 13:29:49.357420 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.357327    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls podName:323355e2-92c2-4dcc-aac9-0e4dc6d468d5 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:50.357308682 +0000 UTC m=+36.569299092 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ht5kw" (UID: "323355e2-92c2-4dcc-aac9-0e4dc6d468d5") : secret "samples-operator-tls" not found
Jul 09 13:29:49.446653 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.446619    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w5mx4" event={"ID":"214d0c91-8dca-4c29-ad16-0157626106a7","Type":"ContainerStarted","Data":"ce71de6c5b6e740d607c73373a1060d7beefdd1e41f11300f8efdc74baad8bbc"}
Jul 09 13:29:49.447656 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.447633    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms" event={"ID":"40818561-d5c2-42c4-9b56-b30e9512ca61","Type":"ContainerStarted","Data":"4caf849099e6b792301272f17c81dfaa077d86e5b268b63800f4750b52b5deaf"}
Jul 09 13:29:49.448671 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.448651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-shv5j" event={"ID":"d3c0fd25-296e-46fd-9f20-852f09ce4dbd","Type":"ContainerStarted","Data":"67a6bad918f75287818b35c45e211d961a41fdd2f844c239ffa28b622032aa8a"}
Jul 09 13:29:49.449613 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.449593    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz" event={"ID":"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd","Type":"ContainerStarted","Data":"67ec237da1c5b8b1af703b0eef93cca7b6800300069578db5f4b80b44f5453f5"}
Jul 09 13:29:49.450568 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.450550    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5nv4r" event={"ID":"f0492814-8e2d-489e-8da3-c41296ac13da","Type":"ContainerStarted","Data":"1f38cdc2be483a1c7f584ea5324d3615094015238981628ab50f4cdffc9e6f19"}
Jul 09 13:29:49.451517 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.451500    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw" event={"ID":"16845078-45af-44da-848e-dc714f64b62f","Type":"ContainerStarted","Data":"c38e8d68424a962bff582d010cea4df6e1c4e2b28b65535f5f475c18483da786"}
Jul 09 13:29:49.452446 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.452429    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q8hsn" event={"ID":"8f62a98a-3c6b-4203-8fdc-8c24f816feae","Type":"ContainerStarted","Data":"50bba379ec88963bd1273af3fbf78ebc17ad862015584803449457b4740f5354"}
Jul 09 13:29:49.457819 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.457795    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:49.457904 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.457864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:49.457904 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:49.457891    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:49.457993 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.457977    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 13:29:49.458024 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.458012    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 13:29:49.458052 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.458035    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls podName:77178ab2-e7c2-4143-aaf3-d12ac523d265 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:50.458022016 +0000 UTC m=+36.670012414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls") pod "dns-default-4p62b" (UID: "77178ab2-e7c2-4143-aaf3-d12ac523d265") : secret "dns-default-metrics-tls" not found
Jul 09 13:29:49.458091 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.458054    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:50.458041003 +0000 UTC m=+36.670031407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : secret "router-metrics-certs-default" not found
Jul 09 13:29:49.458125 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:49.458091    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:50.458082968 +0000 UTC m=+36.670073362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : configmap references non-existent config key: service-ca.crt
Jul 09 13:29:50.312655 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:50.312621    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:29:50.317103 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:50.317080    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 13:29:50.366829 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:50.366798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:29:50.366951 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:50.366903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:50.366951 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:50.366937    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:50.367200 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.367180    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 13:29:50.367373 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.367203    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdf8c7955-db7bb: secret "image-registry-tls" not found
Jul 09 13:29:50.367373 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.367261    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls podName:13386fab-a140-4c47-b672-458b985a625b nodeName:}" failed. No retries permitted until 2026-07-09 13:29:52.367242298 +0000 UTC m=+38.579232691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls") pod "image-registry-6bdf8c7955-db7bb" (UID: "13386fab-a140-4c47-b672-458b985a625b") : secret "image-registry-tls" not found
Jul 09 13:29:50.367733 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.367715    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 13:29:50.367820 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.367773    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls podName:323355e2-92c2-4dcc-aac9-0e4dc6d468d5 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:52.367756087 +0000 UTC m=+38.579746480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ht5kw" (UID: "323355e2-92c2-4dcc-aac9-0e4dc6d468d5") : secret "samples-operator-tls" not found
Jul 09 13:29:50.367882 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.367832    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 13:29:50.367882 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.367869    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls podName:b85f6197-0a67-4802-925c-fde765d61fd9 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:52.367856124 +0000 UTC m=+38.579846535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-wnkbv" (UID: "b85f6197-0a67-4802-925c-fde765d61fd9") : secret "cluster-monitoring-operator-tls" not found
Jul 09 13:29:50.468366 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:50.468333    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:50.468515 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:50.468382    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:50.468595 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:50.468535    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:50.468730 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.468714    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:52.468694917 +0000 UTC m=+38.680685327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : configmap references non-existent config key: service-ca.crt
Jul 09 13:29:50.469224 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.469200    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 13:29:50.469353 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.469260    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls podName:77178ab2-e7c2-4143-aaf3-d12ac523d265 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:52.469245107 +0000 UTC m=+38.681235503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls") pod "dns-default-4p62b" (UID: "77178ab2-e7c2-4143-aaf3-d12ac523d265") : secret "dns-default-metrics-tls" not found
Jul 09 13:29:50.469353 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.469334    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 13:29:50.469478 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:50.469372    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:52.469359897 +0000 UTC m=+38.681350290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : secret "router-metrics-certs-default" not found
Jul 09 13:29:51.589509 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:51.589456    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:29:51.655064 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:51.655004    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:29:52.393048 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:52.393020    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:52.393222 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:52.393150    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:29:52.393222 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.393203    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 13:29:52.393353 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.393224    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdf8c7955-db7bb: secret "image-registry-tls" not found
Jul 09 13:29:52.393353 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:52.393220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:52.393353 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.393311    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls podName:13386fab-a140-4c47-b672-458b985a625b nodeName:}" failed. No retries permitted until 2026-07-09 13:29:56.393269702 +0000 UTC m=+42.605260095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls") pod "image-registry-6bdf8c7955-db7bb" (UID: "13386fab-a140-4c47-b672-458b985a625b") : secret "image-registry-tls" not found
Jul 09 13:29:52.393353 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.393324    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 13:29:52.393353 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.393338    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 13:29:52.393566 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.393385    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls podName:b85f6197-0a67-4802-925c-fde765d61fd9 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:56.393367756 +0000 UTC m=+42.605358162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-wnkbv" (UID: "b85f6197-0a67-4802-925c-fde765d61fd9") : secret "cluster-monitoring-operator-tls" not found
Jul 09 13:29:52.393566 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.393405    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls podName:323355e2-92c2-4dcc-aac9-0e4dc6d468d5 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:56.393393959 +0000 UTC m=+42.605384369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ht5kw" (UID: "323355e2-92c2-4dcc-aac9-0e4dc6d468d5") : secret "samples-operator-tls" not found
Jul 09 13:29:52.494184 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:52.494145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:52.494355 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:52.494234    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:52.494355 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:52.494259    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:52.494355 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.494348    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:56.494323896 +0000 UTC m=+42.706314292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : configmap references non-existent config key: service-ca.crt
Jul 09 13:29:52.494539 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.494382    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 13:29:52.494539 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.494395    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 13:29:52.494539 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.494437    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls podName:77178ab2-e7c2-4143-aaf3-d12ac523d265 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:56.494424604 +0000 UTC m=+42.706415018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls") pod "dns-default-4p62b" (UID: "77178ab2-e7c2-4143-aaf3-d12ac523d265") : secret "dns-default-metrics-tls" not found
Jul 09 13:29:52.494539 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:52.494453    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:29:56.494445247 +0000 UTC m=+42.706435639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : secret "router-metrics-certs-default" not found
Jul 09 13:29:53.335239 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:53.335048    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:29:56.435088 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:56.435048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:29:56.435576 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:56.435115    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:29:56.435576 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:56.435141    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:29:56.435576 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.435223    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 13:29:56.435576 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.435246    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 13:29:56.435576 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.435257    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdf8c7955-db7bb: secret "image-registry-tls" not found
Jul 09 13:29:56.435576 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.435304    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 13:29:56.435576 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.435319    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls podName:13386fab-a140-4c47-b672-458b985a625b nodeName:}" failed. No retries permitted until 2026-07-09 13:30:04.435300613 +0000 UTC m=+50.647291031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls") pod "image-registry-6bdf8c7955-db7bb" (UID: "13386fab-a140-4c47-b672-458b985a625b") : secret "image-registry-tls" not found
Jul 09 13:29:56.435576 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.435342    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls podName:323355e2-92c2-4dcc-aac9-0e4dc6d468d5 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:04.435333942 +0000 UTC m=+50.647324335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ht5kw" (UID: "323355e2-92c2-4dcc-aac9-0e4dc6d468d5") : secret "samples-operator-tls" not found
Jul 09 13:29:56.435576 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.435370    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls podName:b85f6197-0a67-4802-925c-fde765d61fd9 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:04.435351319 +0000 UTC m=+50.647341749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-wnkbv" (UID: "b85f6197-0a67-4802-925c-fde765d61fd9") : secret "cluster-monitoring-operator-tls" not found
Jul 09 13:29:56.536166 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:56.536126    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:56.536368 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:56.536193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:29:56.536368 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.536316    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 13:29:56.536368 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.536323    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:04.536300432 +0000 UTC m=+50.748290843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : configmap references non-existent config key: service-ca.crt
Jul 09 13:29:56.536368 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.536356    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls podName:77178ab2-e7c2-4143-aaf3-d12ac523d265 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:04.536345422 +0000 UTC m=+50.748335818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls") pod "dns-default-4p62b" (UID: "77178ab2-e7c2-4143-aaf3-d12ac523d265") : secret "dns-default-metrics-tls" not found
Jul 09 13:29:56.536368 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:56.536357    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:29:56.536650 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.536521    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 13:29:56.536650 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:29:56.536570    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:04.536556148 +0000 UTC m=+50.748546542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : secret "router-metrics-certs-default" not found
Jul 09 13:29:58.076547 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:58.076510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:29:58.148868 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:58.148833    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:29:59.485372 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.485269    2583 generic.go:356] "Generic (PLEG): container finished" podID="1e955a6c-b988-42c5-be21-74f5a9ea2e69" containerID="edc48d687a395c948e0d55bbb64a03b17d59cf6c75c780f140b55ef8b3d67b5d" exitCode=0
Jul 09 13:29:59.485781 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.485380    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m769" event={"ID":"1e955a6c-b988-42c5-be21-74f5a9ea2e69","Type":"ContainerDied","Data":"edc48d687a395c948e0d55bbb64a03b17d59cf6c75c780f140b55ef8b3d67b5d"}
Jul 09 13:29:59.487456 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.487426    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw" event={"ID":"16845078-45af-44da-848e-dc714f64b62f","Type":"ContainerStarted","Data":"8688d9fe0b23a71f76a5f1a50d431a1b82a483d62d0d041ed2511222c683de61"}
Jul 09 13:29:59.489522 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.489485    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q8hsn" event={"ID":"8f62a98a-3c6b-4203-8fdc-8c24f816feae","Type":"ContainerStarted","Data":"5f4a7f65ddd5f0ca00a6f401de1528a652afd7cdedea4e25b5da8b49183e78b0"}
Jul 09 13:29:59.491106 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.491055    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w5mx4" event={"ID":"214d0c91-8dca-4c29-ad16-0157626106a7","Type":"ContainerStarted","Data":"f2e6966f5fe5d1df427686c7ef9a169adf7f203314ae93f3903299ef16843a32"}
Jul 09 13:29:59.493357 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.493332    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms" event={"ID":"40818561-d5c2-42c4-9b56-b30e9512ca61","Type":"ContainerStarted","Data":"8af268307822bb7dd8532b05901562d6cd0ee92998759b035dc7db03dee55993"}
Jul 09 13:29:59.495271 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.495251    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/0.log"
Jul 09 13:29:59.495373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.495303    2583 generic.go:356] "Generic (PLEG): container finished" podID="d3c0fd25-296e-46fd-9f20-852f09ce4dbd" containerID="2a3e4ee6070f129981746c861066d58df09e1055ce9ff8accb2a0559a4f94c57" exitCode=255
Jul 09 13:29:59.495428 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.495384    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-shv5j" event={"ID":"d3c0fd25-296e-46fd-9f20-852f09ce4dbd","Type":"ContainerDied","Data":"2a3e4ee6070f129981746c861066d58df09e1055ce9ff8accb2a0559a4f94c57"}
Jul 09 13:29:59.495532 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.495517    2583 scope.go:117] "RemoveContainer" containerID="2a3e4ee6070f129981746c861066d58df09e1055ce9ff8accb2a0559a4f94c57"
Jul 09 13:29:59.497059 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.497039    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz" event={"ID":"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd","Type":"ContainerStarted","Data":"d441f5cd289d6147fa9fd457a1b0442a473993d186b7d27c8602a06fc3ba371c"}
Jul 09 13:29:59.498697 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.498651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5nv4r" event={"ID":"f0492814-8e2d-489e-8da3-c41296ac13da","Type":"ContainerStarted","Data":"d0fe8cc7e1f79ed8be2280f70da8dfc4b745d1ad12bba6a2f0938a6d26bfb153"}
Jul 09 13:29:59.565851 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.564817    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw" podStartSLOduration=11.155024168 podStartE2EDuration="20.564796043s" totalImagesPullingTime="9.409771875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:59.535820241 +0000 UTC m=+45.747810657" watchObservedRunningTime="2026-07-09 13:29:59.564796043 +0000 UTC m=+45.776786459"
Jul 09 13:29:59.602114 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.601544    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-q8hsn" podStartSLOduration=9.173780466 podStartE2EDuration="18.60150896s" totalImagesPullingTime="9.427728494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:59.565711672 +0000 UTC m=+45.777702087" watchObservedRunningTime="2026-07-09 13:29:59.60150896 +0000 UTC m=+45.813499373"
Jul 09 13:29:59.629831 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.629605    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w5mx4" podStartSLOduration=2.236164961 podStartE2EDuration="11.629584005s" totalImagesPullingTime="9.393419044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:59.602773658 +0000 UTC m=+45.814764075" watchObservedRunningTime="2026-07-09 13:29:59.629584005 +0000 UTC m=+45.841574421"
Jul 09 13:29:59.671310 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.667901    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms" podStartSLOduration=11.224163517 podStartE2EDuration="20.667875508s" totalImagesPullingTime="9.443711991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:59.646239107 +0000 UTC m=+45.858229526" watchObservedRunningTime="2026-07-09 13:29:59.667875508 +0000 UTC m=+45.879865924"
Jul 09 13:29:59.693064 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.693009    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5nv4r" podStartSLOduration=11.298833401 podStartE2EDuration="20.692989931s" totalImagesPullingTime="9.39415653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:59.691903698 +0000 UTC m=+45.903894130" watchObservedRunningTime="2026-07-09 13:29:59.692989931 +0000 UTC m=+45.904980347"
Jul 09 13:29:59.693548 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.693519    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz" podStartSLOduration=11.195846149 podStartE2EDuration="20.693508583s" totalImagesPullingTime="9.497662434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:29:59.668267617 +0000 UTC m=+45.880258033" watchObservedRunningTime="2026-07-09 13:29:59.693508583 +0000 UTC m=+45.905498999"
Jul 09 13:29:59.786313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.786260    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:29:59.892954 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:29:59.892910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:00.130582 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.130542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:00.223431 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.223385    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lwk76"]
Jul 09 13:30:00.232436 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.232384    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:00.241977 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.241950    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.247063 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.247038    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 13:30:00.248332 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.248311    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kc8dw\""
Jul 09 13:30:00.250729 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.250710    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 13:30:00.280556 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.280525    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lwk76"]
Jul 09 13:30:00.366584 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.366547    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:00.378241 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.378209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa7ff488-de80-4303-99e5-9d40b905816e-data-volume\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.378400 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.378282    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.378400 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.378323    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa7ff488-de80-4303-99e5-9d40b905816e-crio-socket\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.378400 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.378370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wf42\" (UniqueName: \"kubernetes.io/projected/fa7ff488-de80-4303-99e5-9d40b905816e-kube-api-access-8wf42\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.378513 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.378489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.459392 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.459232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:00.479668 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.479642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.479822 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.479690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa7ff488-de80-4303-99e5-9d40b905816e-crio-socket\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.479822 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.479741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wf42\" (UniqueName: \"kubernetes.io/projected/fa7ff488-de80-4303-99e5-9d40b905816e-kube-api-access-8wf42\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.479822 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:00.479769    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 13:30:00.479969 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:00.479835    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm podName:fa7ff488-de80-4303-99e5-9d40b905816e nodeName:}" failed. No retries permitted until 2026-07-09 13:30:00.979819209 +0000 UTC m=+47.191809601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwk76" (UID: "fa7ff488-de80-4303-99e5-9d40b905816e") : configmap "kube-rbac-proxy" not found
Jul 09 13:30:00.479969 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.479776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.479969 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.479849    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa7ff488-de80-4303-99e5-9d40b905816e-crio-socket\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.479969 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.479934    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa7ff488-de80-4303-99e5-9d40b905816e-data-volume\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.480155 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:00.479993    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:00.480155 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:00.480044    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls podName:fa7ff488-de80-4303-99e5-9d40b905816e nodeName:}" failed. No retries permitted until 2026-07-09 13:30:00.98003014 +0000 UTC m=+47.192020546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwk76" (UID: "fa7ff488-de80-4303-99e5-9d40b905816e") : secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:00.480281 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.480265    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa7ff488-de80-4303-99e5-9d40b905816e-data-volume\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.495514 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.495491    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wf42\" (UniqueName: \"kubernetes.io/projected/fa7ff488-de80-4303-99e5-9d40b905816e-kube-api-access-8wf42\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.505764 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.505735    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:30:00.506613 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.506594    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/0.log"
Jul 09 13:30:00.506732 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.506641    2583 generic.go:356] "Generic (PLEG): container finished" podID="d3c0fd25-296e-46fd-9f20-852f09ce4dbd" containerID="629a940564c758750fd29a0a8eda391b947ebfdd3fe357b4ff905c209e25d1ea" exitCode=255
Jul 09 13:30:00.506793 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.506740    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-shv5j" event={"ID":"d3c0fd25-296e-46fd-9f20-852f09ce4dbd","Type":"ContainerDied","Data":"629a940564c758750fd29a0a8eda391b947ebfdd3fe357b4ff905c209e25d1ea"}
Jul 09 13:30:00.506994 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.506978    2583 scope.go:117] "RemoveContainer" containerID="629a940564c758750fd29a0a8eda391b947ebfdd3fe357b4ff905c209e25d1ea"
Jul 09 13:30:00.507073 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.507026    2583 scope.go:117] "RemoveContainer" containerID="2a3e4ee6070f129981746c861066d58df09e1055ce9ff8accb2a0559a4f94c57"
Jul 09 13:30:00.507227 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:00.507179    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-shv5j_openshift-console-operator(d3c0fd25-296e-46fd-9f20-852f09ce4dbd)\"" pod="openshift-console-operator/console-operator-68b757fb67-shv5j" podUID="d3c0fd25-296e-46fd-9f20-852f09ce4dbd"
Jul 09 13:30:00.510590 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.510566    2583 generic.go:356] "Generic (PLEG): container finished" podID="1e955a6c-b988-42c5-be21-74f5a9ea2e69" containerID="1b418c8d42aa027d42364552030ece53ce7a016286f1263141e769b4df588a27" exitCode=0
Jul 09 13:30:00.510693 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.510672    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m769" event={"ID":"1e955a6c-b988-42c5-be21-74f5a9ea2e69","Type":"ContainerDied","Data":"1b418c8d42aa027d42364552030ece53ce7a016286f1263141e769b4df588a27"}
Jul 09 13:30:00.552169 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.552110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:00.839078 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.839049    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:00.938723 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.938691    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:00.984935 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.984902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.985111 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:00.984991    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:00.985111 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:00.985052    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:00.985225 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:00.985124    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls podName:fa7ff488-de80-4303-99e5-9d40b905816e nodeName:}" failed. No retries permitted until 2026-07-09 13:30:01.985109163 +0000 UTC m=+48.197099557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwk76" (UID: "fa7ff488-de80-4303-99e5-9d40b905816e") : secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:00.985225 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:00.985125    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 13:30:00.985225 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:00.985188    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm podName:fa7ff488-de80-4303-99e5-9d40b905816e nodeName:}" failed. No retries permitted until 2026-07-09 13:30:01.98517039 +0000 UTC m=+48.197160798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwk76" (UID: "fa7ff488-de80-4303-99e5-9d40b905816e") : configmap "kube-rbac-proxy" not found
Jul 09 13:30:01.517256 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:01.517214    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7m769" event={"ID":"1e955a6c-b988-42c5-be21-74f5a9ea2e69","Type":"ContainerStarted","Data":"8996254a54b2c3bb9a56e0ab04985cd68a001ceceb8ce8403a58fb146493c26c"}
Jul 09 13:30:01.518799 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:01.518777    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:30:01.519111 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:01.519094    2583 scope.go:117] "RemoveContainer" containerID="629a940564c758750fd29a0a8eda391b947ebfdd3fe357b4ff905c209e25d1ea"
Jul 09 13:30:01.519345 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:01.519320    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-shv5j_openshift-console-operator(d3c0fd25-296e-46fd-9f20-852f09ce4dbd)\"" pod="openshift-console-operator/console-operator-68b757fb67-shv5j" podUID="d3c0fd25-296e-46fd-9f20-852f09ce4dbd"
Jul 09 13:30:01.549894 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:01.549844    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7m769" podStartSLOduration=13.359645439 podStartE2EDuration="47.549830004s" totalImagesPullingTime="34.190184565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:01.548720529 +0000 UTC m=+47.760710943" watchObservedRunningTime="2026-07-09 13:30:01.549830004 +0000 UTC m=+47.761820416"
Jul 09 13:30:01.665401 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:01.665364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:01.763797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:01.763758    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:01.868311 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:01.868247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:01.995508 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:01.995472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:01.995672 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:01.995599    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 13:30:01.995672 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:01.995597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:01.995747 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:01.995667    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm podName:fa7ff488-de80-4303-99e5-9d40b905816e nodeName:}" failed. No retries permitted until 2026-07-09 13:30:03.995647124 +0000 UTC m=+50.207637530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwk76" (UID: "fa7ff488-de80-4303-99e5-9d40b905816e") : configmap "kube-rbac-proxy" not found
Jul 09 13:30:01.995747 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:01.995677    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:01.995747 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:01.995713    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls podName:fa7ff488-de80-4303-99e5-9d40b905816e nodeName:}" failed. No retries permitted until 2026-07-09 13:30:03.995703351 +0000 UTC m=+50.207693747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwk76" (UID: "fa7ff488-de80-4303-99e5-9d40b905816e") : secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:02.022126 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:02.022105    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q57s8_3b444150-17be-4f6b-99a1-7dd33396c270/dns-node-resolver/0.log"
Jul 09 13:30:02.483799 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:02.483765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:02.628034 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:02.628007    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9ww7d_c64940d7-a293-4b8a-97fe-ddc2be44d36b/node-ca/0.log"
Jul 09 13:30:02.681376 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:02.681343    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:03.622337 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:03.622306    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w5mx4_214d0c91-8dca-4c29-ad16-0157626106a7/serve-healthcheck-canary/0.log"
Jul 09 13:30:03.698434 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:03.698395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:04.015000 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:04.014916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:04.015133 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:04.015038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:04.015133 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.015081    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:04.015210 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.015150    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 13:30:04.015210 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.015155    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls podName:fa7ff488-de80-4303-99e5-9d40b905816e nodeName:}" failed. No retries permitted until 2026-07-09 13:30:08.015136258 +0000 UTC m=+54.227126665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwk76" (UID: "fa7ff488-de80-4303-99e5-9d40b905816e") : secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:04.015278 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.015211    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm podName:fa7ff488-de80-4303-99e5-9d40b905816e nodeName:}" failed. No retries permitted until 2026-07-09 13:30:08.015196549 +0000 UTC m=+54.227186942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lwk76" (UID: "fa7ff488-de80-4303-99e5-9d40b905816e") : configmap "kube-rbac-proxy" not found
Jul 09 13:30:04.100532 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:04.100491    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:04.160991 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:04.160957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:04.519126 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:04.519081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:30:04.519338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:04.519159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:30:04.519338 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:04.519187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:30:04.519338 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.519252    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 13:30:04.519518 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.519338    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 13:30:04.519518 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.519357    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls podName:323355e2-92c2-4dcc-aac9-0e4dc6d468d5 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:20.51933437 +0000 UTC m=+66.731324783 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ht5kw" (UID: "323355e2-92c2-4dcc-aac9-0e4dc6d468d5") : secret "samples-operator-tls" not found
Jul 09 13:30:04.519518 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.519358    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdf8c7955-db7bb: secret "image-registry-tls" not found
Jul 09 13:30:04.519518 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.519256    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 13:30:04.519518 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.519402    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls podName:13386fab-a140-4c47-b672-458b985a625b nodeName:}" failed. No retries permitted until 2026-07-09 13:30:20.519391149 +0000 UTC m=+66.731381545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls") pod "image-registry-6bdf8c7955-db7bb" (UID: "13386fab-a140-4c47-b672-458b985a625b") : secret "image-registry-tls" not found
Jul 09 13:30:04.519518 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.519448    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls podName:b85f6197-0a67-4802-925c-fde765d61fd9 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:20.51942249 +0000 UTC m=+66.731412900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-wnkbv" (UID: "b85f6197-0a67-4802-925c-fde765d61fd9") : secret "cluster-monitoring-operator-tls" not found
Jul 09 13:30:04.619899 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:04.619863    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:30:04.619899 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:04.619903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:30:04.620106 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.620022    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 13:30:04.620106 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.620074    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls podName:77178ab2-e7c2-4143-aaf3-d12ac523d265 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:20.620059545 +0000 UTC m=+66.832049938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls") pod "dns-default-4p62b" (UID: "77178ab2-e7c2-4143-aaf3-d12ac523d265") : secret "dns-default-metrics-tls" not found
Jul 09 13:30:04.620106 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.620086    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 09 13:30:04.620230 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:04.620105    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:30:04.620230 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.620139    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:20.620123759 +0000 UTC m=+66.832114173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : secret "router-metrics-certs-default" not found
Jul 09 13:30:04.620230 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:04.620184    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle podName:e5262aa7-786a-42c6-9e5b-274756d292b0 nodeName:}" failed. No retries permitted until 2026-07-09 13:30:20.620173512 +0000 UTC m=+66.832163908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle") pod "router-default-7f4d4669b9-5pg7f" (UID: "e5262aa7-786a-42c6-9e5b-274756d292b0") : configmap references non-existent config key: service-ca.crt
Jul 09 13:30:05.049600 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:05.049564    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:06.591542 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:06.591510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:06.691958 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:06.691922    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:06.796959 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:06.796921    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:06.910049 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:06.909963    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:07.023514 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:07.023478    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:07.104446 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:07.104411    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:07.275453 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:07.275364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:07.696272 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:07.696240    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:07.797349 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:07.797312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:08.050049 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:08.049971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:08.050203 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:08.050058    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:08.050259 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:08.050202    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:08.050324 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:08.050275    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls podName:fa7ff488-de80-4303-99e5-9d40b905816e nodeName:}" failed. No retries permitted until 2026-07-09 13:30:16.050260004 +0000 UTC m=+62.262250397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lwk76" (UID: "fa7ff488-de80-4303-99e5-9d40b905816e") : secret "insights-runtime-extractor-tls" not found
Jul 09 13:30:08.050490 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:08.050474    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa7ff488-de80-4303-99e5-9d40b905816e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:08.668947 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:08.668911    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:08.764979 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:08.764939    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:08.889052 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:08.889016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:08.963385 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:08.963279    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:30:08.963385 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:08.963359    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:30:08.963705 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:08.963692    2583 scope.go:117] "RemoveContainer" containerID="629a940564c758750fd29a0a8eda391b947ebfdd3fe357b4ff905c209e25d1ea"
Jul 09 13:30:08.963853 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:30:08.963835    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-shv5j_openshift-console-operator(d3c0fd25-296e-46fd-9f20-852f09ce4dbd)\"" pod="openshift-console-operator/console-operator-68b757fb67-shv5j" podUID="d3c0fd25-296e-46fd-9f20-852f09ce4dbd"
Jul 09 13:30:09.513479 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:09.513446    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:09.615958 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:09.615921    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:09.886835 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:09.886802    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:10.646749 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:10.646712    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:10.749790 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:10.749751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:10.848266 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:10.848228    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:11.083513 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:11.083480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:11.485473 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:11.485370    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:11.590224 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:11.590177    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:11.883444 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:11.883410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:12.086631 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:12.086588    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:12.232239 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:12.232158    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:12.330817 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:12.330752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:12.701081 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:12.701048    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:13.090062 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:13.090030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:13.227523 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:13.227475    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:13.326174 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:13.326138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:13.686222 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:13.686158    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:14.290970 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:14.290937    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:14.442690 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:14.442661    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t8stv"
Jul 09 13:30:14.697536 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:14.697501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:14.892275 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:14.892233    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:15.283774 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:15.283736    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:15.589636 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:15.589596    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:16.085591 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:16.085560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:16.126839 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:16.126802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:16.129064 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:16.129039    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa7ff488-de80-4303-99e5-9d40b905816e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lwk76\" (UID: \"fa7ff488-de80-4303-99e5-9d40b905816e\") " pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:16.154542 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:16.154505    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kc8dw\""
Jul 09 13:30:16.161928 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:16.161902    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lwk76"
Jul 09 13:30:16.288834 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:16.288800    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:16.297901 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:16.297878    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lwk76"]
Jul 09 13:30:16.300638 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:30:16.300613    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7ff488_de80_4303_99e5_9d40b905816e.slice/crio-4f39a37afcdd1addacfd98c2794fdfd3874c4e00f46a64084d12d33da2241ea2 WatchSource:0}: Error finding container 4f39a37afcdd1addacfd98c2794fdfd3874c4e00f46a64084d12d33da2241ea2: Status 404 returned error can't find the container with id 4f39a37afcdd1addacfd98c2794fdfd3874c4e00f46a64084d12d33da2241ea2
Jul 09 13:30:16.479829 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:16.479737    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:16.565941 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:16.565903    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwk76" event={"ID":"fa7ff488-de80-4303-99e5-9d40b905816e","Type":"ContainerStarted","Data":"4f39a37afcdd1addacfd98c2794fdfd3874c4e00f46a64084d12d33da2241ea2"}
Jul 09 13:30:16.890974 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:16.890750    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:17.294337 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:17.294222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:17.489508 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:17.489467    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:19.965789 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:19.965738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:30:19.966257 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:19.965882    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:30:19.968920 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:19.968897    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 13:30:19.969764 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:19.969748    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 13:30:19.978209 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:19.978172    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64ff7bd1-e900-488f-89e0-a5a8b096751f-metrics-certs\") pod \"network-metrics-daemon-c9kpx\" (UID: \"64ff7bd1-e900-488f-89e0-a5a8b096751f\") " pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:30:19.978328 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:19.978257    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa325c9d-9516-4389-9b8c-b2727a6724b7-original-pull-secret\") pod \"global-pull-secret-syncer-p74l4\" (UID: \"fa325c9d-9516-4389-9b8c-b2727a6724b7\") " pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:30:20.027417 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.027376    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p74l4"
Jul 09 13:30:20.168422 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.168386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6st\" (UniqueName: \"kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st\") pod \"network-check-target-n2fg9\" (UID: \"c68fccbd-cc3e-48f8-a091-1670b97da9ea\") " pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:30:20.170971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.170946    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n6st\" (UniqueName: \"kubernetes.io/projected/c68fccbd-cc3e-48f8-a091-1670b97da9ea-kube-api-access-5n6st\") pod \"network-check-target-n2fg9\" (UID: \"c68fccbd-cc3e-48f8-a091-1670b97da9ea\") " pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:30:20.181512 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.181478    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p74l4"]
Jul 09 13:30:20.186202 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:30:20.186162    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa325c9d_9516_4389_9b8c_b2727a6724b7.slice/crio-a481335f2fb00017cc6a95108adc9d1c8219fbcbc75935d0a701f1898b0220a4 WatchSource:0}: Error finding container a481335f2fb00017cc6a95108adc9d1c8219fbcbc75935d0a701f1898b0220a4: Status 404 returned error can't find the container with id a481335f2fb00017cc6a95108adc9d1c8219fbcbc75935d0a701f1898b0220a4
Jul 09 13:30:20.225577 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.225486    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xg9bl\""
Jul 09 13:30:20.230978 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.230952    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmhp6\""
Jul 09 13:30:20.233005 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.232977    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:30:20.239130 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.239111    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9kpx"
Jul 09 13:30:20.310993 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.310915    2583 scope.go:117] "RemoveContainer" containerID="629a940564c758750fd29a0a8eda391b947ebfdd3fe357b4ff905c209e25d1ea"
Jul 09 13:30:20.375558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.375532    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2fg9"]
Jul 09 13:30:20.378344 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:30:20.378311    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68fccbd_cc3e_48f8_a091_1670b97da9ea.slice/crio-514bf1d692fd3d0759c1a1687863b3ea1f4a7f32d3627f573139ea04b8b60f2f WatchSource:0}: Error finding container 514bf1d692fd3d0759c1a1687863b3ea1f4a7f32d3627f573139ea04b8b60f2f: Status 404 returned error can't find the container with id 514bf1d692fd3d0759c1a1687863b3ea1f4a7f32d3627f573139ea04b8b60f2f
Jul 09 13:30:20.393056 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.393025    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c9kpx"]
Jul 09 13:30:20.396340 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:30:20.396309    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ff7bd1_e900_488f_89e0_a5a8b096751f.slice/crio-6a37db9d2d91b0a84336ec02507c90a97fad2f153fe91e026631cf7aa921678d WatchSource:0}: Error finding container 6a37db9d2d91b0a84336ec02507c90a97fad2f153fe91e026631cf7aa921678d: Status 404 returned error can't find the container with id 6a37db9d2d91b0a84336ec02507c90a97fad2f153fe91e026631cf7aa921678d
Jul 09 13:30:20.572649 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.572616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:30:20.572882 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.572669    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:30:20.572882 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.572793    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:30:20.575734 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.575668    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls\") pod \"image-registry-6bdf8c7955-db7bb\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") " pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:30:20.575885 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.575815    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b85f6197-0a67-4802-925c-fde765d61fd9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-wnkbv\" (UID: \"b85f6197-0a67-4802-925c-fde765d61fd9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:30:20.575885 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.575815    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/323355e2-92c2-4dcc-aac9-0e4dc6d468d5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ht5kw\" (UID: \"323355e2-92c2-4dcc-aac9-0e4dc6d468d5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:30:20.589188 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.589159    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:30:20.589374 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.589264    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-shv5j" event={"ID":"d3c0fd25-296e-46fd-9f20-852f09ce4dbd","Type":"ContainerStarted","Data":"b687e6e10322b3eca596c229635760d6a0772c08acfded425d918f5484834d60"}
Jul 09 13:30:20.589706 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.589656    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:30:20.591480 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.591448    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2fg9" event={"ID":"c68fccbd-cc3e-48f8-a091-1670b97da9ea","Type":"ContainerStarted","Data":"47e157d8ec6e2208af90c187beb6dbe82bfbe3894b15b85cd7e0101c082cd2a3"}
Jul 09 13:30:20.591611 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.591510    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2fg9" event={"ID":"c68fccbd-cc3e-48f8-a091-1670b97da9ea","Type":"ContainerStarted","Data":"514bf1d692fd3d0759c1a1687863b3ea1f4a7f32d3627f573139ea04b8b60f2f"}
Jul 09 13:30:20.591687 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.591580    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:30:20.593456 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.593423    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwk76" event={"ID":"fa7ff488-de80-4303-99e5-9d40b905816e","Type":"ContainerStarted","Data":"1ff10eb160753b6b665f11b95f31f353ffd2325a0af280d8adaecc8e9b394e60"}
Jul 09 13:30:20.594870 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.594845    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c9kpx" event={"ID":"64ff7bd1-e900-488f-89e0-a5a8b096751f","Type":"ContainerStarted","Data":"6a37db9d2d91b0a84336ec02507c90a97fad2f153fe91e026631cf7aa921678d"}
Jul 09 13:30:20.596022 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.595997    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p74l4" event={"ID":"fa325c9d-9516-4389-9b8c-b2727a6724b7","Type":"ContainerStarted","Data":"a481335f2fb00017cc6a95108adc9d1c8219fbcbc75935d0a701f1898b0220a4"}
Jul 09 13:30:20.611933 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.611876    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-shv5j" podStartSLOduration=32.168908636 podStartE2EDuration="41.611856291s" totalImagesPullingTime="9.442947655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:20.611030304 +0000 UTC m=+66.823020719" watchObservedRunningTime="2026-07-09 13:30:20.611856291 +0000 UTC m=+66.823846707"
Jul 09 13:30:20.629919 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.629858    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n2fg9" podStartSLOduration=66.629834666 podStartE2EDuration="1m6.629834666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:20.629731501 +0000 UTC m=+66.841721916" watchObservedRunningTime="2026-07-09 13:30:20.629834666 +0000 UTC m=+66.841825082"
Jul 09 13:30:20.673592 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.673545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:30:20.673782 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.673658    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:30:20.673782 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.673690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:30:20.674263 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.674138    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5262aa7-786a-42c6-9e5b-274756d292b0-service-ca-bundle\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:30:20.676912 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.676887    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77178ab2-e7c2-4143-aaf3-d12ac523d265-metrics-tls\") pod \"dns-default-4p62b\" (UID: \"77178ab2-e7c2-4143-aaf3-d12ac523d265\") " pod="openshift-dns/dns-default-4p62b"
Jul 09 13:30:20.677029 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.677002    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5262aa7-786a-42c6-9e5b-274756d292b0-metrics-certs\") pod \"router-default-7f4d4669b9-5pg7f\" (UID: \"e5262aa7-786a-42c6-9e5b-274756d292b0\") " pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:30:20.740954 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.740918    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4rx22\""
Jul 09 13:30:20.747324 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.747300    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:30:20.782484 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.782444    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-98g4s\""
Jul 09 13:30:20.789233 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.789197    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"
Jul 09 13:30:20.789858 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.789797    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cq4zm\""
Jul 09 13:30:20.797457 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.797428    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"
Jul 09 13:30:20.817340 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.817068    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gs9sg\""
Jul 09 13:30:20.824193 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.824089    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:30:20.831058 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.829550    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vw8bp\""
Jul 09 13:30:20.838939 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.838648    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4p62b"
Jul 09 13:30:20.951661 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:20.951624    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bdf8c7955-db7bb"]
Jul 09 13:30:20.971585 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:30:20.969371    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13386fab_a140_4c47_b672_458b985a625b.slice/crio-2fd37cca1cfcc3455335069fb24ce3cba6c508fe4adfdf09f5482d967decf5e3 WatchSource:0}: Error finding container 2fd37cca1cfcc3455335069fb24ce3cba6c508fe4adfdf09f5482d967decf5e3: Status 404 returned error can't find the container with id 2fd37cca1cfcc3455335069fb24ce3cba6c508fe4adfdf09f5482d967decf5e3
Jul 09 13:30:21.035681 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.035604    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv"]
Jul 09 13:30:21.057446 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.057406    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw"]
Jul 09 13:30:21.085231 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.085159    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f4d4669b9-5pg7f"]
Jul 09 13:30:21.093857 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:30:21.093426    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5262aa7_786a_42c6_9e5b_274756d292b0.slice/crio-1d6ec42ff4807522cd9086065a0bda8306db65cb6046d7ae362bfd3b65093029 WatchSource:0}: Error finding container 1d6ec42ff4807522cd9086065a0bda8306db65cb6046d7ae362bfd3b65093029: Status 404 returned error can't find the container with id 1d6ec42ff4807522cd9086065a0bda8306db65cb6046d7ae362bfd3b65093029
Jul 09 13:30:21.095089 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.094892    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-shv5j"
Jul 09 13:30:21.102414 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.102391    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4p62b"]
Jul 09 13:30:21.113120 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:30:21.113087    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77178ab2_e7c2_4143_aaf3_d12ac523d265.slice/crio-f1e5578cb9afd1f2835616d09b4029d6a8bc2fe266d4df60101a4c2b1da078cc WatchSource:0}: Error finding container f1e5578cb9afd1f2835616d09b4029d6a8bc2fe266d4df60101a4c2b1da078cc: Status 404 returned error can't find the container with id f1e5578cb9afd1f2835616d09b4029d6a8bc2fe266d4df60101a4c2b1da078cc
Jul 09 13:30:21.303249 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.303178    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:21.405486 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.405306    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:21.476898 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.475633    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"]
Jul 09 13:30:21.479324 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.479252    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:21.483323 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.482630    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 13:30:21.483323 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.483011    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 13:30:21.483323 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.483227    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 13:30:21.483577 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.483471    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 13:30:21.492877 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.491626    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"]
Jul 09 13:30:21.512030 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.511962    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:21.576567 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.575309    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-hqd9l"]
Jul 09 13:30:21.579008 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.578914    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-hqd9l"
Jul 09 13:30:21.584459 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.584212    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 13:30:21.584932 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.584906    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-25nxz\""
Jul 09 13:30:21.585416 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.585226    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 13:30:21.587349 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.587057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c88mv\" (UniqueName: \"kubernetes.io/projected/b3bf5b6c-baab-41c4-900a-db10e33cf3d6-kube-api-access-c88mv\") pod \"klusterlet-addon-workmgr-6f55bdddbc-9pzd2\" (UID: \"b3bf5b6c-baab-41c4-900a-db10e33cf3d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:21.587349 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.587148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3bf5b6c-baab-41c4-900a-db10e33cf3d6-tmp\") pod \"klusterlet-addon-workmgr-6f55bdddbc-9pzd2\" (UID: \"b3bf5b6c-baab-41c4-900a-db10e33cf3d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:21.587349 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.587177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b3bf5b6c-baab-41c4-900a-db10e33cf3d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f55bdddbc-9pzd2\" (UID: \"b3bf5b6c-baab-41c4-900a-db10e33cf3d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:21.599590 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.599496    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-hqd9l"]
Jul 09 13:30:21.611813 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.611720    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwk76" event={"ID":"fa7ff488-de80-4303-99e5-9d40b905816e","Type":"ContainerStarted","Data":"b0168e08249ef6a398e2316aa5ed7fea721aded5d821ffdfa39f14cdd401cf98"}
Jul 09 13:30:21.615381 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.615258    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4p62b" event={"ID":"77178ab2-e7c2-4143-aaf3-d12ac523d265","Type":"ContainerStarted","Data":"f1e5578cb9afd1f2835616d09b4029d6a8bc2fe266d4df60101a4c2b1da078cc"}
Jul 09 13:30:21.621223 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.620365    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f4d4669b9-5pg7f" event={"ID":"e5262aa7-786a-42c6-9e5b-274756d292b0","Type":"ContainerStarted","Data":"bb0a2bf87c20869958ea42f5fbb53db3027b4b18d77f9fe294d504c2b03ed8cc"}
Jul 09 13:30:21.621223 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.620438    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f4d4669b9-5pg7f" event={"ID":"e5262aa7-786a-42c6-9e5b-274756d292b0","Type":"ContainerStarted","Data":"1d6ec42ff4807522cd9086065a0bda8306db65cb6046d7ae362bfd3b65093029"}
Jul 09 13:30:21.624676 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.624574    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv" event={"ID":"b85f6197-0a67-4802-925c-fde765d61fd9","Type":"ContainerStarted","Data":"f11464f7d08624ad92d2e1d4a6d675438cce1f233147a737b86375391bbc1796"}
Jul 09 13:30:21.628457 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.628250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:21.629848 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.629778    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw" event={"ID":"323355e2-92c2-4dcc-aac9-0e4dc6d468d5","Type":"ContainerStarted","Data":"059fd91996a8fa7acb90586f48e2f18e82c11424582874cca9aae8f8640c9530"}
Jul 09 13:30:21.634438 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.633922    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb" event={"ID":"13386fab-a140-4c47-b672-458b985a625b","Type":"ContainerStarted","Data":"58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1"}
Jul 09 13:30:21.634438 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.633972    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb" event={"ID":"13386fab-a140-4c47-b672-458b985a625b","Type":"ContainerStarted","Data":"2fd37cca1cfcc3455335069fb24ce3cba6c508fe4adfdf09f5482d967decf5e3"}
Jul 09 13:30:21.634438 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.633998    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:30:21.654479 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.653554    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7f4d4669b9-5pg7f" podStartSLOduration=42.653532656 podStartE2EDuration="42.653532656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:21.652059489 +0000 UTC m=+67.864049953" watchObservedRunningTime="2026-07-09 13:30:21.653532656 +0000 UTC m=+67.865523073"
Jul 09 13:30:21.684462 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.683532    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb" podStartSLOduration=66.683508819 podStartE2EDuration="1m6.683508819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:21.682494415 +0000 UTC m=+67.894484831" watchObservedRunningTime="2026-07-09 13:30:21.683508819 +0000 UTC m=+67.895499236"
Jul 09 13:30:21.692548 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.688496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c88mv\" (UniqueName: \"kubernetes.io/projected/b3bf5b6c-baab-41c4-900a-db10e33cf3d6-kube-api-access-c88mv\") pod \"klusterlet-addon-workmgr-6f55bdddbc-9pzd2\" (UID: \"b3bf5b6c-baab-41c4-900a-db10e33cf3d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:21.692548 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.688559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsntm\" (UniqueName: \"kubernetes.io/projected/bb674bed-3cc6-416c-89c6-ca9f81a2ead1-kube-api-access-wsntm\") pod \"downloads-685bfb5f64-hqd9l\" (UID: \"bb674bed-3cc6-416c-89c6-ca9f81a2ead1\") " pod="openshift-console/downloads-685bfb5f64-hqd9l"
Jul 09 13:30:21.692548 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.688723    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3bf5b6c-baab-41c4-900a-db10e33cf3d6-tmp\") pod \"klusterlet-addon-workmgr-6f55bdddbc-9pzd2\" (UID: \"b3bf5b6c-baab-41c4-900a-db10e33cf3d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:21.692548 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.688750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b3bf5b6c-baab-41c4-900a-db10e33cf3d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f55bdddbc-9pzd2\" (UID: \"b3bf5b6c-baab-41c4-900a-db10e33cf3d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:21.692548 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.689866    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3bf5b6c-baab-41c4-900a-db10e33cf3d6-tmp\") pod \"klusterlet-addon-workmgr-6f55bdddbc-9pzd2\" (UID: \"b3bf5b6c-baab-41c4-900a-db10e33cf3d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:21.694082 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.694050    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b3bf5b6c-baab-41c4-900a-db10e33cf3d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f55bdddbc-9pzd2\" (UID: \"b3bf5b6c-baab-41c4-900a-db10e33cf3d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:21.709384 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.709312    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c88mv\" (UniqueName: \"kubernetes.io/projected/b3bf5b6c-baab-41c4-900a-db10e33cf3d6-kube-api-access-c88mv\") pod \"klusterlet-addon-workmgr-6f55bdddbc-9pzd2\" (UID: \"b3bf5b6c-baab-41c4-900a-db10e33cf3d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:21.728132 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.728038    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:21.790806 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.790634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsntm\" (UniqueName: \"kubernetes.io/projected/bb674bed-3cc6-416c-89c6-ca9f81a2ead1-kube-api-access-wsntm\") pod \"downloads-685bfb5f64-hqd9l\" (UID: \"bb674bed-3cc6-416c-89c6-ca9f81a2ead1\") " pod="openshift-console/downloads-685bfb5f64-hqd9l"
Jul 09 13:30:21.798736 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.798460    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:21.804572 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.804473    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsntm\" (UniqueName: \"kubernetes.io/projected/bb674bed-3cc6-416c-89c6-ca9f81a2ead1-kube-api-access-wsntm\") pod \"downloads-685bfb5f64-hqd9l\" (UID: \"bb674bed-3cc6-416c-89c6-ca9f81a2ead1\") " pod="openshift-console/downloads-685bfb5f64-hqd9l"
Jul 09 13:30:21.824411 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.824338    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:30:21.825546 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.825388    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:21.827610 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.827584    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:30:21.894298 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.894260    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-hqd9l"
Jul 09 13:30:21.931606 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:21.931490    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:22.035781 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.035696    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:22.154459 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.154424    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"]
Jul 09 13:30:22.202364 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.202273    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-hqd9l"]
Jul 09 13:30:22.208771 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:30:22.208732    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb674bed_3cc6_416c_89c6_ca9f81a2ead1.slice/crio-f0b919e1d06ec0e078557fa2d7ba2e50024bd366371b5a54d72447fb77aef945 WatchSource:0}: Error finding container f0b919e1d06ec0e078557fa2d7ba2e50024bd366371b5a54d72447fb77aef945: Status 404 returned error can't find the container with id f0b919e1d06ec0e078557fa2d7ba2e50024bd366371b5a54d72447fb77aef945
Jul 09 13:30:22.370646 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.370608    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:22.476210 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.476108    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:22.624403 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.624334    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:22.645313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.644637    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c9kpx" event={"ID":"64ff7bd1-e900-488f-89e0-a5a8b096751f","Type":"ContainerStarted","Data":"cd5e60bf62c649fdd3aaa1c92e91df00d441aa3bc913a40c3c64846b0c5f2a85"}
Jul 09 13:30:22.645313 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.644705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c9kpx" event={"ID":"64ff7bd1-e900-488f-89e0-a5a8b096751f","Type":"ContainerStarted","Data":"ba43c046d493fe33c81baa5a2dd7333770866e0da17e7351610886b57c1d8f7d"}
Jul 09 13:30:22.647574 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.647482    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2" event={"ID":"b3bf5b6c-baab-41c4-900a-db10e33cf3d6","Type":"ContainerStarted","Data":"9513520c12d898c94a4d666ec6de1b8051103c2bcac6a194e8324360a7cae2f6"}
Jul 09 13:30:22.651549 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.650151    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-hqd9l" event={"ID":"bb674bed-3cc6-416c-89c6-ca9f81a2ead1","Type":"ContainerStarted","Data":"f0b919e1d06ec0e078557fa2d7ba2e50024bd366371b5a54d72447fb77aef945"}
Jul 09 13:30:22.652018 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.651781    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:30:22.653532 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.653375    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f4d4669b9-5pg7f"
Jul 09 13:30:22.668835 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.668191    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c9kpx" podStartSLOduration=67.079971699 podStartE2EDuration="1m8.668167358s" totalImagesPullingTime="1.588195659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:22.666710541 +0000 UTC m=+68.878700956" watchObservedRunningTime="2026-07-09 13:30:22.668167358 +0000 UTC m=+68.880157776"
Jul 09 13:30:22.766542 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.766429    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:22.827984 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:22.827943    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:23.219282 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:23.219084    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:23.574444 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:23.574332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:23.968845 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:23.968562    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:24.038780 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:24.038740    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:24.813042 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:24.813003    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:24.876446 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:24.876269    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:25.140427 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:25.140368    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:25.237454 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:25.237391    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:25.981461 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:25.981405    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:26.382659 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:26.382580    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:26.448806 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:26.448690    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:27.579450 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:27.579393    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:32.259768 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.259732    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:32.357000 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.356844    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:32.456042 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.455970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:32.528023 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.527983    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:32.698048 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.697973    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv" event={"ID":"b85f6197-0a67-4802-925c-fde765d61fd9","Type":"ContainerStarted","Data":"e6c602636017512f8535ee25a0dd3571ec7b5790987260139c793e4c758da018"}
Jul 09 13:30:32.700645 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.700611    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lwk76" event={"ID":"fa7ff488-de80-4303-99e5-9d40b905816e","Type":"ContainerStarted","Data":"30ab4e91fcb00eabdb14c2b3c01be583d8dd7505ac435647472ce0b339ef782c"}
Jul 09 13:30:32.703234 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.703204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4p62b" event={"ID":"77178ab2-e7c2-4143-aaf3-d12ac523d265","Type":"ContainerStarted","Data":"7303efd2a6f611798208a798fd866ead4576093e3e233792bfd9b5b592a5a6fb"}
Jul 09 13:30:32.703406 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.703261    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4p62b"
Jul 09 13:30:32.703406 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.703280    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4p62b" event={"ID":"77178ab2-e7c2-4143-aaf3-d12ac523d265","Type":"ContainerStarted","Data":"cf963c7907cda5d68f131ca732eeaa12feba3450024f2c3836252778fd313661"}
Jul 09 13:30:32.705108 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.705080    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p74l4" event={"ID":"fa325c9d-9516-4389-9b8c-b2727a6724b7","Type":"ContainerStarted","Data":"7da8f4588f033000483114f5bcd5da1bf9cf82c0e546908553087050c932981e"}
Jul 09 13:30:32.706999 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.706970    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw" event={"ID":"323355e2-92c2-4dcc-aac9-0e4dc6d468d5","Type":"ContainerStarted","Data":"f8885ca21c26cfcd2b360494b19532366a2ba5c83721536a58e70d3c80a3cd8c"}
Jul 09 13:30:32.707106 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.707074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw" event={"ID":"323355e2-92c2-4dcc-aac9-0e4dc6d468d5","Type":"ContainerStarted","Data":"37e3477ae71da15f37b2d4a13d346f8170cf1b765073f5e71a5c75e2fd9cb4e7"}
Jul 09 13:30:32.708686 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.708663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2" event={"ID":"b3bf5b6c-baab-41c4-900a-db10e33cf3d6","Type":"ContainerStarted","Data":"2d5d718e42ec2abf5f980f2bab050edd8c69477092c222bb1b6e171f15bfd685"}
Jul 09 13:30:32.708901 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.708878    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:32.710922 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.710898    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2"
Jul 09 13:30:32.719848 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.719796    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-wnkbv" podStartSLOduration=42.991552046 podStartE2EDuration="53.719782101s" totalImagesPullingTime="10.728230055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:32.718707898 +0000 UTC m=+78.930698367" watchObservedRunningTime="2026-07-09 13:30:32.719782101 +0000 UTC m=+78.931772516"
Jul 09 13:30:32.743030 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.742956    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4p62b" podStartSLOduration=34.057987446 podStartE2EDuration="44.742935512s" totalImagesPullingTime="10.684948066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:32.741869703 +0000 UTC m=+78.953860142" watchObservedRunningTime="2026-07-09 13:30:32.742935512 +0000 UTC m=+78.954925930"
Jul 09 13:30:32.761197 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.761127    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f55bdddbc-9pzd2" podStartSLOduration=1.6913737580000001 podStartE2EDuration="11.761103103s" totalImagesPullingTime="10.069729345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:32.760209359 +0000 UTC m=+78.972199778" watchObservedRunningTime="2026-07-09 13:30:32.761103103 +0000 UTC m=+78.973093520"
Jul 09 13:30:32.777468 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.777413    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p74l4" podStartSLOduration=67.148078076 podStartE2EDuration="1m18.777395565s" totalImagesPullingTime="11.629317489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:32.776924546 +0000 UTC m=+78.988914962" watchObservedRunningTime="2026-07-09 13:30:32.777395565 +0000 UTC m=+78.989386043"
Jul 09 13:30:32.817326 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.817256    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lwk76" podStartSLOduration=17.49316999 podStartE2EDuration="32.817234716s" totalImagesPullingTime="15.324064726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:30:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:32.816129414 +0000 UTC m=+79.028119828" watchObservedRunningTime="2026-07-09 13:30:32.817234716 +0000 UTC m=+79.029225132"
Jul 09 13:30:32.817643 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.817620    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ht5kw" podStartSLOduration=43.152469045 podStartE2EDuration="53.817611212s" totalImagesPullingTime="10.665142167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:32.795680798 +0000 UTC m=+79.007671213" watchObservedRunningTime="2026-07-09 13:30:32.817611212 +0000 UTC m=+79.029601626"
Jul 09 13:30:32.895639 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:32.895549    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:35.414387 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:35.414346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:35.492644 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:35.492599    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:36.283488 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:36.283339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:36.384301 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:36.384246    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:36.593487 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:36.593432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:36.661593 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:36.661556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:37.498164 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:37.498127    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:37.576486 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:37.576443    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:37.639304 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:37.639248    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:38.163193 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:38.163150    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:38.230161 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:38.230124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:41.152045 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:41.152008    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:41.291907 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:41.291869    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:41.401268 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:41.401237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:41.748572 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:41.748490    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-hqd9l" event={"ID":"bb674bed-3cc6-416c-89c6-ca9f81a2ead1","Type":"ContainerStarted","Data":"f1b55f78bd573f472b935910eef28f5d00e306c98d4442640e2d60f1166a79b5"}
Jul 09 13:30:41.748752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:41.748655    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-hqd9l"
Jul 09 13:30:41.767766 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:41.767732    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-hqd9l"
Jul 09 13:30:41.830654 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:41.830591    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-hqd9l" podStartSLOduration=1.732137075 podStartE2EDuration="20.830573059s" totalImagesPullingTime="19.098435984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:41.789732128 +0000 UTC m=+88.001722620" watchObservedRunningTime="2026-07-09 13:30:41.830573059 +0000 UTC m=+88.042563513"
Jul 09 13:30:42.657445 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:42.656461    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:30:42.673398 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:42.673355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:42.716846 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:42.716789    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4p62b"
Jul 09 13:30:42.858274 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:42.858232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:42.959891 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:42.959802    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:42.982453 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:42.982421    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-62xtx"]
Jul 09 13:30:43.012854 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.012822    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.016216 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.016192    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 13:30:43.016439 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.016417    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 13:30:43.016531 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.016188    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 13:30:43.016531 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.016270    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 13:30:43.016531 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.016343    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xs29z\""
Jul 09 13:30:43.090238 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.090188    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.090454 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.090264    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20522500-0260-43bd-b3a0-b5a199fa0aa3-metrics-client-ca\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.090454 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.090337    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-wtmp\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.090454 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.090362    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20522500-0260-43bd-b3a0-b5a199fa0aa3-root\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.090625 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.090454    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vpr\" (UniqueName: \"kubernetes.io/projected/20522500-0260-43bd-b3a0-b5a199fa0aa3-kube-api-access-75vpr\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.090625 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.090500    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.090625 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.090542    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-tls\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.090625 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.090618    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20522500-0260-43bd-b3a0-b5a199fa0aa3-sys\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.090835 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.090682    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-textfile\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.140369 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.140242    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:43.191400 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20522500-0260-43bd-b3a0-b5a199fa0aa3-metrics-client-ca\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.191609 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-wtmp\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.191609 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20522500-0260-43bd-b3a0-b5a199fa0aa3-root\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.191609 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191510    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vpr\" (UniqueName: \"kubernetes.io/projected/20522500-0260-43bd-b3a0-b5a199fa0aa3-kube-api-access-75vpr\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.191609 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.191609 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191578    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-tls\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.191609 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191585    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/20522500-0260-43bd-b3a0-b5a199fa0aa3-root\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.191609 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20522500-0260-43bd-b3a0-b5a199fa0aa3-sys\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.192003 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191653    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20522500-0260-43bd-b3a0-b5a199fa0aa3-sys\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.192003 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191651    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-wtmp\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.192003 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-textfile\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.192003 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.191714    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.192210 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.192058    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20522500-0260-43bd-b3a0-b5a199fa0aa3-metrics-client-ca\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.192323 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.192277    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.192581 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.192558    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-textfile\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.194626 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.194603    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-tls\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.194965 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.194924    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20522500-0260-43bd-b3a0-b5a199fa0aa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.222078 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.222002    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vpr\" (UniqueName: \"kubernetes.io/projected/20522500-0260-43bd-b3a0-b5a199fa0aa3-kube-api-access-75vpr\") pod \"node-exporter-62xtx\" (UID: \"20522500-0260-43bd-b3a0-b5a199fa0aa3\") " pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.251576 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.251522    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:43.325662 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.325621    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-62xtx"
Jul 09 13:30:43.356367 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:30:43.356326    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20522500_0260_43bd_b3a0_b5a199fa0aa3.slice/crio-de8e177167af6203f5fb0603fcd0ec70ee2ce00bbcc8ebabe7eeb8106fdbbb32 WatchSource:0}: Error finding container de8e177167af6203f5fb0603fcd0ec70ee2ce00bbcc8ebabe7eeb8106fdbbb32: Status 404 returned error can't find the container with id de8e177167af6203f5fb0603fcd0ec70ee2ce00bbcc8ebabe7eeb8106fdbbb32
Jul 09 13:30:43.359648 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.359339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:43.458107 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.458066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:43.537571 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.537472    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:43.743556 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.743516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:43.767936 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:43.767890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-62xtx" event={"ID":"20522500-0260-43bd-b3a0-b5a199fa0aa3","Type":"ContainerStarted","Data":"de8e177167af6203f5fb0603fcd0ec70ee2ce00bbcc8ebabe7eeb8106fdbbb32"}
Jul 09 13:30:44.027695 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:44.027605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:44.146151 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:44.146070    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:44.152556 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:44.152522    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bdf8c7955-db7bb"]
Jul 09 13:30:44.226431 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:44.225940    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:44.313079 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:44.312705    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:44.543343 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:44.543279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:44.644179 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:44.644130    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:44.917134 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:44.917037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:45.028520 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:45.028475    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:45.782192 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:45.782157    2583 generic.go:356] "Generic (PLEG): container finished" podID="20522500-0260-43bd-b3a0-b5a199fa0aa3" containerID="07b9d40eb4869f4d8ab9419fef6c1dd2a56d65b2f34719e3d8684cd1b9aa734a" exitCode=0
Jul 09 13:30:45.782429 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:45.782250    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-62xtx" event={"ID":"20522500-0260-43bd-b3a0-b5a199fa0aa3","Type":"ContainerDied","Data":"07b9d40eb4869f4d8ab9419fef6c1dd2a56d65b2f34719e3d8684cd1b9aa734a"}
Jul 09 13:30:45.965803 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:45.965762    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:46.064480 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:46.064398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:46.406886 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:46.406849    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:46.515241 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:46.515189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:46.789788 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:46.789697    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-62xtx" event={"ID":"20522500-0260-43bd-b3a0-b5a199fa0aa3","Type":"ContainerStarted","Data":"36102918d0a64f6c1285af729696dd1748e1c9ada47a99fcf72b3cbaed464deb"}
Jul 09 13:30:46.789788 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:46.789759    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-62xtx" event={"ID":"20522500-0260-43bd-b3a0-b5a199fa0aa3","Type":"ContainerStarted","Data":"ed757c494e454bf23c4757a42d1459e01a4e905fe090dd3878eb34989bfa3556"}
Jul 09 13:30:46.814120 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:46.814072    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-62xtx" podStartSLOduration=3.188657423 podStartE2EDuration="4.814054622s" totalImagesPullingTime="1.529025402s" totalInitContainerRuntime="96.371797ms" isStatefulPod=true podCreationTimestamp="2026-07-09 13:30:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:46.812581979 +0000 UTC m=+93.024572397" watchObservedRunningTime="2026-07-09 13:30:46.814054622 +0000 UTC m=+93.026045076"
Jul 09 13:30:47.706673 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:47.706634    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:47.774880 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:47.774841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:48.105541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:48.105503    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:48.622018 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:48.621984    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:48.711858 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:48.711822    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:49.314427 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:49.314361    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:51.636810 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:51.636783    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n2fg9"
Jul 09 13:30:51.893219 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:51.893125    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:52.173197 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:52.173118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:52.273229 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:52.273180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:53.694208 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:53.694173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:53.757733 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:53.757689    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:54.949197 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:54.949157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:55.008684 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:55.008643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:55.551937 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:55.551893    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:55.653119 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:55.653085    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:58.628262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:58.628230    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:58.731374 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:58.731334    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:30:58.833895 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:30:58.833850    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:00.888881 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:00.888843    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:04.861564 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:04.861473    2583 generic.go:356] "Generic (PLEG): container finished" podID="16845078-45af-44da-848e-dc714f64b62f" containerID="8688d9fe0b23a71f76a5f1a50d431a1b82a483d62d0d041ed2511222c683de61" exitCode=0
Jul 09 13:31:04.861564 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:04.861527    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw" event={"ID":"16845078-45af-44da-848e-dc714f64b62f","Type":"ContainerDied","Data":"8688d9fe0b23a71f76a5f1a50d431a1b82a483d62d0d041ed2511222c683de61"}
Jul 09 13:31:04.862075 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:04.861872    2583 scope.go:117] "RemoveContainer" containerID="8688d9fe0b23a71f76a5f1a50d431a1b82a483d62d0d041ed2511222c683de61"
Jul 09 13:31:05.676427 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:05.676393    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:05.774644 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:05.774607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:05.870245 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:05.870208    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-wxsmw" event={"ID":"16845078-45af-44da-848e-dc714f64b62f","Type":"ContainerStarted","Data":"6d74345eef7c16e4493be30197cb54ed7f1de0c18620fc068b25fa54de34c2a3"}
Jul 09 13:31:05.874477 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:05.874449    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:06.610222 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:06.610184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:06.670517 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:06.670480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:09.181208 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.181140    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb" podUID="13386fab-a140-4c47-b672-458b985a625b" containerName="registry" containerID="cri-o://58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1" gracePeriod=30
Jul 09 13:31:09.457583 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.457509    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:31:09.501162 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.501133    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-installation-pull-secrets\") pod \"13386fab-a140-4c47-b672-458b985a625b\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") "
Jul 09 13:31:09.501162 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.501165    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls\") pod \"13386fab-a140-4c47-b672-458b985a625b\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") "
Jul 09 13:31:09.501386 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.501201    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-trusted-ca\") pod \"13386fab-a140-4c47-b672-458b985a625b\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") "
Jul 09 13:31:09.501386 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.501280    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj2rx\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-kube-api-access-pj2rx\") pod \"13386fab-a140-4c47-b672-458b985a625b\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") "
Jul 09 13:31:09.501386 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.501317    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-bound-sa-token\") pod \"13386fab-a140-4c47-b672-458b985a625b\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") "
Jul 09 13:31:09.501386 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.501373    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-registry-certificates\") pod \"13386fab-a140-4c47-b672-458b985a625b\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") "
Jul 09 13:31:09.501569 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.501402    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-image-registry-private-configuration\") pod \"13386fab-a140-4c47-b672-458b985a625b\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") "
Jul 09 13:31:09.501569 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.501437    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13386fab-a140-4c47-b672-458b985a625b-ca-trust-extracted\") pod \"13386fab-a140-4c47-b672-458b985a625b\" (UID: \"13386fab-a140-4c47-b672-458b985a625b\") "
Jul 09 13:31:09.501725 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.501696    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "13386fab-a140-4c47-b672-458b985a625b" (UID: "13386fab-a140-4c47-b672-458b985a625b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:31:09.501917 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.501891    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "13386fab-a140-4c47-b672-458b985a625b" (UID: "13386fab-a140-4c47-b672-458b985a625b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:31:09.504324 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.504261    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "13386fab-a140-4c47-b672-458b985a625b" (UID: "13386fab-a140-4c47-b672-458b985a625b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:31:09.504324 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.504305    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "13386fab-a140-4c47-b672-458b985a625b" (UID: "13386fab-a140-4c47-b672-458b985a625b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:31:09.504510 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.504418    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "13386fab-a140-4c47-b672-458b985a625b" (UID: "13386fab-a140-4c47-b672-458b985a625b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:31:09.504571 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.504509    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-kube-api-access-pj2rx" (OuterVolumeSpecName: "kube-api-access-pj2rx") pod "13386fab-a140-4c47-b672-458b985a625b" (UID: "13386fab-a140-4c47-b672-458b985a625b"). InnerVolumeSpecName "kube-api-access-pj2rx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:31:09.504785 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.504758    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "13386fab-a140-4c47-b672-458b985a625b" (UID: "13386fab-a140-4c47-b672-458b985a625b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:31:09.510861 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.510836    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13386fab-a140-4c47-b672-458b985a625b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "13386fab-a140-4c47-b672-458b985a625b" (UID: "13386fab-a140-4c47-b672-458b985a625b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:31:09.602709 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.602678    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj2rx\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-kube-api-access-pj2rx\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:31:09.602709 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.602705    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-bound-sa-token\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:31:09.602709 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.602717    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-registry-certificates\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:31:09.602943 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.602727    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-image-registry-private-configuration\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:31:09.602943 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.602737    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13386fab-a140-4c47-b672-458b985a625b-ca-trust-extracted\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:31:09.602943 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.602746    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13386fab-a140-4c47-b672-458b985a625b-installation-pull-secrets\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:31:09.602943 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.602754    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13386fab-a140-4c47-b672-458b985a625b-registry-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:31:09.602943 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.602763    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13386fab-a140-4c47-b672-458b985a625b-trusted-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:31:09.885282 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.885245    2583 generic.go:356] "Generic (PLEG): container finished" podID="13386fab-a140-4c47-b672-458b985a625b" containerID="58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1" exitCode=0
Jul 09 13:31:09.885282 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.885311    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb"
Jul 09 13:31:09.885580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.885336    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb" event={"ID":"13386fab-a140-4c47-b672-458b985a625b","Type":"ContainerDied","Data":"58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1"}
Jul 09 13:31:09.885580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.885401    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdf8c7955-db7bb" event={"ID":"13386fab-a140-4c47-b672-458b985a625b","Type":"ContainerDied","Data":"2fd37cca1cfcc3455335069fb24ce3cba6c508fe4adfdf09f5482d967decf5e3"}
Jul 09 13:31:09.885580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.885428    2583 scope.go:117] "RemoveContainer" containerID="58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1"
Jul 09 13:31:09.893802 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.893781    2583 scope.go:117] "RemoveContainer" containerID="58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1"
Jul 09 13:31:09.894085 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:31:09.894064    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1\": container with ID starting with 58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1 not found: ID does not exist" containerID="58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1"
Jul 09 13:31:09.894151 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.894096    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1"} err="failed to get container status \"58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1\": rpc error: code = NotFound desc = could not find container \"58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1\": container with ID starting with 58fc004b44e01a54328ee5cc6eae904300b90a98f60175e838bc3dffbb557fc1 not found: ID does not exist"
Jul 09 13:31:09.913590 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.913558    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bdf8c7955-db7bb"]
Jul 09 13:31:09.923234 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:09.923204    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bdf8c7955-db7bb"]
Jul 09 13:31:10.315281 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:10.315198    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13386fab-a140-4c47-b672-458b985a625b" path="/var/lib/kubelet/pods/13386fab-a140-4c47-b672-458b985a625b/volumes"
Jul 09 13:31:10.700210 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:10.700171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:14.905457 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:14.905418    2583 generic.go:356] "Generic (PLEG): container finished" podID="40818561-d5c2-42c4-9b56-b30e9512ca61" containerID="8af268307822bb7dd8532b05901562d6cd0ee92998759b035dc7db03dee55993" exitCode=0
Jul 09 13:31:14.905949 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:14.905496    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms" event={"ID":"40818561-d5c2-42c4-9b56-b30e9512ca61","Type":"ContainerDied","Data":"8af268307822bb7dd8532b05901562d6cd0ee92998759b035dc7db03dee55993"}
Jul 09 13:31:14.905949 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:14.905922    2583 scope.go:117] "RemoveContainer" containerID="8af268307822bb7dd8532b05901562d6cd0ee92998759b035dc7db03dee55993"
Jul 09 13:31:15.910722 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:15.910684    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qsxms" event={"ID":"40818561-d5c2-42c4-9b56-b30e9512ca61","Type":"ContainerStarted","Data":"2639bb7ab469fa9dc02a377f7a57765f8d37f3e5bd837807182c5f14a64dd47e"}
Jul 09 13:31:21.603154 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:21.603118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:21.707873 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:21.707828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:29.854736 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:29.854693    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:29.967770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:29.967682    2583 generic.go:356] "Generic (PLEG): container finished" podID="f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd" containerID="d441f5cd289d6147fa9fd457a1b0442a473993d186b7d27c8602a06fc3ba371c" exitCode=0
Jul 09 13:31:29.967770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:29.967723    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz" event={"ID":"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd","Type":"ContainerDied","Data":"d441f5cd289d6147fa9fd457a1b0442a473993d186b7d27c8602a06fc3ba371c"}
Jul 09 13:31:29.968028 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:29.968017    2583 scope.go:117] "RemoveContainer" containerID="d441f5cd289d6147fa9fd457a1b0442a473993d186b7d27c8602a06fc3ba371c"
Jul 09 13:31:30.055718 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:30.055676    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:30.973173 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:30.973142    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kjwvz" event={"ID":"f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd","Type":"ContainerStarted","Data":"489e4a88884dd073eb5ea9ef57e4694fe31b619e78853acc06911650e6a17523"}
Jul 09 13:31:59.137405 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:59.137368    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:31:59.240511 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:31:59.240472    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:05.614843 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:05.614799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:05.729929 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:05.729888    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:05.819905 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:05.819866    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:06.263746 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:06.263695    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:11.048671 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:11.048634    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:11.113138 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:11.113107    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:17.038040 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:17.038001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:17.152119 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:17.152077    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:17.264068 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:17.264028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:21.612337 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:21.612271    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:21.711753 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:21.711714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:21.772126 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:21.772078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:35.658257 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:35.658219    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:46.375204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:46.375161    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:46.476047 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:46.476016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:32:47.051759 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.051723    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"]
Jul 09 13:32:47.052032 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.052019    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13386fab-a140-4c47-b672-458b985a625b" containerName="registry"
Jul 09 13:32:47.052087 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.052035    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="13386fab-a140-4c47-b672-458b985a625b" containerName="registry"
Jul 09 13:32:47.052087 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.052085    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="13386fab-a140-4c47-b672-458b985a625b" containerName="registry"
Jul 09 13:32:47.054102 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.054085    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:32:47.057721 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.057704    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6mlhc\""
Jul 09 13:32:47.058029 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.058011    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 13:32:47.059021 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.058977    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 13:32:47.067442 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.067413    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"]
Jul 09 13:32:47.157586 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.157550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:32:47.157586 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.157589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:32:47.157821 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.157629    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bmnk\" (UniqueName: \"kubernetes.io/projected/632d9324-4f2e-4d35-be0a-658b2c89d866-kube-api-access-8bmnk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:32:47.258303 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.258257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:32:47.258472 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.258315    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:32:47.258472 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.258354    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bmnk\" (UniqueName: \"kubernetes.io/projected/632d9324-4f2e-4d35-be0a-658b2c89d866-kube-api-access-8bmnk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:32:47.258674 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.258654    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:32:47.258715 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.258678    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:32:47.269436 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.269402    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bmnk\" (UniqueName: \"kubernetes.io/projected/632d9324-4f2e-4d35-be0a-658b2c89d866-kube-api-access-8bmnk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:32:47.363621 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.363583    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:32:47.497628 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:47.497596    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"]
Jul 09 13:32:47.501372 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:32:47.501344    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632d9324_4f2e_4d35_be0a_658b2c89d866.slice/crio-9a84dc7285249fc635f2cbd5fbe4518bf5a013f7a1f93bbc79b148b474d745d5 WatchSource:0}: Error finding container 9a84dc7285249fc635f2cbd5fbe4518bf5a013f7a1f93bbc79b148b474d745d5: Status 404 returned error can't find the container with id 9a84dc7285249fc635f2cbd5fbe4518bf5a013f7a1f93bbc79b148b474d745d5
Jul 09 13:32:48.258429 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:48.258385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b" event={"ID":"632d9324-4f2e-4d35-be0a-658b2c89d866","Type":"ContainerStarted","Data":"9a84dc7285249fc635f2cbd5fbe4518bf5a013f7a1f93bbc79b148b474d745d5"}
Jul 09 13:32:53.279763 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:53.279722    2583 generic.go:356] "Generic (PLEG): container finished" podID="632d9324-4f2e-4d35-be0a-658b2c89d866" containerID="2b6b8945ab812b676a8ea98bb02d9e927ac0fbff1ec6d7cf8a776545c18067d8" exitCode=0
Jul 09 13:32:53.280177 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:53.279807    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b" event={"ID":"632d9324-4f2e-4d35-be0a-658b2c89d866","Type":"ContainerDied","Data":"2b6b8945ab812b676a8ea98bb02d9e927ac0fbff1ec6d7cf8a776545c18067d8"}
Jul 09 13:32:55.288945 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:55.288907    2583 generic.go:356] "Generic (PLEG): container finished" podID="632d9324-4f2e-4d35-be0a-658b2c89d866" containerID="d3b669c2c09c8fea811dd9daea486dbe8b513a630859543f05fb4703159d3494" exitCode=0
Jul 09 13:32:55.289378 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:32:55.288995    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b" event={"ID":"632d9324-4f2e-4d35-be0a-658b2c89d866","Type":"ContainerDied","Data":"d3b669c2c09c8fea811dd9daea486dbe8b513a630859543f05fb4703159d3494"}
Jul 09 13:33:01.315558 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:01.315525    2583 generic.go:356] "Generic (PLEG): container finished" podID="632d9324-4f2e-4d35-be0a-658b2c89d866" containerID="9500e7ea9162130163a5c054d52f0da29e3c9260078120a07d905b5603900bd1" exitCode=0
Jul 09 13:33:01.315941 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:01.315567    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b" event={"ID":"632d9324-4f2e-4d35-be0a-658b2c89d866","Type":"ContainerDied","Data":"9500e7ea9162130163a5c054d52f0da29e3c9260078120a07d905b5603900bd1"}
Jul 09 13:33:02.449773 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:02.449744    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:33:02.590364 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:02.590253    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-bundle\") pod \"632d9324-4f2e-4d35-be0a-658b2c89d866\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") "
Jul 09 13:33:02.590364 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:02.590311    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-util\") pod \"632d9324-4f2e-4d35-be0a-658b2c89d866\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") "
Jul 09 13:33:02.590364 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:02.590355    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bmnk\" (UniqueName: \"kubernetes.io/projected/632d9324-4f2e-4d35-be0a-658b2c89d866-kube-api-access-8bmnk\") pod \"632d9324-4f2e-4d35-be0a-658b2c89d866\" (UID: \"632d9324-4f2e-4d35-be0a-658b2c89d866\") "
Jul 09 13:33:02.590960 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:02.590921    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-bundle" (OuterVolumeSpecName: "bundle") pod "632d9324-4f2e-4d35-be0a-658b2c89d866" (UID: "632d9324-4f2e-4d35-be0a-658b2c89d866"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:33:02.592572 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:02.592546    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/632d9324-4f2e-4d35-be0a-658b2c89d866-kube-api-access-8bmnk" (OuterVolumeSpecName: "kube-api-access-8bmnk") pod "632d9324-4f2e-4d35-be0a-658b2c89d866" (UID: "632d9324-4f2e-4d35-be0a-658b2c89d866"). InnerVolumeSpecName "kube-api-access-8bmnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:33:02.595299 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:02.595264    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-util" (OuterVolumeSpecName: "util") pod "632d9324-4f2e-4d35-be0a-658b2c89d866" (UID: "632d9324-4f2e-4d35-be0a-658b2c89d866"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:33:02.691580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:02.691537    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bmnk\" (UniqueName: \"kubernetes.io/projected/632d9324-4f2e-4d35-be0a-658b2c89d866-kube-api-access-8bmnk\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:33:02.691580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:02.691572    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-bundle\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:33:02.691580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:02.691582    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/632d9324-4f2e-4d35-be0a-658b2c89d866-util\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:33:03.323802 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:03.323762    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b" event={"ID":"632d9324-4f2e-4d35-be0a-658b2c89d866","Type":"ContainerDied","Data":"9a84dc7285249fc635f2cbd5fbe4518bf5a013f7a1f93bbc79b148b474d745d5"}
Jul 09 13:33:03.323802 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:03.323788    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wg7b"
Jul 09 13:33:03.324021 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:03.323816    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a84dc7285249fc635f2cbd5fbe4518bf5a013f7a1f93bbc79b148b474d745d5"
Jul 09 13:33:07.847883 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:07.847843    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:09.282882 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.282847    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:09.835426 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.835388    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7"]
Jul 09 13:33:09.835768 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.835749    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="632d9324-4f2e-4d35-be0a-658b2c89d866" containerName="util"
Jul 09 13:33:09.835848 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.835771    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="632d9324-4f2e-4d35-be0a-658b2c89d866" containerName="util"
Jul 09 13:33:09.835848 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.835785    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="632d9324-4f2e-4d35-be0a-658b2c89d866" containerName="pull"
Jul 09 13:33:09.835848 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.835792    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="632d9324-4f2e-4d35-be0a-658b2c89d866" containerName="pull"
Jul 09 13:33:09.835848 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.835817    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="632d9324-4f2e-4d35-be0a-658b2c89d866" containerName="extract"
Jul 09 13:33:09.835848 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.835826    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="632d9324-4f2e-4d35-be0a-658b2c89d866" containerName="extract"
Jul 09 13:33:09.836081 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.835901    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="632d9324-4f2e-4d35-be0a-658b2c89d866" containerName="extract"
Jul 09 13:33:09.883963 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.883918    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7"]
Jul 09 13:33:09.884151 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.884036    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7"
Jul 09 13:33:09.887532 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.887507    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 13:33:09.887649 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.887511    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 13:33:09.887649 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:09.887508    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vzljq\""
Jul 09 13:33:10.055211 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:10.055174    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/044ef533-d90c-4b3e-a7c3-db4fb97077bc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jf9p7\" (UID: \"044ef533-d90c-4b3e-a7c3-db4fb97077bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7"
Jul 09 13:33:10.055426 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:10.055257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlxv2\" (UniqueName: \"kubernetes.io/projected/044ef533-d90c-4b3e-a7c3-db4fb97077bc-kube-api-access-qlxv2\") pod \"cert-manager-operator-controller-manager-55c444bf86-jf9p7\" (UID: \"044ef533-d90c-4b3e-a7c3-db4fb97077bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7"
Jul 09 13:33:10.156585 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:10.156484    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlxv2\" (UniqueName: \"kubernetes.io/projected/044ef533-d90c-4b3e-a7c3-db4fb97077bc-kube-api-access-qlxv2\") pod \"cert-manager-operator-controller-manager-55c444bf86-jf9p7\" (UID: \"044ef533-d90c-4b3e-a7c3-db4fb97077bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7"
Jul 09 13:33:10.156585 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:10.156573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/044ef533-d90c-4b3e-a7c3-db4fb97077bc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jf9p7\" (UID: \"044ef533-d90c-4b3e-a7c3-db4fb97077bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7"
Jul 09 13:33:10.156984 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:10.156964    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/044ef533-d90c-4b3e-a7c3-db4fb97077bc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jf9p7\" (UID: \"044ef533-d90c-4b3e-a7c3-db4fb97077bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7"
Jul 09 13:33:10.170345 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:10.170313    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlxv2\" (UniqueName: \"kubernetes.io/projected/044ef533-d90c-4b3e-a7c3-db4fb97077bc-kube-api-access-qlxv2\") pod \"cert-manager-operator-controller-manager-55c444bf86-jf9p7\" (UID: \"044ef533-d90c-4b3e-a7c3-db4fb97077bc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7"
Jul 09 13:33:10.193259 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:10.193222    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7"
Jul 09 13:33:10.350957 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:10.350923    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7"]
Jul 09 13:33:10.355183 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:33:10.355150    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044ef533_d90c_4b3e_a7c3_db4fb97077bc.slice/crio-7518ba59565d4b886a41f4664db4c03add411ae0eb482e8114da9157c4677708 WatchSource:0}: Error finding container 7518ba59565d4b886a41f4664db4c03add411ae0eb482e8114da9157c4677708: Status 404 returned error can't find the container with id 7518ba59565d4b886a41f4664db4c03add411ae0eb482e8114da9157c4677708
Jul 09 13:33:11.353351 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:11.353308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7" event={"ID":"044ef533-d90c-4b3e-a7c3-db4fb97077bc","Type":"ContainerStarted","Data":"7518ba59565d4b886a41f4664db4c03add411ae0eb482e8114da9157c4677708"}
Jul 09 13:33:11.614734 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:11.614630    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:11.715859 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:11.715810    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:13.300480 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:13.300441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:13.364878 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:13.364838    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7" event={"ID":"044ef533-d90c-4b3e-a7c3-db4fb97077bc","Type":"ContainerStarted","Data":"2d6b29edb0a9312c459b4d3e40983d4c7479f8e60b3dc3286bd7279bb9272095"}
Jul 09 13:33:13.391556 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:13.391502    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jf9p7" podStartSLOduration=2.380914582 podStartE2EDuration="4.391484498s" totalImagesPullingTime="2.010569916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:33:13.388759303 +0000 UTC m=+239.600749717" watchObservedRunningTime="2026-07-09 13:33:13.391484498 +0000 UTC m=+239.603474912"
Jul 09 13:33:13.395685 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:13.395653    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:13.824366 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:13.824331    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:13.920333 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:13.920296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:14.513101 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.513062    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"]
Jul 09 13:33:14.532802 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.532770    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"]
Jul 09 13:33:14.532941 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.532884    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:14.536174 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.536150    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6mlhc\""
Jul 09 13:33:14.536675 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.536657    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 13:33:14.537628 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.537606    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 13:33:14.696344 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.696274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:14.696521 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.696384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:14.696521 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.696498    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgz4s\" (UniqueName: \"kubernetes.io/projected/87dd1511-7267-4e57-80bf-fc247f59f366-kube-api-access-wgz4s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:14.797439 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.797352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgz4s\" (UniqueName: \"kubernetes.io/projected/87dd1511-7267-4e57-80bf-fc247f59f366-kube-api-access-wgz4s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:14.797439 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.797403    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:14.797601 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.797570    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:14.797741 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.797723    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:14.797941 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.797922    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:14.809417 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.809386    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgz4s\" (UniqueName: \"kubernetes.io/projected/87dd1511-7267-4e57-80bf-fc247f59f366-kube-api-access-wgz4s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:14.842412 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.842376    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:14.991304 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:14.991249    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"]
Jul 09 13:33:14.994202 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:33:14.994170    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87dd1511_7267_4e57_80bf_fc247f59f366.slice/crio-7e808402e53ac9357bd8401a62ca710bcae23d13266304aaab66ee9e7fd62a99 WatchSource:0}: Error finding container 7e808402e53ac9357bd8401a62ca710bcae23d13266304aaab66ee9e7fd62a99: Status 404 returned error can't find the container with id 7e808402e53ac9357bd8401a62ca710bcae23d13266304aaab66ee9e7fd62a99
Jul 09 13:33:15.373963 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:15.373924    2583 generic.go:356] "Generic (PLEG): container finished" podID="87dd1511-7267-4e57-80bf-fc247f59f366" containerID="1ff5e8fb1044625c5844df04571d0dce03c53918a4158007e54e72f5f5a58dc3" exitCode=0
Jul 09 13:33:15.374181 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:15.374007    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf" event={"ID":"87dd1511-7267-4e57-80bf-fc247f59f366","Type":"ContainerDied","Data":"1ff5e8fb1044625c5844df04571d0dce03c53918a4158007e54e72f5f5a58dc3"}
Jul 09 13:33:15.374181 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:15.374053    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf" event={"ID":"87dd1511-7267-4e57-80bf-fc247f59f366","Type":"ContainerStarted","Data":"7e808402e53ac9357bd8401a62ca710bcae23d13266304aaab66ee9e7fd62a99"}
Jul 09 13:33:15.590604 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:15.590557    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:15.710466 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:15.710371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:15.943165 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:15.943121    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5msz7"]
Jul 09 13:33:15.960948 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:15.960871    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5msz7"]
Jul 09 13:33:15.961142 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:15.960984    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5msz7"
Jul 09 13:33:15.963905 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:15.963879    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 13:33:15.964087 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:15.964073    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 13:33:15.964186 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:15.964166    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6h2v7\""
Jul 09 13:33:16.107957 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:16.107920    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s65j\" (UniqueName: \"kubernetes.io/projected/c790e752-afee-4b31-897e-22a6399dcfd5-kube-api-access-6s65j\") pod \"cert-manager-cainjector-559cdd8c87-5msz7\" (UID: \"c790e752-afee-4b31-897e-22a6399dcfd5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5msz7"
Jul 09 13:33:16.108139 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:16.107983    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c790e752-afee-4b31-897e-22a6399dcfd5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5msz7\" (UID: \"c790e752-afee-4b31-897e-22a6399dcfd5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5msz7"
Jul 09 13:33:16.209247 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:16.209215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c790e752-afee-4b31-897e-22a6399dcfd5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5msz7\" (UID: \"c790e752-afee-4b31-897e-22a6399dcfd5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5msz7"
Jul 09 13:33:16.209430 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:16.209312    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s65j\" (UniqueName: \"kubernetes.io/projected/c790e752-afee-4b31-897e-22a6399dcfd5-kube-api-access-6s65j\") pod \"cert-manager-cainjector-559cdd8c87-5msz7\" (UID: \"c790e752-afee-4b31-897e-22a6399dcfd5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5msz7"
Jul 09 13:33:16.219384 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:16.219308    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c790e752-afee-4b31-897e-22a6399dcfd5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5msz7\" (UID: \"c790e752-afee-4b31-897e-22a6399dcfd5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5msz7"
Jul 09 13:33:16.219512 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:16.219471    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s65j\" (UniqueName: \"kubernetes.io/projected/c790e752-afee-4b31-897e-22a6399dcfd5-kube-api-access-6s65j\") pod \"cert-manager-cainjector-559cdd8c87-5msz7\" (UID: \"c790e752-afee-4b31-897e-22a6399dcfd5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5msz7"
Jul 09 13:33:16.286475 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:16.286425    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5msz7"
Jul 09 13:33:16.440571 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:16.440455    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5msz7"]
Jul 09 13:33:16.443021 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:33:16.442995    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc790e752_afee_4b31_897e_22a6399dcfd5.slice/crio-ba589fcf27395329142b589ed99fcaeb53ae219e960895aa2802bb322d70650a WatchSource:0}: Error finding container ba589fcf27395329142b589ed99fcaeb53ae219e960895aa2802bb322d70650a: Status 404 returned error can't find the container with id ba589fcf27395329142b589ed99fcaeb53ae219e960895aa2802bb322d70650a
Jul 09 13:33:17.385282 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:17.385242    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5msz7" event={"ID":"c790e752-afee-4b31-897e-22a6399dcfd5","Type":"ContainerStarted","Data":"ba589fcf27395329142b589ed99fcaeb53ae219e960895aa2802bb322d70650a"}
Jul 09 13:33:18.253774 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:18.253739    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:18.313798 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:18.313761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:20.402598 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:20.402553    2583 generic.go:356] "Generic (PLEG): container finished" podID="87dd1511-7267-4e57-80bf-fc247f59f366" containerID="2a094180f3cf8c6b17c3baf899241bac5c316733ad6e5f7769afa23810d1e58d" exitCode=0
Jul 09 13:33:20.403074 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:20.402634    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf" event={"ID":"87dd1511-7267-4e57-80bf-fc247f59f366","Type":"ContainerDied","Data":"2a094180f3cf8c6b17c3baf899241bac5c316733ad6e5f7769afa23810d1e58d"}
Jul 09 13:33:20.404430 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:20.404409    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5msz7" event={"ID":"c790e752-afee-4b31-897e-22a6399dcfd5","Type":"ContainerStarted","Data":"adfb28a78a448e10bb4f5ddc6e73998f6e389ab40d4637ac41ae5197b6509eb6"}
Jul 09 13:33:20.449455 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:20.449410    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5msz7" podStartSLOduration=2.255996868 podStartE2EDuration="5.449393017s" totalImagesPullingTime="3.193396149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:33:20.448530559 +0000 UTC m=+246.660520975" watchObservedRunningTime="2026-07-09 13:33:20.449393017 +0000 UTC m=+246.661383432"
Jul 09 13:33:21.410703 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:21.410664    2583 generic.go:356] "Generic (PLEG): container finished" podID="87dd1511-7267-4e57-80bf-fc247f59f366" containerID="247b3b3fc484a2211c68595f47817b5e29e80434469239766f6d823adc5f1320" exitCode=0
Jul 09 13:33:21.411194 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:21.410749    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf" event={"ID":"87dd1511-7267-4e57-80bf-fc247f59f366","Type":"ContainerDied","Data":"247b3b3fc484a2211c68595f47817b5e29e80434469239766f6d823adc5f1320"}
Jul 09 13:33:22.539879 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:22.539852    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:22.567960 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:22.567385    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-bundle\") pod \"87dd1511-7267-4e57-80bf-fc247f59f366\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") "
Jul 09 13:33:22.567960 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:22.567453    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgz4s\" (UniqueName: \"kubernetes.io/projected/87dd1511-7267-4e57-80bf-fc247f59f366-kube-api-access-wgz4s\") pod \"87dd1511-7267-4e57-80bf-fc247f59f366\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") "
Jul 09 13:33:22.567960 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:22.567497    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-util\") pod \"87dd1511-7267-4e57-80bf-fc247f59f366\" (UID: \"87dd1511-7267-4e57-80bf-fc247f59f366\") "
Jul 09 13:33:22.569596 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:22.568831    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-bundle" (OuterVolumeSpecName: "bundle") pod "87dd1511-7267-4e57-80bf-fc247f59f366" (UID: "87dd1511-7267-4e57-80bf-fc247f59f366"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:33:22.571181 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:22.571148    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87dd1511-7267-4e57-80bf-fc247f59f366-kube-api-access-wgz4s" (OuterVolumeSpecName: "kube-api-access-wgz4s") pod "87dd1511-7267-4e57-80bf-fc247f59f366" (UID: "87dd1511-7267-4e57-80bf-fc247f59f366"). InnerVolumeSpecName "kube-api-access-wgz4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:33:22.573521 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:22.573482    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-util" (OuterVolumeSpecName: "util") pod "87dd1511-7267-4e57-80bf-fc247f59f366" (UID: "87dd1511-7267-4e57-80bf-fc247f59f366"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:33:22.668401 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:22.668308    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgz4s\" (UniqueName: \"kubernetes.io/projected/87dd1511-7267-4e57-80bf-fc247f59f366-kube-api-access-wgz4s\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:33:22.668401 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:22.668341    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-util\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:33:22.668401 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:22.668352    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87dd1511-7267-4e57-80bf-fc247f59f366-bundle\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:33:23.419881 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:23.419853    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf"
Jul 09 13:33:23.420093 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:23.419843    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkw4cf" event={"ID":"87dd1511-7267-4e57-80bf-fc247f59f366","Type":"ContainerDied","Data":"7e808402e53ac9357bd8401a62ca710bcae23d13266304aaab66ee9e7fd62a99"}
Jul 09 13:33:23.420093 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:23.419991    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e808402e53ac9357bd8401a62ca710bcae23d13266304aaab66ee9e7fd62a99"
Jul 09 13:33:23.911049 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:23.911017    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:24.585809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.585768    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7t77w"]
Jul 09 13:33:24.586067 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.586052    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87dd1511-7267-4e57-80bf-fc247f59f366" containerName="extract"
Jul 09 13:33:24.586110 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.586068    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="87dd1511-7267-4e57-80bf-fc247f59f366" containerName="extract"
Jul 09 13:33:24.586110 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.586086    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87dd1511-7267-4e57-80bf-fc247f59f366" containerName="pull"
Jul 09 13:33:24.586110 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.586092    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="87dd1511-7267-4e57-80bf-fc247f59f366" containerName="pull"
Jul 09 13:33:24.586110 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.586103    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87dd1511-7267-4e57-80bf-fc247f59f366" containerName="util"
Jul 09 13:33:24.586110 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.586108    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="87dd1511-7267-4e57-80bf-fc247f59f366" containerName="util"
Jul 09 13:33:24.586265 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.586174    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="87dd1511-7267-4e57-80bf-fc247f59f366" containerName="extract"
Jul 09 13:33:24.588251 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.588232    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7t77w"
Jul 09 13:33:24.590918 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.590896    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mb7cj\""
Jul 09 13:33:24.598179 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.598135    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7t77w"]
Jul 09 13:33:24.682530 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.682476    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2skv\" (UniqueName: \"kubernetes.io/projected/775ec02b-6648-489f-ba36-fe8a483c9c5f-kube-api-access-g2skv\") pod \"cert-manager-55b4d954d5-7t77w\" (UID: \"775ec02b-6648-489f-ba36-fe8a483c9c5f\") " pod="cert-manager/cert-manager-55b4d954d5-7t77w"
Jul 09 13:33:24.682713 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.682560    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/775ec02b-6648-489f-ba36-fe8a483c9c5f-bound-sa-token\") pod \"cert-manager-55b4d954d5-7t77w\" (UID: \"775ec02b-6648-489f-ba36-fe8a483c9c5f\") " pod="cert-manager/cert-manager-55b4d954d5-7t77w"
Jul 09 13:33:24.783063 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.783021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2skv\" (UniqueName: \"kubernetes.io/projected/775ec02b-6648-489f-ba36-fe8a483c9c5f-kube-api-access-g2skv\") pod \"cert-manager-55b4d954d5-7t77w\" (UID: \"775ec02b-6648-489f-ba36-fe8a483c9c5f\") " pod="cert-manager/cert-manager-55b4d954d5-7t77w"
Jul 09 13:33:24.783063 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.783064    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/775ec02b-6648-489f-ba36-fe8a483c9c5f-bound-sa-token\") pod \"cert-manager-55b4d954d5-7t77w\" (UID: \"775ec02b-6648-489f-ba36-fe8a483c9c5f\") " pod="cert-manager/cert-manager-55b4d954d5-7t77w"
Jul 09 13:33:24.792723 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.792686    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/775ec02b-6648-489f-ba36-fe8a483c9c5f-bound-sa-token\") pod \"cert-manager-55b4d954d5-7t77w\" (UID: \"775ec02b-6648-489f-ba36-fe8a483c9c5f\") " pod="cert-manager/cert-manager-55b4d954d5-7t77w"
Jul 09 13:33:24.792849 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.792750    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2skv\" (UniqueName: \"kubernetes.io/projected/775ec02b-6648-489f-ba36-fe8a483c9c5f-kube-api-access-g2skv\") pod \"cert-manager-55b4d954d5-7t77w\" (UID: \"775ec02b-6648-489f-ba36-fe8a483c9c5f\") " pod="cert-manager/cert-manager-55b4d954d5-7t77w"
Jul 09 13:33:24.898751 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:24.898670    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7t77w"
Jul 09 13:33:25.028082 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:25.028059    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7t77w"]
Jul 09 13:33:25.030822 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:33:25.030791    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod775ec02b_6648_489f_ba36_fe8a483c9c5f.slice/crio-0f628dbca4bb1f67c33560d71eae6088c9cfacf15701d3313b4331b5bd991d80 WatchSource:0}: Error finding container 0f628dbca4bb1f67c33560d71eae6088c9cfacf15701d3313b4331b5bd991d80: Status 404 returned error can't find the container with id 0f628dbca4bb1f67c33560d71eae6088c9cfacf15701d3313b4331b5bd991d80
Jul 09 13:33:25.429635 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:25.429595    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7t77w" event={"ID":"775ec02b-6648-489f-ba36-fe8a483c9c5f","Type":"ContainerStarted","Data":"0999b47f481fcfe4cebf0d414b097cb8b7e6fe0e36295b0ea9f820b9937c9102"}
Jul 09 13:33:25.429635 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:25.429642    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7t77w" event={"ID":"775ec02b-6648-489f-ba36-fe8a483c9c5f","Type":"ContainerStarted","Data":"0f628dbca4bb1f67c33560d71eae6088c9cfacf15701d3313b4331b5bd991d80"}
Jul 09 13:33:25.449282 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:25.449225    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-7t77w" podStartSLOduration=1.44920796 podStartE2EDuration="1.44920796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:33:25.447616835 +0000 UTC m=+251.659607252" watchObservedRunningTime="2026-07-09 13:33:25.44920796 +0000 UTC m=+251.661198376"
Jul 09 13:33:25.600819 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:25.600776    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:25.701892 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:25.701804    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:30.255469 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:30.255427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:30.357405 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:30.357362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:31.165627 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:31.165589    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:36.914912 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:36.914816    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:37.005978 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:37.005942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:39.056884 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.056844    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:39.751257 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.751223    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"]
Jul 09 13:33:39.753417 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.753400    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:39.756460 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.756433    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 13:33:39.756569 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.756440    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6mlhc\""
Jul 09 13:33:39.757738 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.757710    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 13:33:39.764409 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.764386    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"]
Jul 09 13:33:39.794138 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.794104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:39.794332 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.794143    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:39.794332 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.794214    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq2tf\" (UniqueName: \"kubernetes.io/projected/cb85aa57-f125-46e5-927e-60d6a5447871-kube-api-access-cq2tf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:39.895239 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.895196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq2tf\" (UniqueName: \"kubernetes.io/projected/cb85aa57-f125-46e5-927e-60d6a5447871-kube-api-access-cq2tf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:39.895455 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.895266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:39.895455 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.895323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:39.895760 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.895737    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:39.895798 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.895750    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:39.905402 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:39.905374    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq2tf\" (UniqueName: \"kubernetes.io/projected/cb85aa57-f125-46e5-927e-60d6a5447871-kube-api-access-cq2tf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:40.062872 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:40.062780    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:40.197606 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:40.197581    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"]
Jul 09 13:33:40.200131 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:33:40.200098    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb85aa57_f125_46e5_927e_60d6a5447871.slice/crio-ccfaa5505a7854fe12dca01d3cac4835211dd795a48e67afe39cfa406b4e5f53 WatchSource:0}: Error finding container ccfaa5505a7854fe12dca01d3cac4835211dd795a48e67afe39cfa406b4e5f53: Status 404 returned error can't find the container with id ccfaa5505a7854fe12dca01d3cac4835211dd795a48e67afe39cfa406b4e5f53
Jul 09 13:33:40.492999 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:40.492964    2583 generic.go:356] "Generic (PLEG): container finished" podID="cb85aa57-f125-46e5-927e-60d6a5447871" containerID="e039fc6677b0b8c6db005619df05702834f65935854a1b215cbb62715fba15a6" exitCode=0
Jul 09 13:33:40.493183 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:40.493010    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w" event={"ID":"cb85aa57-f125-46e5-927e-60d6a5447871","Type":"ContainerDied","Data":"e039fc6677b0b8c6db005619df05702834f65935854a1b215cbb62715fba15a6"}
Jul 09 13:33:40.493183 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:40.493045    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w" event={"ID":"cb85aa57-f125-46e5-927e-60d6a5447871","Type":"ContainerStarted","Data":"ccfaa5505a7854fe12dca01d3cac4835211dd795a48e67afe39cfa406b4e5f53"}
Jul 09 13:33:41.499094 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:41.499054    2583 generic.go:356] "Generic (PLEG): container finished" podID="cb85aa57-f125-46e5-927e-60d6a5447871" containerID="523d0ad403ff51c6f2b605d21bd3340f1c698ab0cf2cf9e66241a5dc1172cf87" exitCode=0
Jul 09 13:33:41.499548 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:41.499137    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w" event={"ID":"cb85aa57-f125-46e5-927e-60d6a5447871","Type":"ContainerDied","Data":"523d0ad403ff51c6f2b605d21bd3340f1c698ab0cf2cf9e66241a5dc1172cf87"}
Jul 09 13:33:42.505705 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:42.505673    2583 generic.go:356] "Generic (PLEG): container finished" podID="cb85aa57-f125-46e5-927e-60d6a5447871" containerID="599ffbf14d65e4c2ce48b827f1365bce03ea99b42e21e91fd8e349a68199d254" exitCode=0
Jul 09 13:33:42.506112 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:42.505718    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w" event={"ID":"cb85aa57-f125-46e5-927e-60d6a5447871","Type":"ContainerDied","Data":"599ffbf14d65e4c2ce48b827f1365bce03ea99b42e21e91fd8e349a68199d254"}
Jul 09 13:33:43.641820 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:43.641792    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:43.725436 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:43.725396    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-bundle\") pod \"cb85aa57-f125-46e5-927e-60d6a5447871\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") "
Jul 09 13:33:43.725606 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:43.725450    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq2tf\" (UniqueName: \"kubernetes.io/projected/cb85aa57-f125-46e5-927e-60d6a5447871-kube-api-access-cq2tf\") pod \"cb85aa57-f125-46e5-927e-60d6a5447871\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") "
Jul 09 13:33:43.725606 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:43.725485    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-util\") pod \"cb85aa57-f125-46e5-927e-60d6a5447871\" (UID: \"cb85aa57-f125-46e5-927e-60d6a5447871\") "
Jul 09 13:33:43.726112 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:43.726084    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-bundle" (OuterVolumeSpecName: "bundle") pod "cb85aa57-f125-46e5-927e-60d6a5447871" (UID: "cb85aa57-f125-46e5-927e-60d6a5447871"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:33:43.727605 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:43.727579    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb85aa57-f125-46e5-927e-60d6a5447871-kube-api-access-cq2tf" (OuterVolumeSpecName: "kube-api-access-cq2tf") pod "cb85aa57-f125-46e5-927e-60d6a5447871" (UID: "cb85aa57-f125-46e5-927e-60d6a5447871"). InnerVolumeSpecName "kube-api-access-cq2tf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:33:43.731070 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:43.731043    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-util" (OuterVolumeSpecName: "util") pod "cb85aa57-f125-46e5-927e-60d6a5447871" (UID: "cb85aa57-f125-46e5-927e-60d6a5447871"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:33:43.826227 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:43.826194    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-bundle\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:33:43.826227 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:43.826221    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq2tf\" (UniqueName: \"kubernetes.io/projected/cb85aa57-f125-46e5-927e-60d6a5447871-kube-api-access-cq2tf\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:33:43.826227 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:43.826230    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb85aa57-f125-46e5-927e-60d6a5447871-util\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:33:44.515589 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:44.515555    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w" event={"ID":"cb85aa57-f125-46e5-927e-60d6a5447871","Type":"ContainerDied","Data":"ccfaa5505a7854fe12dca01d3cac4835211dd795a48e67afe39cfa406b4e5f53"}
Jul 09 13:33:44.515786 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:44.515617    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccfaa5505a7854fe12dca01d3cac4835211dd795a48e67afe39cfa406b4e5f53"
Jul 09 13:33:44.515786 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:44.515568    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl8g8w"
Jul 09 13:33:48.766151 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:48.766113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:50.875469 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:50.875425    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:50.977378 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:50.977341    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:51.482161 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.482117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:51.722706 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.722666    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:51.825606 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.825576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:51.870758 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.870723    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"]
Jul 09 13:33:51.871033 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.871022    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb85aa57-f125-46e5-927e-60d6a5447871" containerName="extract"
Jul 09 13:33:51.871079 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.871035    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb85aa57-f125-46e5-927e-60d6a5447871" containerName="extract"
Jul 09 13:33:51.871079 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.871061    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb85aa57-f125-46e5-927e-60d6a5447871" containerName="pull"
Jul 09 13:33:51.871079 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.871067    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb85aa57-f125-46e5-927e-60d6a5447871" containerName="pull"
Jul 09 13:33:51.871079 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.871072    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb85aa57-f125-46e5-927e-60d6a5447871" containerName="util"
Jul 09 13:33:51.871079 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.871078    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb85aa57-f125-46e5-927e-60d6a5447871" containerName="util"
Jul 09 13:33:51.871330 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.871145    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb85aa57-f125-46e5-927e-60d6a5447871" containerName="extract"
Jul 09 13:33:51.875479 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.875459    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:51.879031 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.879007    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 13:33:51.879520 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.879504    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 13:33:51.879796 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.879778    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ts6jb\""
Jul 09 13:33:51.880088 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.880075    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 13:33:51.880128 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.880076    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 13:33:51.887469 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.887440    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"]
Jul 09 13:33:51.990649 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.990607    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-tmp\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:51.990649 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.990649    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-manifests\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:51.990861 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.990680    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:51.990861 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.990758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdwf6\" (UniqueName: \"kubernetes.io/projected/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-kube-api-access-rdwf6\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:51.990861 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:51.990798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.008954 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.008921    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:52.092185 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.092085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-tmp\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.092185 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.092130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-manifests\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.092185 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.092158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.092514 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.092306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdwf6\" (UniqueName: \"kubernetes.io/projected/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-kube-api-access-rdwf6\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.092514 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.092375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.092642 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.092621    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-manifests\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.094691 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.094660    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-tmp\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.094848 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.094831    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.094890 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.094873    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-webhook-cert\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.102480 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.102455    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdwf6\" (UniqueName: \"kubernetes.io/projected/3f7e01ed-38a7-4bb2-a4df-faad63d17b65-kube-api-access-rdwf6\") pod \"opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm\" (UID: \"3f7e01ed-38a7-4bb2-a4df-faad63d17b65\") " pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.110140 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.110113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:52.186020 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.185986    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:52.208717 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.208678    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:52.309856 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.309811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:52.328072 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.328047    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"]
Jul 09 13:33:52.330665 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:33:52.330637    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7e01ed_38a7_4bb2_a4df_faad63d17b65.slice/crio-b71d2da336182b3ac0916835efae5fb574ddb6a0a723ec526d77babf8607812d WatchSource:0}: Error finding container b71d2da336182b3ac0916835efae5fb574ddb6a0a723ec526d77babf8607812d: Status 404 returned error can't find the container with id b71d2da336182b3ac0916835efae5fb574ddb6a0a723ec526d77babf8607812d
Jul 09 13:33:52.380861 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.380753    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:52.482964 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.482924    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:52.552140 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.552107    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm" event={"ID":"3f7e01ed-38a7-4bb2-a4df-faad63d17b65","Type":"ContainerStarted","Data":"b71d2da336182b3ac0916835efae5fb574ddb6a0a723ec526d77babf8607812d"}
Jul 09 13:33:52.581611 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:52.581572    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:55.351154 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:55.351123    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:55.449753 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:55.449711    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:33:55.571268 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:55.571231    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm" event={"ID":"3f7e01ed-38a7-4bb2-a4df-faad63d17b65","Type":"ContainerStarted","Data":"693b3497ad6d1b5ae72df171a8ef4c27fb6d66a2325a05853740d00cf8039f0a"}
Jul 09 13:33:57.582346 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:57.582309    2583 generic.go:356] "Generic (PLEG): container finished" podID="3f7e01ed-38a7-4bb2-a4df-faad63d17b65" containerID="693b3497ad6d1b5ae72df171a8ef4c27fb6d66a2325a05853740d00cf8039f0a" exitCode=0
Jul 09 13:33:57.582799 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:57.582314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm" event={"ID":"3f7e01ed-38a7-4bb2-a4df-faad63d17b65","Type":"ContainerDied","Data":"693b3497ad6d1b5ae72df171a8ef4c27fb6d66a2325a05853740d00cf8039f0a"}
Jul 09 13:33:58.588781 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:58.588737    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm" event={"ID":"3f7e01ed-38a7-4bb2-a4df-faad63d17b65","Type":"ContainerStarted","Data":"34de7ec220a451a317da3cc42cf1d45fa4b50eab824cc2ed8e50bff6480663bf"}
Jul 09 13:33:58.589228 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:58.588954    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:33:58.614995 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:33:58.614935    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm" podStartSLOduration=3.081583908 podStartE2EDuration="7.614917052s" totalImagesPullingTime="3.351478378s" totalInitContainerRuntime="1.181854766s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:33:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:33:58.612197561 +0000 UTC m=+284.824187977" watchObservedRunningTime="2026-07-09 13:33:58.614917052 +0000 UTC m=+284.826907466"
Jul 09 13:34:09.595027 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:09.594996    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm"
Jul 09 13:34:11.298798 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:11.298761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:11.430531 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:11.430487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:11.775985 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:11.775954    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:11.961877 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:11.961834    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:12.038645 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.038560    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"]
Jul 09 13:34:12.041645 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.041628    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"
Jul 09 13:34:12.046651 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.046621    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 13:34:12.046787 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.046649    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9szxb\""
Jul 09 13:34:12.046787 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.046649    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 13:34:12.053561 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.053532    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"]
Jul 09 13:34:12.161960 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.161914    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/092483ae-8d38-4d82-98da-3d558bd93d69-tmp\") pod \"kube-auth-proxy-7b96d9fb58-s67nh\" (UID: \"092483ae-8d38-4d82-98da-3d558bd93d69\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"
Jul 09 13:34:12.162134 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.162014    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/092483ae-8d38-4d82-98da-3d558bd93d69-tls-certs\") pod \"kube-auth-proxy-7b96d9fb58-s67nh\" (UID: \"092483ae-8d38-4d82-98da-3d558bd93d69\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"
Jul 09 13:34:12.162134 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.162064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln26f\" (UniqueName: \"kubernetes.io/projected/092483ae-8d38-4d82-98da-3d558bd93d69-kube-api-access-ln26f\") pod \"kube-auth-proxy-7b96d9fb58-s67nh\" (UID: \"092483ae-8d38-4d82-98da-3d558bd93d69\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"
Jul 09 13:34:12.212498 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.212466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:12.262640 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.262595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/092483ae-8d38-4d82-98da-3d558bd93d69-tls-certs\") pod \"kube-auth-proxy-7b96d9fb58-s67nh\" (UID: \"092483ae-8d38-4d82-98da-3d558bd93d69\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"
Jul 09 13:34:12.262823 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.262648    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln26f\" (UniqueName: \"kubernetes.io/projected/092483ae-8d38-4d82-98da-3d558bd93d69-kube-api-access-ln26f\") pod \"kube-auth-proxy-7b96d9fb58-s67nh\" (UID: \"092483ae-8d38-4d82-98da-3d558bd93d69\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"
Jul 09 13:34:12.262823 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.262670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/092483ae-8d38-4d82-98da-3d558bd93d69-tmp\") pod \"kube-auth-proxy-7b96d9fb58-s67nh\" (UID: \"092483ae-8d38-4d82-98da-3d558bd93d69\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"
Jul 09 13:34:12.264953 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.264916    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/092483ae-8d38-4d82-98da-3d558bd93d69-tmp\") pod \"kube-auth-proxy-7b96d9fb58-s67nh\" (UID: \"092483ae-8d38-4d82-98da-3d558bd93d69\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"
Jul 09 13:34:12.265141 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.265124    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/092483ae-8d38-4d82-98da-3d558bd93d69-tls-certs\") pod \"kube-auth-proxy-7b96d9fb58-s67nh\" (UID: \"092483ae-8d38-4d82-98da-3d558bd93d69\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"
Jul 09 13:34:12.285505 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.285469    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln26f\" (UniqueName: \"kubernetes.io/projected/092483ae-8d38-4d82-98da-3d558bd93d69-kube-api-access-ln26f\") pod \"kube-auth-proxy-7b96d9fb58-s67nh\" (UID: \"092483ae-8d38-4d82-98da-3d558bd93d69\") " pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"
Jul 09 13:34:12.321553 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.321516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:12.351975 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.351944    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"
Jul 09 13:34:12.422651 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.422615    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:12.500377 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.500309    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh"]
Jul 09 13:34:12.503198 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:34:12.503170    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092483ae_8d38_4d82_98da_3d558bd93d69.slice/crio-aa94d40a38d1e6510f1d82fcbd70d2a4792e79177681ffb096b516f43f5faeba WatchSource:0}: Error finding container aa94d40a38d1e6510f1d82fcbd70d2a4792e79177681ffb096b516f43f5faeba: Status 404 returned error can't find the container with id aa94d40a38d1e6510f1d82fcbd70d2a4792e79177681ffb096b516f43f5faeba
Jul 09 13:34:12.649115 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.649026    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh" event={"ID":"092483ae-8d38-4d82-98da-3d558bd93d69","Type":"ContainerStarted","Data":"aa94d40a38d1e6510f1d82fcbd70d2a4792e79177681ffb096b516f43f5faeba"}
Jul 09 13:34:12.919068 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:12.918971    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:13.160549 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.160514    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ph8qg"]
Jul 09 13:34:13.164831 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.164812    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg"
Jul 09 13:34:13.171249 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.171189    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 13:34:13.175690 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.175667    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ph8qg"]
Jul 09 13:34:13.179476 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.179447    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:13.271185 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.271154    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b5baa7-61dd-4739-b8cd-be09a44f2d10-tls-certs\") pod \"model-serving-api-54d89bd5fc-ph8qg\" (UID: \"79b5baa7-61dd-4739-b8cd-be09a44f2d10\") " pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg"
Jul 09 13:34:13.271403 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.271208    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjxm9\" (UniqueName: \"kubernetes.io/projected/79b5baa7-61dd-4739-b8cd-be09a44f2d10-kube-api-access-hjxm9\") pod \"model-serving-api-54d89bd5fc-ph8qg\" (UID: \"79b5baa7-61dd-4739-b8cd-be09a44f2d10\") " pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg"
Jul 09 13:34:13.372740 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.372698    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjxm9\" (UniqueName: \"kubernetes.io/projected/79b5baa7-61dd-4739-b8cd-be09a44f2d10-kube-api-access-hjxm9\") pod \"model-serving-api-54d89bd5fc-ph8qg\" (UID: \"79b5baa7-61dd-4739-b8cd-be09a44f2d10\") " pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg"
Jul 09 13:34:13.373247 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.372821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b5baa7-61dd-4739-b8cd-be09a44f2d10-tls-certs\") pod \"model-serving-api-54d89bd5fc-ph8qg\" (UID: \"79b5baa7-61dd-4739-b8cd-be09a44f2d10\") " pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg"
Jul 09 13:34:13.373247 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:34:13.372915    2583 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 09 13:34:13.373247 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:34:13.372975    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79b5baa7-61dd-4739-b8cd-be09a44f2d10-tls-certs podName:79b5baa7-61dd-4739-b8cd-be09a44f2d10 nodeName:}" failed. No retries permitted until 2026-07-09 13:34:13.872952829 +0000 UTC m=+300.084943224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/79b5baa7-61dd-4739-b8cd-be09a44f2d10-tls-certs") pod "model-serving-api-54d89bd5fc-ph8qg" (UID: "79b5baa7-61dd-4739-b8cd-be09a44f2d10") : secret "model-serving-api-tls" not found
Jul 09 13:34:13.385994 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.385970    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjxm9\" (UniqueName: \"kubernetes.io/projected/79b5baa7-61dd-4739-b8cd-be09a44f2d10-kube-api-access-hjxm9\") pod \"model-serving-api-54d89bd5fc-ph8qg\" (UID: \"79b5baa7-61dd-4739-b8cd-be09a44f2d10\") " pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg"
Jul 09 13:34:13.827993 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.827941    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:13.845728 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.845696    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"]
Jul 09 13:34:13.849062 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.849032    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:13.852330 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.852304    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 13:34:13.852562 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.852543    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 13:34:13.852651 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.852553    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 13:34:13.852651 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.852553    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 13:34:13.852897 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.852883    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-d54nv\""
Jul 09 13:34:13.866950 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.866923    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"]
Jul 09 13:34:13.878404 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.878349    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b5baa7-61dd-4739-b8cd-be09a44f2d10-tls-certs\") pod \"model-serving-api-54d89bd5fc-ph8qg\" (UID: \"79b5baa7-61dd-4739-b8cd-be09a44f2d10\") " pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg"
Jul 09 13:34:13.881202 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.881178    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79b5baa7-61dd-4739-b8cd-be09a44f2d10-tls-certs\") pod \"model-serving-api-54d89bd5fc-ph8qg\" (UID: \"79b5baa7-61dd-4739-b8cd-be09a44f2d10\") " pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg"
Jul 09 13:34:13.918139 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.918100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:13.979231 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.979170    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-local-certs\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:13.979231 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.979232    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:13.979506 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.979326    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-cacerts\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:13.979506 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.979390    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfwpc\" (UniqueName: \"kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-kube-api-access-qfwpc\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:13.979506 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.979418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:13.979506 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.979462    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-token\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:13.979656 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:13.979516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.075976 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.075940    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg"
Jul 09 13:34:14.080346 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.080309    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-token\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.080473 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.080380    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.080473 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.080417    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-local-certs\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.080473 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.080442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.080650 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.080480    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-cacerts\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.080650 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.080530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfwpc\" (UniqueName: \"kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-kube-api-access-qfwpc\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.080650 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.080563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.081274 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.081224    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.083767 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.083739    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.083880 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.083790    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-local-certs\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.084131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.084107    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-cacerts\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.084223 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.084125    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.092058 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.092030    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-token\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.092357 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.092327    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfwpc\" (UniqueName: \"kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-kube-api-access-qfwpc\") pod \"istiod-openshift-gateway-7574459656-hb9cs\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.163862 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.163828    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-d54nv\""
Jul 09 13:34:14.170573 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.170392    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:14.213565 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.213342    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:34:14.213755 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.213712    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:34:14.225990 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.225835    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 13:34:14.245481 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.245381    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ph8qg"]
Jul 09 13:34:14.246093 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:34:14.246064    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b5baa7_61dd_4739_b8cd_be09a44f2d10.slice/crio-cc7a9cc20dd1f0a1aa439cd6ffff25acf239d3e84127c627c4ce848a431e1096 WatchSource:0}: Error finding container cc7a9cc20dd1f0a1aa439cd6ffff25acf239d3e84127c627c4ce848a431e1096: Status 404 returned error can't find the container with id cc7a9cc20dd1f0a1aa439cd6ffff25acf239d3e84127c627c4ce848a431e1096
Jul 09 13:34:14.352169 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.352133    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"]
Jul 09 13:34:14.354923 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:34:14.354885    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc136eddf_a594_4a6f_9ad0_c9a6a85ec9d9.slice/crio-fd1cedbe3de323035975fb34dd226933696229464ba20bb04c160ee8b96ec72e WatchSource:0}: Error finding container fd1cedbe3de323035975fb34dd226933696229464ba20bb04c160ee8b96ec72e: Status 404 returned error can't find the container with id fd1cedbe3de323035975fb34dd226933696229464ba20bb04c160ee8b96ec72e
Jul 09 13:34:14.659135 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.659034    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs" event={"ID":"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9","Type":"ContainerStarted","Data":"fd1cedbe3de323035975fb34dd226933696229464ba20bb04c160ee8b96ec72e"}
Jul 09 13:34:14.660192 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:14.660172    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg" event={"ID":"79b5baa7-61dd-4739-b8cd-be09a44f2d10","Type":"ContainerStarted","Data":"cc7a9cc20dd1f0a1aa439cd6ffff25acf239d3e84127c627c4ce848a431e1096"}
Jul 09 13:34:15.020886 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:15.020794    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:17.215581 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.215533    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 13:34:17.215872 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.215630    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 13:34:17.216415 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.216391    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 13:34:17.680049 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.680010    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh" event={"ID":"092483ae-8d38-4d82-98da-3d558bd93d69","Type":"ContainerStarted","Data":"b893ec3de3d4e71a97edc819f6b73605d1af3fcd6abfb9bb6d2d9e4e4eb2b97c"}
Jul 09 13:34:17.681683 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.681652    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs" event={"ID":"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9","Type":"ContainerStarted","Data":"b241f89159dbbd719d7a40046a0666b228e0427dc5154f26e30b8dc1472b14fa"}
Jul 09 13:34:17.681830 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.681704    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:17.683175 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.683149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg" event={"ID":"79b5baa7-61dd-4739-b8cd-be09a44f2d10","Type":"ContainerStarted","Data":"b4fd5a0c310684e625f446ef86fc369dde9567022c9634fb30ae80f39844432d"}
Jul 09 13:34:17.683282 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.683231    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg"
Jul 09 13:34:17.704919 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.704866    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b96d9fb58-s67nh" podStartSLOduration=0.997207013 podStartE2EDuration="5.704850892s" totalImagesPullingTime="4.707643879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:34:17.702501976 +0000 UTC m=+303.914492432" watchObservedRunningTime="2026-07-09 13:34:17.704850892 +0000 UTC m=+303.916841307"
Jul 09 13:34:17.730105 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.730056    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg" podStartSLOduration=1.762834882 podStartE2EDuration="4.730039124s" totalImagesPullingTime="2.967204242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:34:17.728096714 +0000 UTC m=+303.940087158" watchObservedRunningTime="2026-07-09 13:34:17.730039124 +0000 UTC m=+303.942029539"
Jul 09 13:34:17.769322 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.769249    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs" podStartSLOduration=1.911329117 podStartE2EDuration="4.769230028s" totalImagesPullingTime="2.857900911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:34:17.767201998 +0000 UTC m=+303.979192440" watchObservedRunningTime="2026-07-09 13:34:17.769230028 +0000 UTC m=+303.981220442"
Jul 09 13:34:17.969693 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:17.969555    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:18.690062 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:18.690026    2583 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hb9cs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 13:34:18.690486 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:18.690089    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs" podUID="c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 13:34:19.268799 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:19.268752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:21.689887 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:21.689848    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:23.945041 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:23.944979    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:24.033443 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.033386    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"]
Jul 09 13:34:24.038335 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.038314    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"]
Jul 09 13:34:24.038432 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.038402    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"
Jul 09 13:34:24.041662 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.041638    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"
Jul 09 13:34:24.047952 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.047924    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 09 13:34:24.048106 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.048086    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-776ln\""
Jul 09 13:34:24.049261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.049236    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 09 13:34:24.049379 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.049242    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bg97k\""
Jul 09 13:34:24.050156 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.050123    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:24.059145 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.059096    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"]
Jul 09 13:34:24.061225 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.061203    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"]
Jul 09 13:34:24.178986 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.178952    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s58s\" (UniqueName: \"kubernetes.io/projected/6dcf11a0-f201-4672-b7d4-1c0847231cb9-kube-api-access-7s58s\") pod \"kserve-controller-manager-d6f4b65b8-8gxwv\" (UID: \"6dcf11a0-f201-4672-b7d4-1c0847231cb9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"
Jul 09 13:34:24.179173 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.179054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08e89e60-e816-458d-8517-66871f3bfc4a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bmlj4\" (UID: \"08e89e60-e816-458d-8517-66871f3bfc4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"
Jul 09 13:34:24.179173 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.179096    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dcf11a0-f201-4672-b7d4-1c0847231cb9-cert\") pod \"kserve-controller-manager-d6f4b65b8-8gxwv\" (UID: \"6dcf11a0-f201-4672-b7d4-1c0847231cb9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"
Jul 09 13:34:24.179173 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.179128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2s7b\" (UniqueName: \"kubernetes.io/projected/08e89e60-e816-458d-8517-66871f3bfc4a-kube-api-access-l2s7b\") pod \"llmisvc-controller-manager-777c6bd7d5-bmlj4\" (UID: \"08e89e60-e816-458d-8517-66871f3bfc4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"
Jul 09 13:34:24.197101 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.197024    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:24.279992 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.279954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s58s\" (UniqueName: \"kubernetes.io/projected/6dcf11a0-f201-4672-b7d4-1c0847231cb9-kube-api-access-7s58s\") pod \"kserve-controller-manager-d6f4b65b8-8gxwv\" (UID: \"6dcf11a0-f201-4672-b7d4-1c0847231cb9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"
Jul 09 13:34:24.280195 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.280038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08e89e60-e816-458d-8517-66871f3bfc4a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bmlj4\" (UID: \"08e89e60-e816-458d-8517-66871f3bfc4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"
Jul 09 13:34:24.280195 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.280068    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dcf11a0-f201-4672-b7d4-1c0847231cb9-cert\") pod \"kserve-controller-manager-d6f4b65b8-8gxwv\" (UID: \"6dcf11a0-f201-4672-b7d4-1c0847231cb9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"
Jul 09 13:34:24.280195 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.280094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2s7b\" (UniqueName: \"kubernetes.io/projected/08e89e60-e816-458d-8517-66871f3bfc4a-kube-api-access-l2s7b\") pod \"llmisvc-controller-manager-777c6bd7d5-bmlj4\" (UID: \"08e89e60-e816-458d-8517-66871f3bfc4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"
Jul 09 13:34:24.282591 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.282563    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dcf11a0-f201-4672-b7d4-1c0847231cb9-cert\") pod \"kserve-controller-manager-d6f4b65b8-8gxwv\" (UID: \"6dcf11a0-f201-4672-b7d4-1c0847231cb9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"
Jul 09 13:34:24.282694 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.282637    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08e89e60-e816-458d-8517-66871f3bfc4a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bmlj4\" (UID: \"08e89e60-e816-458d-8517-66871f3bfc4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"
Jul 09 13:34:24.295752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.295722    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s58s\" (UniqueName: \"kubernetes.io/projected/6dcf11a0-f201-4672-b7d4-1c0847231cb9-kube-api-access-7s58s\") pod \"kserve-controller-manager-d6f4b65b8-8gxwv\" (UID: \"6dcf11a0-f201-4672-b7d4-1c0847231cb9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"
Jul 09 13:34:24.297334 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.297301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:24.301268 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.301242    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2s7b\" (UniqueName: \"kubernetes.io/projected/08e89e60-e816-458d-8517-66871f3bfc4a-kube-api-access-l2s7b\") pod \"llmisvc-controller-manager-777c6bd7d5-bmlj4\" (UID: \"08e89e60-e816-458d-8517-66871f3bfc4a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"
Jul 09 13:34:24.349936 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.349907    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"
Jul 09 13:34:24.356161 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.356136    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"
Jul 09 13:34:24.410956 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.410724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:24.528091 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.528061    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"]
Jul 09 13:34:24.529467 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:34:24.529426    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dcf11a0_f201_4672_b7d4_1c0847231cb9.slice/crio-a32de1b7b7f02566d86d872e13ae29bdeecc673e71b9dd23d24fe33008e8b1d4 WatchSource:0}: Error finding container a32de1b7b7f02566d86d872e13ae29bdeecc673e71b9dd23d24fe33008e8b1d4: Status 404 returned error can't find the container with id a32de1b7b7f02566d86d872e13ae29bdeecc673e71b9dd23d24fe33008e8b1d4
Jul 09 13:34:24.530917 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.530897    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 13:34:24.555666 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.555627    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"]
Jul 09 13:34:24.562359 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:34:24.562325    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod08e89e60_e816_458d_8517_66871f3bfc4a.slice/crio-3c712bd9fa440377fa47002caa799e1e8265230deb984ce049cb237f0bce42b3 WatchSource:0}: Error finding container 3c712bd9fa440377fa47002caa799e1e8265230deb984ce049cb237f0bce42b3: Status 404 returned error can't find the container with id 3c712bd9fa440377fa47002caa799e1e8265230deb984ce049cb237f0bce42b3
Jul 09 13:34:24.724943 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.724858    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv" event={"ID":"6dcf11a0-f201-4672-b7d4-1c0847231cb9","Type":"ContainerStarted","Data":"a32de1b7b7f02566d86d872e13ae29bdeecc673e71b9dd23d24fe33008e8b1d4"}
Jul 09 13:34:24.725998 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:24.725969    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4" event={"ID":"08e89e60-e816-458d-8517-66871f3bfc4a","Type":"ContainerStarted","Data":"3c712bd9fa440377fa47002caa799e1e8265230deb984ce049cb237f0bce42b3"}
Jul 09 13:34:25.535326 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.535270    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"]
Jul 09 13:34:25.535770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.535513    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs" podUID="c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" containerName="discovery" containerID="cri-o://b241f89159dbbd719d7a40046a0666b228e0427dc5154f26e30b8dc1472b14fa" gracePeriod=30
Jul 09 13:34:25.737041 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.736954    2583 generic.go:356] "Generic (PLEG): container finished" podID="c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" containerID="b241f89159dbbd719d7a40046a0666b228e0427dc5154f26e30b8dc1472b14fa" exitCode=0
Jul 09 13:34:25.737041 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.737016    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs" event={"ID":"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9","Type":"ContainerDied","Data":"b241f89159dbbd719d7a40046a0666b228e0427dc5154f26e30b8dc1472b14fa"}
Jul 09 13:34:25.891391 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.891358    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:25.895379 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.895343    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-dns-cert\") pod \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") "
Jul 09 13:34:25.895541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.895411    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-kubeconfig\") pod \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") "
Jul 09 13:34:25.895541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.895452    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-local-certs\") pod \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") "
Jul 09 13:34:25.895541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.895481    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-ca-configmap\") pod \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") "
Jul 09 13:34:25.895541 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.895507    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfwpc\" (UniqueName: \"kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-kube-api-access-qfwpc\") pod \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") "
Jul 09 13:34:25.895749 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.895556    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-token\") pod \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") "
Jul 09 13:34:25.895749 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.895599    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-cacerts\") pod \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\" (UID: \"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9\") "
Jul 09 13:34:25.898665 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.898576    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" (UID: "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:34:25.900347 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.900317    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" (UID: "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:34:25.900792 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.900750    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-kube-api-access-qfwpc" (OuterVolumeSpecName: "kube-api-access-qfwpc") pod "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" (UID: "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9"). InnerVolumeSpecName "kube-api-access-qfwpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:34:25.901215 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.901190    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-local-certs" (OuterVolumeSpecName: "local-certs") pod "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" (UID: "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:34:25.905985 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.905955    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" (UID: "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:34:25.906105 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.905977    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" (UID: "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:34:25.906105 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.906003    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-cacerts" (OuterVolumeSpecName: "cacerts") pod "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" (UID: "c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:34:25.996543 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.996509    2583 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-kubeconfig\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:34:25.996543 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.996542    2583 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-local-certs\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:34:25.996786 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.996557    2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-ca-configmap\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:34:25.996786 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.996576    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfwpc\" (UniqueName: \"kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-kube-api-access-qfwpc\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:34:25.996786 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.996591    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-token\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:34:25.996786 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.996605    2583 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-cacerts\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:34:25.996786 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:25.996616    2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9-istio-csr-dns-cert\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:34:26.745430 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:26.745398    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"
Jul 09 13:34:26.745929 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:26.745387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs" event={"ID":"c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9","Type":"ContainerDied","Data":"fd1cedbe3de323035975fb34dd226933696229464ba20bb04c160ee8b96ec72e"}
Jul 09 13:34:26.745929 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:26.745556    2583 scope.go:117] "RemoveContainer" containerID="b241f89159dbbd719d7a40046a0666b228e0427dc5154f26e30b8dc1472b14fa"
Jul 09 13:34:26.780957 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:26.780912    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"]
Jul 09 13:34:26.785858 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:26.785823    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hb9cs"]
Jul 09 13:34:28.317885 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:28.317850    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" path="/var/lib/kubelet/pods/c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9/volumes"
Jul 09 13:34:28.692654 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:28.692573    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ph8qg"
Jul 09 13:34:28.758627 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:28.758575    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv" event={"ID":"6dcf11a0-f201-4672-b7d4-1c0847231cb9","Type":"ContainerStarted","Data":"fb6c075cd12c5212b3f1ba895a831d2074325bcb12c19bb5af3de15b4aea2d01"}
Jul 09 13:34:28.758823 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:28.758647    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"
Jul 09 13:34:28.760320 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:28.760277    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4" event={"ID":"08e89e60-e816-458d-8517-66871f3bfc4a","Type":"ContainerStarted","Data":"70123ab629cc1d83947bc973efab8f9af2d0043284c3590f31860e607c57a335"}
Jul 09 13:34:28.760466 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:28.760368    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"
Jul 09 13:34:28.782373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:28.782318    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv" podStartSLOduration=1.577147794 podStartE2EDuration="4.782281168s" totalImagesPullingTime="3.205133374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:34:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:34:28.780971334 +0000 UTC m=+314.992961750" watchObservedRunningTime="2026-07-09 13:34:28.782281168 +0000 UTC m=+314.994271582"
Jul 09 13:34:28.805060 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:28.805011    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4" podStartSLOduration=1.6291180779999999 podStartE2EDuration="4.804999236s" totalImagesPullingTime="3.175881158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:34:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:34:28.803911243 +0000 UTC m=+315.015901656" watchObservedRunningTime="2026-07-09 13:34:28.804999236 +0000 UTC m=+315.016989698"
Jul 09 13:34:51.220518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:51.220461    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:34:59.768247 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:59.768214    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bmlj4"
Jul 09 13:34:59.771295 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:34:59.771268    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8gxwv"
Jul 09 13:35:01.811373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:01.811324    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:01.936897 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:01.936853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:12.795273 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:12.795175    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:12.897533 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:12.897494    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:12.940593 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:12.940556    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f9fzn"]
Jul 09 13:35:12.940877 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:12.940865    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" containerName="discovery"
Jul 09 13:35:12.940922 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:12.940878    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" containerName="discovery"
Jul 09 13:35:12.940964 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:12.940948    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c136eddf-a594-4a6f-9ad0-c9a6a85ec9d9" containerName="discovery"
Jul 09 13:35:12.943029 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:12.943005    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f9fzn"
Jul 09 13:35:12.946737 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:12.946713    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 13:35:12.946879 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:12.946713    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-crms6\""
Jul 09 13:35:12.948073 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:12.948046    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 13:35:12.955137 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:12.955106    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f9fzn"]
Jul 09 13:35:13.016912 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.016861    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:13.089997 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.089957    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdkdp\" (UniqueName: \"kubernetes.io/projected/2c87269e-0fd8-4619-9d07-c1294a2030d5-kube-api-access-rdkdp\") pod \"kuadrant-operator-catalog-f9fzn\" (UID: \"2c87269e-0fd8-4619-9d07-c1294a2030d5\") " pod="kuadrant-system/kuadrant-operator-catalog-f9fzn"
Jul 09 13:35:13.190610 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.190572    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdkdp\" (UniqueName: \"kubernetes.io/projected/2c87269e-0fd8-4619-9d07-c1294a2030d5-kube-api-access-rdkdp\") pod \"kuadrant-operator-catalog-f9fzn\" (UID: \"2c87269e-0fd8-4619-9d07-c1294a2030d5\") " pod="kuadrant-system/kuadrant-operator-catalog-f9fzn"
Jul 09 13:35:13.214750 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.214714    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdkdp\" (UniqueName: \"kubernetes.io/projected/2c87269e-0fd8-4619-9d07-c1294a2030d5-kube-api-access-rdkdp\") pod \"kuadrant-operator-catalog-f9fzn\" (UID: \"2c87269e-0fd8-4619-9d07-c1294a2030d5\") " pod="kuadrant-system/kuadrant-operator-catalog-f9fzn"
Jul 09 13:35:13.254619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.254582    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f9fzn"
Jul 09 13:35:13.296807 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.296772    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f9fzn"]
Jul 09 13:35:13.394310 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.394259    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f9fzn"]
Jul 09 13:35:13.396156 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:35:13.396115    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c87269e_0fd8_4619_9d07_c1294a2030d5.slice/crio-df18645ccc24e84f8b4f6a38b9f03535902383f8e1bee2a7d932392acfb72bba WatchSource:0}: Error finding container df18645ccc24e84f8b4f6a38b9f03535902383f8e1bee2a7d932392acfb72bba: Status 404 returned error can't find the container with id df18645ccc24e84f8b4f6a38b9f03535902383f8e1bee2a7d932392acfb72bba
Jul 09 13:35:13.504081 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.504042    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fvxcb"]
Jul 09 13:35:13.507010 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.506988    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fvxcb"
Jul 09 13:35:13.517973 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.517946    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fvxcb"]
Jul 09 13:35:13.694183 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.694084    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdgsg\" (UniqueName: \"kubernetes.io/projected/c2b56922-1032-4c58-b2d8-48f2e0c6d661-kube-api-access-sdgsg\") pod \"kuadrant-operator-catalog-fvxcb\" (UID: \"c2b56922-1032-4c58-b2d8-48f2e0c6d661\") " pod="kuadrant-system/kuadrant-operator-catalog-fvxcb"
Jul 09 13:35:13.781045 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.780993    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:13.795026 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.794990    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdgsg\" (UniqueName: \"kubernetes.io/projected/c2b56922-1032-4c58-b2d8-48f2e0c6d661-kube-api-access-sdgsg\") pod \"kuadrant-operator-catalog-fvxcb\" (UID: \"c2b56922-1032-4c58-b2d8-48f2e0c6d661\") " pod="kuadrant-system/kuadrant-operator-catalog-fvxcb"
Jul 09 13:35:13.806863 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.806835    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdgsg\" (UniqueName: \"kubernetes.io/projected/c2b56922-1032-4c58-b2d8-48f2e0c6d661-kube-api-access-sdgsg\") pod \"kuadrant-operator-catalog-fvxcb\" (UID: \"c2b56922-1032-4c58-b2d8-48f2e0c6d661\") " pod="kuadrant-system/kuadrant-operator-catalog-fvxcb"
Jul 09 13:35:13.816853 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.816819    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fvxcb"
Jul 09 13:35:13.943763 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.943724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:13.967205 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.967134    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f9fzn" event={"ID":"2c87269e-0fd8-4619-9d07-c1294a2030d5","Type":"ContainerStarted","Data":"df18645ccc24e84f8b4f6a38b9f03535902383f8e1bee2a7d932392acfb72bba"}
Jul 09 13:35:13.970660 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:13.970630    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fvxcb"]
Jul 09 13:35:13.987944 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:35:13.987912    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b56922_1032_4c58_b2d8_48f2e0c6d661.slice/crio-e97ac355b55a08f275ab970a43e650f022e6c6f19e4c0cd65fe245ccb6a46c3d WatchSource:0}: Error finding container e97ac355b55a08f275ab970a43e650f022e6c6f19e4c0cd65fe245ccb6a46c3d: Status 404 returned error can't find the container with id e97ac355b55a08f275ab970a43e650f022e6c6f19e4c0cd65fe245ccb6a46c3d
Jul 09 13:35:14.973644 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:14.973602    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fvxcb" event={"ID":"c2b56922-1032-4c58-b2d8-48f2e0c6d661","Type":"ContainerStarted","Data":"e97ac355b55a08f275ab970a43e650f022e6c6f19e4c0cd65fe245ccb6a46c3d"}
Jul 09 13:35:15.979772 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:15.979733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fvxcb" event={"ID":"c2b56922-1032-4c58-b2d8-48f2e0c6d661","Type":"ContainerStarted","Data":"21f01f42d438671af3fb700a943f689dfa5aceb78bd4053e855bc3e39417c233"}
Jul 09 13:35:15.981270 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:15.981243    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f9fzn" event={"ID":"2c87269e-0fd8-4619-9d07-c1294a2030d5","Type":"ContainerStarted","Data":"71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d"}
Jul 09 13:35:15.981427 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:15.981351    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-f9fzn" podUID="2c87269e-0fd8-4619-9d07-c1294a2030d5" containerName="registry-server" containerID="cri-o://71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d" gracePeriod=2
Jul 09 13:35:15.999853 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:15.999804    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fvxcb" podStartSLOduration=1.5827591490000001 podStartE2EDuration="2.999786575s" totalImagesPullingTime="1.417027426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:35:15.998686651 +0000 UTC m=+362.210677067" watchObservedRunningTime="2026-07-09 13:35:15.999786575 +0000 UTC m=+362.211776989"
Jul 09 13:35:16.020437 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.020384    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-f9fzn" podStartSLOduration=2.011906524 podStartE2EDuration="4.020367226s" totalImagesPullingTime="2.008460702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:35:16.019115094 +0000 UTC m=+362.231105511" watchObservedRunningTime="2026-07-09 13:35:16.020367226 +0000 UTC m=+362.232357640"
Jul 09 13:35:16.235358 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.235249    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f9fzn"
Jul 09 13:35:16.417476 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.417437    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdkdp\" (UniqueName: \"kubernetes.io/projected/2c87269e-0fd8-4619-9d07-c1294a2030d5-kube-api-access-rdkdp\") pod \"2c87269e-0fd8-4619-9d07-c1294a2030d5\" (UID: \"2c87269e-0fd8-4619-9d07-c1294a2030d5\") "
Jul 09 13:35:16.419680 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.419645    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c87269e-0fd8-4619-9d07-c1294a2030d5-kube-api-access-rdkdp" (OuterVolumeSpecName: "kube-api-access-rdkdp") pod "2c87269e-0fd8-4619-9d07-c1294a2030d5" (UID: "2c87269e-0fd8-4619-9d07-c1294a2030d5"). InnerVolumeSpecName "kube-api-access-rdkdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:35:16.518979 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.518882    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdkdp\" (UniqueName: \"kubernetes.io/projected/2c87269e-0fd8-4619-9d07-c1294a2030d5-kube-api-access-rdkdp\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:16.987610 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.987567    2583 generic.go:356] "Generic (PLEG): container finished" podID="2c87269e-0fd8-4619-9d07-c1294a2030d5" containerID="71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d" exitCode=0
Jul 09 13:35:16.987610 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.987613    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f9fzn"
Jul 09 13:35:16.988109 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.987651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f9fzn" event={"ID":"2c87269e-0fd8-4619-9d07-c1294a2030d5","Type":"ContainerDied","Data":"71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d"}
Jul 09 13:35:16.988109 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.987705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f9fzn" event={"ID":"2c87269e-0fd8-4619-9d07-c1294a2030d5","Type":"ContainerDied","Data":"df18645ccc24e84f8b4f6a38b9f03535902383f8e1bee2a7d932392acfb72bba"}
Jul 09 13:35:16.988109 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.987727    2583 scope.go:117] "RemoveContainer" containerID="71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d"
Jul 09 13:35:16.997431 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.997411    2583 scope.go:117] "RemoveContainer" containerID="71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d"
Jul 09 13:35:16.997751 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:35:16.997732    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d\": container with ID starting with 71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d not found: ID does not exist" containerID="71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d"
Jul 09 13:35:16.997801 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:16.997761    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d"} err="failed to get container status \"71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d\": rpc error: code = NotFound desc = could not find container \"71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d\": container with ID starting with 71145e366e6227ad80e84dde136e4a2fa4174dc9888d5064581806b249f88c9d not found: ID does not exist"
Jul 09 13:35:17.015820 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:17.015785    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f9fzn"]
Jul 09 13:35:17.025552 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:17.025522    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f9fzn"]
Jul 09 13:35:18.316361 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:18.316321    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c87269e-0fd8-4619-9d07-c1294a2030d5" path="/var/lib/kubelet/pods/2c87269e-0fd8-4619-9d07-c1294a2030d5/volumes"
Jul 09 13:35:23.817822 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:23.817769    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fvxcb"
Jul 09 13:35:23.818382 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:23.817858    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fvxcb"
Jul 09 13:35:23.841104 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:23.841070    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fvxcb"
Jul 09 13:35:24.055813 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:24.055782    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fvxcb"
Jul 09 13:35:28.815193 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:28.815157    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"]
Jul 09 13:35:28.815603 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:28.815492    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c87269e-0fd8-4619-9d07-c1294a2030d5" containerName="registry-server"
Jul 09 13:35:28.815603 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:28.815504    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c87269e-0fd8-4619-9d07-c1294a2030d5" containerName="registry-server"
Jul 09 13:35:28.815603 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:28.815565    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c87269e-0fd8-4619-9d07-c1294a2030d5" containerName="registry-server"
Jul 09 13:35:28.819845 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:28.819826    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:28.823944 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:28.823925    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gc4qp\""
Jul 09 13:35:28.837742 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:28.837717    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"]
Jul 09 13:35:28.912951 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:28.912916    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:28.913136 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:28.912963    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:28.913136 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:28.912991    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lm57\" (UniqueName: \"kubernetes.io/projected/e8e40cc8-dcec-4388-a499-8b82085c36c4-kube-api-access-4lm57\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:29.013577 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.013536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:29.013741 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.013583    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lm57\" (UniqueName: \"kubernetes.io/projected/e8e40cc8-dcec-4388-a499-8b82085c36c4-kube-api-access-4lm57\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:29.013741 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.013634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:29.013941 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.013921    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:29.013995 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.013941    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:29.030119 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.030089    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lm57\" (UniqueName: \"kubernetes.io/projected/e8e40cc8-dcec-4388-a499-8b82085c36c4-kube-api-access-4lm57\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:29.129496 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.129456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:29.271897 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.271869    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"]
Jul 09 13:35:29.274128 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:35:29.274098    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e40cc8_dcec_4388_a499_8b82085c36c4.slice/crio-5095a8bd2c857455af6235e8febead77ca2243b630481f6c7f526c092cbc6d20 WatchSource:0}: Error finding container 5095a8bd2c857455af6235e8febead77ca2243b630481f6c7f526c092cbc6d20: Status 404 returned error can't find the container with id 5095a8bd2c857455af6235e8febead77ca2243b630481f6c7f526c092cbc6d20
Jul 09 13:35:29.565939 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.565854    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"]
Jul 09 13:35:29.570092 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.570058    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:29.581405 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.581372    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"]
Jul 09 13:35:29.617590 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.617555    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrp2b\" (UniqueName: \"kubernetes.io/projected/b7c67634-104a-46ba-aef4-32c56dd64b43-kube-api-access-zrp2b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:29.617777 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.617635    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:29.617777 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.617683    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:29.718849 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.718809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:29.719038 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.718864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:29.719038 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.718897    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrp2b\" (UniqueName: \"kubernetes.io/projected/b7c67634-104a-46ba-aef4-32c56dd64b43-kube-api-access-zrp2b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:29.719230 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.719208    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:29.719328 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.719243    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:29.730507 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.730476    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrp2b\" (UniqueName: \"kubernetes.io/projected/b7c67634-104a-46ba-aef4-32c56dd64b43-kube-api-access-zrp2b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:29.881168 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:29.881126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:30.023009 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.022982    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"]
Jul 09 13:35:30.024245 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:35:30.024218    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c67634_104a_46ba_aef4_32c56dd64b43.slice/crio-015733adaa65d0e572805dbe17d01cdc9193dc9dead9b0cfd1e88cdf1724e292 WatchSource:0}: Error finding container 015733adaa65d0e572805dbe17d01cdc9193dc9dead9b0cfd1e88cdf1724e292: Status 404 returned error can't find the container with id 015733adaa65d0e572805dbe17d01cdc9193dc9dead9b0cfd1e88cdf1724e292
Jul 09 13:35:30.062184 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.062145    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg" event={"ID":"b7c67634-104a-46ba-aef4-32c56dd64b43","Type":"ContainerStarted","Data":"015733adaa65d0e572805dbe17d01cdc9193dc9dead9b0cfd1e88cdf1724e292"}
Jul 09 13:35:30.063838 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.063811    2583 generic.go:356] "Generic (PLEG): container finished" podID="e8e40cc8-dcec-4388-a499-8b82085c36c4" containerID="437f7ec086dd4321400f241de4f97a84acdde5c4f06763446544d131b0b6ed8e" exitCode=0
Jul 09 13:35:30.063976 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.063897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq" event={"ID":"e8e40cc8-dcec-4388-a499-8b82085c36c4","Type":"ContainerDied","Data":"437f7ec086dd4321400f241de4f97a84acdde5c4f06763446544d131b0b6ed8e"}
Jul 09 13:35:30.063976 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.063957    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq" event={"ID":"e8e40cc8-dcec-4388-a499-8b82085c36c4","Type":"ContainerStarted","Data":"5095a8bd2c857455af6235e8febead77ca2243b630481f6c7f526c092cbc6d20"}
Jul 09 13:35:30.197681 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.197644    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"]
Jul 09 13:35:30.201146 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.201127    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:30.216191 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.216162    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"]
Jul 09 13:35:30.223576 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.223546    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:30.223720 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.223588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wgv7\" (UniqueName: \"kubernetes.io/projected/8f27d364-6479-4411-a22b-1129e2031e91-kube-api-access-4wgv7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:30.223720 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.223611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:30.324811 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.324770    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:30.325014 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.324825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wgv7\" (UniqueName: \"kubernetes.io/projected/8f27d364-6479-4411-a22b-1129e2031e91-kube-api-access-4wgv7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:30.325014 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.324863    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:30.325234 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.325214    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:30.325319 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.325246    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:30.339931 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.339891    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wgv7\" (UniqueName: \"kubernetes.io/projected/8f27d364-6479-4411-a22b-1129e2031e91-kube-api-access-4wgv7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:30.510327 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.510203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:30.585666 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.585629    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"]
Jul 09 13:35:30.590353 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.590328    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:30.604500 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.604473    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"]
Jul 09 13:35:30.628049 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.628014    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:30.628246 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.628098    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klws8\" (UniqueName: \"kubernetes.io/projected/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-kube-api-access-klws8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:30.628246 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.628215    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:30.662879 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.662851    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"]
Jul 09 13:35:30.664556 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:35:30.664526    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f27d364_6479_4411_a22b_1129e2031e91.slice/crio-83c1182b7b3c6d9b6282168dafc1d41fbd255f0ffdc0f42a37ac754ea6dee2e8 WatchSource:0}: Error finding container 83c1182b7b3c6d9b6282168dafc1d41fbd255f0ffdc0f42a37ac754ea6dee2e8: Status 404 returned error can't find the container with id 83c1182b7b3c6d9b6282168dafc1d41fbd255f0ffdc0f42a37ac754ea6dee2e8
Jul 09 13:35:30.728775 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.728746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klws8\" (UniqueName: \"kubernetes.io/projected/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-kube-api-access-klws8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:30.728910 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.728833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:30.728910 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.728856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:30.729252 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.729224    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:30.729252 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.729249    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:30.743110 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.743086    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klws8\" (UniqueName: \"kubernetes.io/projected/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-kube-api-access-klws8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:30.903836 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:30.903800    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:31.047917 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:31.047852    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"]
Jul 09 13:35:31.050081 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:35:31.050053    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02a7d2b_e228_4ab0_a993_1ff9f65b5ffc.slice/crio-187871a3f2805f2e8b76b3b9d526e3e7f47f859c7ab0861fbb435fa9a1408bee WatchSource:0}: Error finding container 187871a3f2805f2e8b76b3b9d526e3e7f47f859c7ab0861fbb435fa9a1408bee: Status 404 returned error can't find the container with id 187871a3f2805f2e8b76b3b9d526e3e7f47f859c7ab0861fbb435fa9a1408bee
Jul 09 13:35:31.076748 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:31.076713    2583 generic.go:356] "Generic (PLEG): container finished" podID="8f27d364-6479-4411-a22b-1129e2031e91" containerID="d7bcaa3f891c9aeed8a4847fdb6f05de0e2aa5c624440a8ca46e251a4d767242" exitCode=0
Jul 09 13:35:31.076906 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:31.076793    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz" event={"ID":"8f27d364-6479-4411-a22b-1129e2031e91","Type":"ContainerDied","Data":"d7bcaa3f891c9aeed8a4847fdb6f05de0e2aa5c624440a8ca46e251a4d767242"}
Jul 09 13:35:31.076906 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:31.076868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz" event={"ID":"8f27d364-6479-4411-a22b-1129e2031e91","Type":"ContainerStarted","Data":"83c1182b7b3c6d9b6282168dafc1d41fbd255f0ffdc0f42a37ac754ea6dee2e8"}
Jul 09 13:35:31.078337 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:31.078314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb" event={"ID":"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc","Type":"ContainerStarted","Data":"187871a3f2805f2e8b76b3b9d526e3e7f47f859c7ab0861fbb435fa9a1408bee"}
Jul 09 13:35:31.080045 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:31.080023    2583 generic.go:356] "Generic (PLEG): container finished" podID="b7c67634-104a-46ba-aef4-32c56dd64b43" containerID="41eb338c7fd71ece775de1e7b95ecfd26a847dee00bc6fc316ac4d71f535c0ce" exitCode=0
Jul 09 13:35:31.080127 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:31.080095    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg" event={"ID":"b7c67634-104a-46ba-aef4-32c56dd64b43","Type":"ContainerDied","Data":"41eb338c7fd71ece775de1e7b95ecfd26a847dee00bc6fc316ac4d71f535c0ce"}
Jul 09 13:35:31.081888 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:31.081865    2583 generic.go:356] "Generic (PLEG): container finished" podID="e8e40cc8-dcec-4388-a499-8b82085c36c4" containerID="9ff97c5842e95e9624c272faa512ff53960c22ebcefd1e40426c0e4a80df5b66" exitCode=0
Jul 09 13:35:31.081970 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:31.081933    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq" event={"ID":"e8e40cc8-dcec-4388-a499-8b82085c36c4","Type":"ContainerDied","Data":"9ff97c5842e95e9624c272faa512ff53960c22ebcefd1e40426c0e4a80df5b66"}
Jul 09 13:35:32.088843 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:32.088808    2583 generic.go:356] "Generic (PLEG): container finished" podID="b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" containerID="b99c26d947f6ebe8e1c21aa343f3b053ed477b5eb016030416f1eb655b435ebd" exitCode=0
Jul 09 13:35:32.089255 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:32.088889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb" event={"ID":"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc","Type":"ContainerDied","Data":"b99c26d947f6ebe8e1c21aa343f3b053ed477b5eb016030416f1eb655b435ebd"}
Jul 09 13:35:32.090913 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:32.090842    2583 generic.go:356] "Generic (PLEG): container finished" podID="b7c67634-104a-46ba-aef4-32c56dd64b43" containerID="cf6b6be726aad125a32822ed2d4db92696c50547dba2c3f847339a16f2ace71a" exitCode=0
Jul 09 13:35:32.091024 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:32.090926    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg" event={"ID":"b7c67634-104a-46ba-aef4-32c56dd64b43","Type":"ContainerDied","Data":"cf6b6be726aad125a32822ed2d4db92696c50547dba2c3f847339a16f2ace71a"}
Jul 09 13:35:32.093377 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:32.093354    2583 generic.go:356] "Generic (PLEG): container finished" podID="e8e40cc8-dcec-4388-a499-8b82085c36c4" containerID="152b17e6f1fcb3975616411b99d0144db164e74ce3870a7e413956c6d3b651de" exitCode=0
Jul 09 13:35:32.093465 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:32.093397    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq" event={"ID":"e8e40cc8-dcec-4388-a499-8b82085c36c4","Type":"ContainerDied","Data":"152b17e6f1fcb3975616411b99d0144db164e74ce3870a7e413956c6d3b651de"}
Jul 09 13:35:32.102482 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:32.102459    2583 generic.go:356] "Generic (PLEG): container finished" podID="8f27d364-6479-4411-a22b-1129e2031e91" containerID="38f16647218a237ee799dd8d66d30834c95b4a799b5d8654c71a2a0e56d7015b" exitCode=0
Jul 09 13:35:32.102630 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:32.102499    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz" event={"ID":"8f27d364-6479-4411-a22b-1129e2031e91","Type":"ContainerDied","Data":"38f16647218a237ee799dd8d66d30834c95b4a799b5d8654c71a2a0e56d7015b"}
Jul 09 13:35:33.109780 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.109739    2583 generic.go:356] "Generic (PLEG): container finished" podID="b7c67634-104a-46ba-aef4-32c56dd64b43" containerID="b7b6253b9a9b07a07e5e1c1145c60ce2353b4b725dcbf31b935b4d59b1edba6b" exitCode=0
Jul 09 13:35:33.110173 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.109817    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg" event={"ID":"b7c67634-104a-46ba-aef4-32c56dd64b43","Type":"ContainerDied","Data":"b7b6253b9a9b07a07e5e1c1145c60ce2353b4b725dcbf31b935b4d59b1edba6b"}
Jul 09 13:35:33.111786 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.111762    2583 generic.go:356] "Generic (PLEG): container finished" podID="8f27d364-6479-4411-a22b-1129e2031e91" containerID="23eae3620a832d9ba06431f918aa652611691761cce83e80bfadc165de96c4f8" exitCode=0
Jul 09 13:35:33.111919 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.111851    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz" event={"ID":"8f27d364-6479-4411-a22b-1129e2031e91","Type":"ContainerDied","Data":"23eae3620a832d9ba06431f918aa652611691761cce83e80bfadc165de96c4f8"}
Jul 09 13:35:33.113475 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.113456    2583 generic.go:356] "Generic (PLEG): container finished" podID="b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" containerID="52049be53623e7dfe5b3332b901bb83602751a6d9e73cb966d489072a30b8011" exitCode=0
Jul 09 13:35:33.113572 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.113507    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb" event={"ID":"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc","Type":"ContainerDied","Data":"52049be53623e7dfe5b3332b901bb83602751a6d9e73cb966d489072a30b8011"}
Jul 09 13:35:33.253326 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.253237    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:33.351556 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.351517    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-util\") pod \"e8e40cc8-dcec-4388-a499-8b82085c36c4\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") "
Jul 09 13:35:33.351735 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.351585    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lm57\" (UniqueName: \"kubernetes.io/projected/e8e40cc8-dcec-4388-a499-8b82085c36c4-kube-api-access-4lm57\") pod \"e8e40cc8-dcec-4388-a499-8b82085c36c4\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") "
Jul 09 13:35:33.351735 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.351606    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-bundle\") pod \"e8e40cc8-dcec-4388-a499-8b82085c36c4\" (UID: \"e8e40cc8-dcec-4388-a499-8b82085c36c4\") "
Jul 09 13:35:33.352339 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.352313    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-bundle" (OuterVolumeSpecName: "bundle") pod "e8e40cc8-dcec-4388-a499-8b82085c36c4" (UID: "e8e40cc8-dcec-4388-a499-8b82085c36c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:35:33.353816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.353789    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e40cc8-dcec-4388-a499-8b82085c36c4-kube-api-access-4lm57" (OuterVolumeSpecName: "kube-api-access-4lm57") pod "e8e40cc8-dcec-4388-a499-8b82085c36c4" (UID: "e8e40cc8-dcec-4388-a499-8b82085c36c4"). InnerVolumeSpecName "kube-api-access-4lm57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:35:33.356334 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.356276    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-util" (OuterVolumeSpecName: "util") pod "e8e40cc8-dcec-4388-a499-8b82085c36c4" (UID: "e8e40cc8-dcec-4388-a499-8b82085c36c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:35:33.452452 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.452364    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lm57\" (UniqueName: \"kubernetes.io/projected/e8e40cc8-dcec-4388-a499-8b82085c36c4-kube-api-access-4lm57\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:33.452452 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.452396    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-bundle\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:33.452452 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:33.452407    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8e40cc8-dcec-4388-a499-8b82085c36c4-util\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:34.120445 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.120414    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq"
Jul 09 13:35:34.120855 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.120445    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq" event={"ID":"e8e40cc8-dcec-4388-a499-8b82085c36c4","Type":"ContainerDied","Data":"5095a8bd2c857455af6235e8febead77ca2243b630481f6c7f526c092cbc6d20"}
Jul 09 13:35:34.120855 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.120493    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5095a8bd2c857455af6235e8febead77ca2243b630481f6c7f526c092cbc6d20"
Jul 09 13:35:34.122580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.122552    2583 generic.go:356] "Generic (PLEG): container finished" podID="b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" containerID="043f738fcb7df517d81fd80816900ffec54de6dbee72d629497f47430cf8f3a9" exitCode=0
Jul 09 13:35:34.122724 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.122622    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb" event={"ID":"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc","Type":"ContainerDied","Data":"043f738fcb7df517d81fd80816900ffec54de6dbee72d629497f47430cf8f3a9"}
Jul 09 13:35:34.285867 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.285832    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:34.287908 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.287889    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:34.358619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.358587    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-bundle\") pod \"8f27d364-6479-4411-a22b-1129e2031e91\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") "
Jul 09 13:35:34.358794 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.358635    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wgv7\" (UniqueName: \"kubernetes.io/projected/8f27d364-6479-4411-a22b-1129e2031e91-kube-api-access-4wgv7\") pod \"8f27d364-6479-4411-a22b-1129e2031e91\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") "
Jul 09 13:35:34.358794 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.358658    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-bundle\") pod \"b7c67634-104a-46ba-aef4-32c56dd64b43\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") "
Jul 09 13:35:34.358794 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.358673    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-util\") pod \"b7c67634-104a-46ba-aef4-32c56dd64b43\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") "
Jul 09 13:35:34.358794 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.358697    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-util\") pod \"8f27d364-6479-4411-a22b-1129e2031e91\" (UID: \"8f27d364-6479-4411-a22b-1129e2031e91\") "
Jul 09 13:35:34.358794 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.358783    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrp2b\" (UniqueName: \"kubernetes.io/projected/b7c67634-104a-46ba-aef4-32c56dd64b43-kube-api-access-zrp2b\") pod \"b7c67634-104a-46ba-aef4-32c56dd64b43\" (UID: \"b7c67634-104a-46ba-aef4-32c56dd64b43\") "
Jul 09 13:35:34.359304 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.359250    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-bundle" (OuterVolumeSpecName: "bundle") pod "8f27d364-6479-4411-a22b-1129e2031e91" (UID: "8f27d364-6479-4411-a22b-1129e2031e91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:35:34.359304 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.359273    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-bundle" (OuterVolumeSpecName: "bundle") pod "b7c67634-104a-46ba-aef4-32c56dd64b43" (UID: "b7c67634-104a-46ba-aef4-32c56dd64b43"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:35:34.361051 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.361021    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7c67634-104a-46ba-aef4-32c56dd64b43-kube-api-access-zrp2b" (OuterVolumeSpecName: "kube-api-access-zrp2b") pod "b7c67634-104a-46ba-aef4-32c56dd64b43" (UID: "b7c67634-104a-46ba-aef4-32c56dd64b43"). InnerVolumeSpecName "kube-api-access-zrp2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:35:34.361211 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.361182    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f27d364-6479-4411-a22b-1129e2031e91-kube-api-access-4wgv7" (OuterVolumeSpecName: "kube-api-access-4wgv7") pod "8f27d364-6479-4411-a22b-1129e2031e91" (UID: "8f27d364-6479-4411-a22b-1129e2031e91"). InnerVolumeSpecName "kube-api-access-4wgv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:35:34.364248 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.364218    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-util" (OuterVolumeSpecName: "util") pod "b7c67634-104a-46ba-aef4-32c56dd64b43" (UID: "b7c67634-104a-46ba-aef4-32c56dd64b43"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:35:34.364647 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.364625    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-util" (OuterVolumeSpecName: "util") pod "8f27d364-6479-4411-a22b-1129e2031e91" (UID: "8f27d364-6479-4411-a22b-1129e2031e91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:35:34.459922 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.459881    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrp2b\" (UniqueName: \"kubernetes.io/projected/b7c67634-104a-46ba-aef4-32c56dd64b43-kube-api-access-zrp2b\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:34.459922 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.459916    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-bundle\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:34.459922 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.459928    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wgv7\" (UniqueName: \"kubernetes.io/projected/8f27d364-6479-4411-a22b-1129e2031e91-kube-api-access-4wgv7\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:34.460167 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.459938    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-bundle\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:34.460167 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.459946    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7c67634-104a-46ba-aef4-32c56dd64b43-util\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:34.460167 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:34.459954    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f27d364-6479-4411-a22b-1129e2031e91-util\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:35.129590 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.129561    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg"
Jul 09 13:35:35.129590 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.129570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg" event={"ID":"b7c67634-104a-46ba-aef4-32c56dd64b43","Type":"ContainerDied","Data":"015733adaa65d0e572805dbe17d01cdc9193dc9dead9b0cfd1e88cdf1724e292"}
Jul 09 13:35:35.130072 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.129649    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="015733adaa65d0e572805dbe17d01cdc9193dc9dead9b0cfd1e88cdf1724e292"
Jul 09 13:35:35.131645 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.131624    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz"
Jul 09 13:35:35.131645 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.131614    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz" event={"ID":"8f27d364-6479-4411-a22b-1129e2031e91","Type":"ContainerDied","Data":"83c1182b7b3c6d9b6282168dafc1d41fbd255f0ffdc0f42a37ac754ea6dee2e8"}
Jul 09 13:35:35.131809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.131669    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83c1182b7b3c6d9b6282168dafc1d41fbd255f0ffdc0f42a37ac754ea6dee2e8"
Jul 09 13:35:35.267407 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.267381    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:35.367566 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.367534    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-bundle\") pod \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") "
Jul 09 13:35:35.367566 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.367573    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-util\") pod \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") "
Jul 09 13:35:35.367781 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.367634    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klws8\" (UniqueName: \"kubernetes.io/projected/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-kube-api-access-klws8\") pod \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\" (UID: \"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc\") "
Jul 09 13:35:35.368093 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.368066    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-bundle" (OuterVolumeSpecName: "bundle") pod "b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" (UID: "b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:35:35.369977 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.369949    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-kube-api-access-klws8" (OuterVolumeSpecName: "kube-api-access-klws8") pod "b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" (UID: "b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc"). InnerVolumeSpecName "kube-api-access-klws8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:35:35.373280 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.373238    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-util" (OuterVolumeSpecName: "util") pod "b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" (UID: "b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:35:35.468375 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.468265    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klws8\" (UniqueName: \"kubernetes.io/projected/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-kube-api-access-klws8\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:35.468375 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.468344    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-bundle\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:35.468375 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:35.468353    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc-util\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:35:36.138645 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:36.138605    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb" event={"ID":"b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc","Type":"ContainerDied","Data":"187871a3f2805f2e8b76b3b9d526e3e7f47f859c7ab0861fbb435fa9a1408bee"}
Jul 09 13:35:36.138645 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:36.138636    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb"
Jul 09 13:35:36.139085 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:36.138664    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="187871a3f2805f2e8b76b3b9d526e3e7f47f859c7ab0861fbb435fa9a1408bee"
Jul 09 13:35:42.088848 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:42.088804    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:42.688156 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:42.688051    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:43.720945 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:43.720903    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:43.820764 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:43.820728    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:46.223089 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223052    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g"]
Jul 09 13:35:46.223619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223553    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7c67634-104a-46ba-aef4-32c56dd64b43" containerName="pull"
Jul 09 13:35:46.223619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223575    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7c67634-104a-46ba-aef4-32c56dd64b43" containerName="pull"
Jul 09 13:35:46.223619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223590    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f27d364-6479-4411-a22b-1129e2031e91" containerName="extract"
Jul 09 13:35:46.223619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223598    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f27d364-6479-4411-a22b-1129e2031e91" containerName="extract"
Jul 09 13:35:46.223619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223612    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f27d364-6479-4411-a22b-1129e2031e91" containerName="pull"
Jul 09 13:35:46.223619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223620    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f27d364-6479-4411-a22b-1129e2031e91" containerName="pull"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223635    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e40cc8-dcec-4388-a499-8b82085c36c4" containerName="pull"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223643    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e40cc8-dcec-4388-a499-8b82085c36c4" containerName="pull"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223656    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e40cc8-dcec-4388-a499-8b82085c36c4" containerName="extract"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223664    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e40cc8-dcec-4388-a499-8b82085c36c4" containerName="extract"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223677    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" containerName="extract"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223685    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" containerName="extract"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223699    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e40cc8-dcec-4388-a499-8b82085c36c4" containerName="util"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223707    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e40cc8-dcec-4388-a499-8b82085c36c4" containerName="util"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223717    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7c67634-104a-46ba-aef4-32c56dd64b43" containerName="util"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223725    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7c67634-104a-46ba-aef4-32c56dd64b43" containerName="util"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223738    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7c67634-104a-46ba-aef4-32c56dd64b43" containerName="extract"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223746    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7c67634-104a-46ba-aef4-32c56dd64b43" containerName="extract"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223760    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" containerName="util"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223768    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" containerName="util"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223781    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" containerName="pull"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223789    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" containerName="pull"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223797    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f27d364-6479-4411-a22b-1129e2031e91" containerName="util"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223805    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f27d364-6479-4411-a22b-1129e2031e91" containerName="util"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223884    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f27d364-6479-4411-a22b-1129e2031e91" containerName="extract"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223897    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e40cc8-dcec-4388-a499-8b82085c36c4" containerName="extract"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223908    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc" containerName="extract"
Jul 09 13:35:46.223930 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.223919    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7c67634-104a-46ba-aef4-32c56dd64b43" containerName="extract"
Jul 09 13:35:46.228971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.228944    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g"
Jul 09 13:35:46.232175 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.232152    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-f64fh\""
Jul 09 13:35:46.242785 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.242756    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g"]
Jul 09 13:35:46.256171 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.256144    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vznh7\" (UniqueName: \"kubernetes.io/projected/0ddea29b-72b0-4669-a363-62b7e786b4b3-kube-api-access-vznh7\") pod \"authorino-operator-75cc8d5cb7-v9t7g\" (UID: \"0ddea29b-72b0-4669-a363-62b7e786b4b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g"
Jul 09 13:35:46.357242 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.357190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vznh7\" (UniqueName: \"kubernetes.io/projected/0ddea29b-72b0-4669-a363-62b7e786b4b3-kube-api-access-vznh7\") pod \"authorino-operator-75cc8d5cb7-v9t7g\" (UID: \"0ddea29b-72b0-4669-a363-62b7e786b4b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g"
Jul 09 13:35:46.369719 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.369682    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vznh7\" (UniqueName: \"kubernetes.io/projected/0ddea29b-72b0-4669-a363-62b7e786b4b3-kube-api-access-vznh7\") pod \"authorino-operator-75cc8d5cb7-v9t7g\" (UID: \"0ddea29b-72b0-4669-a363-62b7e786b4b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g"
Jul 09 13:35:46.538996 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.538904    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g"
Jul 09 13:35:46.685158 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:46.685123    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g"]
Jul 09 13:35:46.689109 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:35:46.689080    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ddea29b_72b0_4669_a363_62b7e786b4b3.slice/crio-831581e10100a2a2d6dfdc075590bb88fc371197743bc81b7b0734de0621a592 WatchSource:0}: Error finding container 831581e10100a2a2d6dfdc075590bb88fc371197743bc81b7b0734de0621a592: Status 404 returned error can't find the container with id 831581e10100a2a2d6dfdc075590bb88fc371197743bc81b7b0734de0621a592
Jul 09 13:35:47.199011 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:47.198969    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g" event={"ID":"0ddea29b-72b0-4669-a363-62b7e786b4b3","Type":"ContainerStarted","Data":"831581e10100a2a2d6dfdc075590bb88fc371197743bc81b7b0734de0621a592"}
Jul 09 13:35:47.346976 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:47.346900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:49.213397 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.213364    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g" event={"ID":"0ddea29b-72b0-4669-a363-62b7e786b4b3","Type":"ContainerStarted","Data":"ea924db58d82eba3476987269ce2b98baec3d4eb900cff3a730c1b45622e605c"}
Jul 09 13:35:49.213794 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.213429    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g"
Jul 09 13:35:49.240539 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.240434    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g" podStartSLOduration=0.959740241 podStartE2EDuration="3.24041762s" totalImagesPullingTime="2.280677379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:35:49.240062506 +0000 UTC m=+395.452052957" watchObservedRunningTime="2026-07-09 13:35:49.24041762 +0000 UTC m=+395.452408034"
Jul 09 13:35:49.409071 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.409033    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"]
Jul 09 13:35:49.434368 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.430761    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"]
Jul 09 13:35:49.434368 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.430908    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"
Jul 09 13:35:49.435534 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.435503    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fth58\""
Jul 09 13:35:49.436674 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.436642    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:49.481822 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.481786    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkwd7\" (UniqueName: \"kubernetes.io/projected/a405fe2e-e96f-4cd7-a60a-14d8d9b5b632-kube-api-access-kkwd7\") pod \"limitador-operator-controller-manager-859d7b78bd-5np22\" (UID: \"a405fe2e-e96f-4cd7-a60a-14d8d9b5b632\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"
Jul 09 13:35:49.533342 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.533230    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:49.582574 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.582532    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkwd7\" (UniqueName: \"kubernetes.io/projected/a405fe2e-e96f-4cd7-a60a-14d8d9b5b632-kube-api-access-kkwd7\") pod \"limitador-operator-controller-manager-859d7b78bd-5np22\" (UID: \"a405fe2e-e96f-4cd7-a60a-14d8d9b5b632\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"
Jul 09 13:35:49.595455 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.595426    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkwd7\" (UniqueName: \"kubernetes.io/projected/a405fe2e-e96f-4cd7-a60a-14d8d9b5b632-kube-api-access-kkwd7\") pod \"limitador-operator-controller-manager-859d7b78bd-5np22\" (UID: \"a405fe2e-e96f-4cd7-a60a-14d8d9b5b632\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"
Jul 09 13:35:49.743790 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.743749    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"
Jul 09 13:35:49.904918 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:49.904889    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"]
Jul 09 13:35:49.906349 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:35:49.906315    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda405fe2e_e96f_4cd7_a60a_14d8d9b5b632.slice/crio-c51aa579c84fb502eb021263cc782e05aa21aceb4bc5b2b5c517e4475fb70966 WatchSource:0}: Error finding container c51aa579c84fb502eb021263cc782e05aa21aceb4bc5b2b5c517e4475fb70966: Status 404 returned error can't find the container with id c51aa579c84fb502eb021263cc782e05aa21aceb4bc5b2b5c517e4475fb70966
Jul 09 13:35:50.106314 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:50.106263    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:50.221268 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:50.221225    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22" event={"ID":"a405fe2e-e96f-4cd7-a60a-14d8d9b5b632","Type":"ContainerStarted","Data":"c51aa579c84fb502eb021263cc782e05aa21aceb4bc5b2b5c517e4475fb70966"}
Jul 09 13:35:50.726089 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:50.726022    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:51.283472 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:51.283434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:51.376560 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:51.376524    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:51.964476 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:51.964390    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm"]
Jul 09 13:35:51.966844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:51.966820    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm"
Jul 09 13:35:51.970076 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:51.970049    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-r4b6x\""
Jul 09 13:35:51.974387 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:51.974361    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 13:35:51.993492 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:51.993461    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm"]
Jul 09 13:35:52.002655 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:52.002622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvmjw\" (UniqueName: \"kubernetes.io/projected/b82707ff-8fdc-4ee2-afb4-f0635798c389-kube-api-access-nvmjw\") pod \"dns-operator-controller-manager-864dd78c4c-f4wtm\" (UID: \"b82707ff-8fdc-4ee2-afb4-f0635798c389\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm"
Jul 09 13:35:52.103061 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:52.103021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvmjw\" (UniqueName: \"kubernetes.io/projected/b82707ff-8fdc-4ee2-afb4-f0635798c389-kube-api-access-nvmjw\") pod \"dns-operator-controller-manager-864dd78c4c-f4wtm\" (UID: \"b82707ff-8fdc-4ee2-afb4-f0635798c389\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm"
Jul 09 13:35:52.125062 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:52.125018    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvmjw\" (UniqueName: \"kubernetes.io/projected/b82707ff-8fdc-4ee2-afb4-f0635798c389-kube-api-access-nvmjw\") pod \"dns-operator-controller-manager-864dd78c4c-f4wtm\" (UID: \"b82707ff-8fdc-4ee2-afb4-f0635798c389\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm"
Jul 09 13:35:52.234816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:52.234723    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22" event={"ID":"a405fe2e-e96f-4cd7-a60a-14d8d9b5b632","Type":"ContainerStarted","Data":"cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d"}
Jul 09 13:35:52.234966 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:52.234853    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"
Jul 09 13:35:52.260944 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:52.260889    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22" podStartSLOduration=1.5687448609999999 podStartE2EDuration="3.260875666s" totalImagesPullingTime="1.692130805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:35:52.259949239 +0000 UTC m=+398.471939654" watchObservedRunningTime="2026-07-09 13:35:52.260875666 +0000 UTC m=+398.472866082"
Jul 09 13:35:52.277431 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:52.277401    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm"
Jul 09 13:35:52.420377 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:52.420350    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm"]
Jul 09 13:35:52.422695 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:35:52.422668    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82707ff_8fdc_4ee2_afb4_f0635798c389.slice/crio-af53ff1bd91c0f6e124c6dd963c02d41ea083d7ccfd6da467eb7faf2a12676d5 WatchSource:0}: Error finding container af53ff1bd91c0f6e124c6dd963c02d41ea083d7ccfd6da467eb7faf2a12676d5: Status 404 returned error can't find the container with id af53ff1bd91c0f6e124c6dd963c02d41ea083d7ccfd6da467eb7faf2a12676d5
Jul 09 13:35:52.496380 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:52.496256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:52.927113 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:52.927078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:53.240869 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:53.240764    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm" event={"ID":"b82707ff-8fdc-4ee2-afb4-f0635798c389","Type":"ContainerStarted","Data":"af53ff1bd91c0f6e124c6dd963c02d41ea083d7ccfd6da467eb7faf2a12676d5"}
Jul 09 13:35:55.255466 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:55.255377    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm" event={"ID":"b82707ff-8fdc-4ee2-afb4-f0635798c389","Type":"ContainerStarted","Data":"d7d098545f07baa790e5ebe51a2217be96bf9fe8f5885ce8fa847ed5e6b0dc6d"}
Jul 09 13:35:55.255818 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:55.255510    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm"
Jul 09 13:35:55.293506 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:55.293450    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm" podStartSLOduration=1.79614798 podStartE2EDuration="4.293432831s" totalImagesPullingTime="2.497284851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:35:55.291740341 +0000 UTC m=+401.503730755" watchObservedRunningTime="2026-07-09 13:35:55.293432831 +0000 UTC m=+401.505423317"
Jul 09 13:35:55.971580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:55.971542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:56.374978 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.374936    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"]
Jul 09 13:35:56.378888 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.378865    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:35:56.381884 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.381863    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hr285\""
Jul 09 13:35:56.392066 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.392037    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"]
Jul 09 13:35:56.446569 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.446523    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c6c7467-7e3f-49ca-913a-ea9791ba1914-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9j85\" (UID: \"9c6c7467-7e3f-49ca-913a-ea9791ba1914\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:35:56.446732 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.446585    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvcsd\" (UniqueName: \"kubernetes.io/projected/9c6c7467-7e3f-49ca-913a-ea9791ba1914-kube-api-access-xvcsd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9j85\" (UID: \"9c6c7467-7e3f-49ca-913a-ea9791ba1914\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:35:56.547371 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.547328    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c6c7467-7e3f-49ca-913a-ea9791ba1914-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9j85\" (UID: \"9c6c7467-7e3f-49ca-913a-ea9791ba1914\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:35:56.547371 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.547383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvcsd\" (UniqueName: \"kubernetes.io/projected/9c6c7467-7e3f-49ca-913a-ea9791ba1914-kube-api-access-xvcsd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9j85\" (UID: \"9c6c7467-7e3f-49ca-913a-ea9791ba1914\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:35:56.547783 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.547756    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c6c7467-7e3f-49ca-913a-ea9791ba1914-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9j85\" (UID: \"9c6c7467-7e3f-49ca-913a-ea9791ba1914\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:35:56.557854 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.557822    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvcsd\" (UniqueName: \"kubernetes.io/projected/9c6c7467-7e3f-49ca-913a-ea9791ba1914-kube-api-access-xvcsd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t9j85\" (UID: \"9c6c7467-7e3f-49ca-913a-ea9791ba1914\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:35:56.688615 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.688519    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:35:56.837359 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:56.837330    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"]
Jul 09 13:35:56.839440 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:35:56.839409    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6c7467_7e3f_49ca_913a_ea9791ba1914.slice/crio-98cc63cb008a6097abb65307d76dc94f9b104d1eeab7c17d4d9837f1e7b3e3e3 WatchSource:0}: Error finding container 98cc63cb008a6097abb65307d76dc94f9b104d1eeab7c17d4d9837f1e7b3e3e3: Status 404 returned error can't find the container with id 98cc63cb008a6097abb65307d76dc94f9b104d1eeab7c17d4d9837f1e7b3e3e3
Jul 09 13:35:57.266618 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:57.266583    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85" event={"ID":"9c6c7467-7e3f-49ca-913a-ea9791ba1914","Type":"ContainerStarted","Data":"98cc63cb008a6097abb65307d76dc94f9b104d1eeab7c17d4d9837f1e7b3e3e3"}
Jul 09 13:35:57.701298 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:57.701245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:57.801229 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:57.801195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:58.320914 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:58.320879    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:58.422592 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:58.422553    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:35:58.525878 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:35:58.525841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:00.224360 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:00.224328    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-v9t7g"
Jul 09 13:36:01.527887 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:01.527842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:01.627533 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:01.627481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:03.243003 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:03.242916    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"
Jul 09 13:36:03.306079 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:03.306046    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85" event={"ID":"9c6c7467-7e3f-49ca-913a-ea9791ba1914","Type":"ContainerStarted","Data":"b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc"}
Jul 09 13:36:03.306309 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:03.306151    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:36:03.333235 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:03.333183    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85" podStartSLOduration=1.233943979 podStartE2EDuration="7.333166021s" totalImagesPullingTime="6.099222042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:35:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:36:03.330819328 +0000 UTC m=+409.542809745" watchObservedRunningTime="2026-07-09 13:36:03.333166021 +0000 UTC m=+409.545156436"
Jul 09 13:36:05.288194 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:05.288152    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:05.389886 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:05.389848    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:05.751406 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:05.751367    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:05.913685 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:05.913638    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:06.262880 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:06.262847    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-f4wtm"
Jul 09 13:36:08.853600 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:08.853568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:08.918566 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:08.918509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:09.240144 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:09.240054    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:09.340357 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:09.340315    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:14.317085 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:14.317056    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:36:15.264836 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:15.264793    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"]
Jul 09 13:36:15.269247 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:15.269217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:15.280875 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:15.280846    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"]
Jul 09 13:36:15.416847 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:15.416805    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f92f424-817f-4694-a644-c6a9a06eda56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w92h7\" (UID: \"0f92f424-817f-4694-a644-c6a9a06eda56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:15.416847 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:15.416854    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rdkl\" (UniqueName: \"kubernetes.io/projected/0f92f424-817f-4694-a644-c6a9a06eda56-kube-api-access-9rdkl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w92h7\" (UID: \"0f92f424-817f-4694-a644-c6a9a06eda56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:15.517373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:15.517267    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f92f424-817f-4694-a644-c6a9a06eda56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w92h7\" (UID: \"0f92f424-817f-4694-a644-c6a9a06eda56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:15.517373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:15.517317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rdkl\" (UniqueName: \"kubernetes.io/projected/0f92f424-817f-4694-a644-c6a9a06eda56-kube-api-access-9rdkl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w92h7\" (UID: \"0f92f424-817f-4694-a644-c6a9a06eda56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:15.517683 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:15.517649    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f92f424-817f-4694-a644-c6a9a06eda56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w92h7\" (UID: \"0f92f424-817f-4694-a644-c6a9a06eda56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:15.529205 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:15.529173    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rdkl\" (UniqueName: \"kubernetes.io/projected/0f92f424-817f-4694-a644-c6a9a06eda56-kube-api-access-9rdkl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-w92h7\" (UID: \"0f92f424-817f-4694-a644-c6a9a06eda56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:15.580048 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:15.580012    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:15.723027 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:15.722992    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"]
Jul 09 13:36:15.725771 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:36:15.725732    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f92f424_817f_4694_a644_c6a9a06eda56.slice/crio-cb56bfd3074e3e5c9cace45c17090cabe0174cea032ee4caed2515908c9470f5 WatchSource:0}: Error finding container cb56bfd3074e3e5c9cace45c17090cabe0174cea032ee4caed2515908c9470f5: Status 404 returned error can't find the container with id cb56bfd3074e3e5c9cace45c17090cabe0174cea032ee4caed2515908c9470f5
Jul 09 13:36:16.051328 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.051217    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"]
Jul 09 13:36:16.064156 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.064124    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"]
Jul 09 13:36:16.077219 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.077181    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"]
Jul 09 13:36:16.077436 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.077407    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85" podUID="9c6c7467-7e3f-49ca-913a-ea9791ba1914" containerName="manager" containerID="cri-o://b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc" gracePeriod=2
Jul 09 13:36:16.084789 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.084759    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"]
Jul 09 13:36:16.085176 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.085162    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f92f424-817f-4694-a644-c6a9a06eda56" containerName="manager"
Jul 09 13:36:16.085242 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.085178    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f92f424-817f-4694-a644-c6a9a06eda56" containerName="manager"
Jul 09 13:36:16.085335 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.085253    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f92f424-817f-4694-a644-c6a9a06eda56" containerName="manager"
Jul 09 13:36:16.088413 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.088392    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:16.091264 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.091240    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"]
Jul 09 13:36:16.105093 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:16.104731    2583 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c6c7467-7e3f-49ca-913a-ea9791ba1914\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-t9j85\": pods \"kuadrant-operator-controller-manager-8684c9ff49-t9j85\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:36:16.106131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.106086    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"]
Jul 09 13:36:16.107173 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:16.107140    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t9j85\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="9c6c7467-7e3f-49ca-913a-ea9791ba1914" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:36:16.111197 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.109896    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"]
Jul 09 13:36:16.111197 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.110469    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c6c7467-7e3f-49ca-913a-ea9791ba1914" containerName="manager"
Jul 09 13:36:16.111197 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.110490    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c6c7467-7e3f-49ca-913a-ea9791ba1914" containerName="manager"
Jul 09 13:36:16.111197 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.110600    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c6c7467-7e3f-49ca-913a-ea9791ba1914" containerName="manager"
Jul 09 13:36:16.113003 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.112978    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:16.115255 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.115219    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"]
Jul 09 13:36:16.115647 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.115611    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22" podUID="a405fe2e-e96f-4cd7-a60a-14d8d9b5b632" containerName="manager" containerID="cri-o://cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d" gracePeriod=2
Jul 09 13:36:16.127111 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.127043    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"]
Jul 09 13:36:16.129549 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.129523    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"]
Jul 09 13:36:16.135172 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.135143    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm"]
Jul 09 13:36:16.135723 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.135701    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a405fe2e-e96f-4cd7-a60a-14d8d9b5b632" containerName="manager"
Jul 09 13:36:16.135877 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.135857    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a405fe2e-e96f-4cd7-a60a-14d8d9b5b632" containerName="manager"
Jul 09 13:36:16.135996 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.135985    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a405fe2e-e96f-4cd7-a60a-14d8d9b5b632" containerName="manager"
Jul 09 13:36:16.138146 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.138128    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm"
Jul 09 13:36:16.146386 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:16.146349    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5np22\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="a405fe2e-e96f-4cd7-a60a-14d8d9b5b632" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"
Jul 09 13:36:16.152705 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.152677    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm"]
Jul 09 13:36:16.215040 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:16.215001    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t9j85\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="9c6c7467-7e3f-49ca-913a-ea9791ba1914" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:36:16.224621 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.224579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44f0dc04-afc9-4387-9024-4a11a1edb7f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pc75h\" (UID: \"44f0dc04-afc9-4387-9024-4a11a1edb7f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:16.224726 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.224687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6997\" (UniqueName: \"kubernetes.io/projected/acd837cc-ca7e-4d03-aa2d-cef42f9d6db9-kube-api-access-v6997\") pod \"limitador-operator-controller-manager-859d7b78bd-g46sm\" (UID: \"acd837cc-ca7e-4d03-aa2d-cef42f9d6db9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm"
Jul 09 13:36:16.224781 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.224728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fc817e4-189d-400b-8370-c2be1d1e41d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bjxzv\" (UID: \"4fc817e4-189d-400b-8370-c2be1d1e41d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:16.224781 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.224756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq4lx\" (UniqueName: \"kubernetes.io/projected/44f0dc04-afc9-4387-9024-4a11a1edb7f3-kube-api-access-bq4lx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pc75h\" (UID: \"44f0dc04-afc9-4387-9024-4a11a1edb7f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:16.224855 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.224822    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2kqs\" (UniqueName: \"kubernetes.io/projected/4fc817e4-189d-400b-8370-c2be1d1e41d7-kube-api-access-l2kqs\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bjxzv\" (UID: \"4fc817e4-189d-400b-8370-c2be1d1e41d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:16.326042 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.326006    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44f0dc04-afc9-4387-9024-4a11a1edb7f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pc75h\" (UID: \"44f0dc04-afc9-4387-9024-4a11a1edb7f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:16.326249 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.326057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6997\" (UniqueName: \"kubernetes.io/projected/acd837cc-ca7e-4d03-aa2d-cef42f9d6db9-kube-api-access-v6997\") pod \"limitador-operator-controller-manager-859d7b78bd-g46sm\" (UID: \"acd837cc-ca7e-4d03-aa2d-cef42f9d6db9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm"
Jul 09 13:36:16.326249 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.326078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fc817e4-189d-400b-8370-c2be1d1e41d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bjxzv\" (UID: \"4fc817e4-189d-400b-8370-c2be1d1e41d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:16.326249 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.326096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq4lx\" (UniqueName: \"kubernetes.io/projected/44f0dc04-afc9-4387-9024-4a11a1edb7f3-kube-api-access-bq4lx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pc75h\" (UID: \"44f0dc04-afc9-4387-9024-4a11a1edb7f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:16.326249 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.326136    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2kqs\" (UniqueName: \"kubernetes.io/projected/4fc817e4-189d-400b-8370-c2be1d1e41d7-kube-api-access-l2kqs\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bjxzv\" (UID: \"4fc817e4-189d-400b-8370-c2be1d1e41d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:16.326941 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.326733    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44f0dc04-afc9-4387-9024-4a11a1edb7f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pc75h\" (UID: \"44f0dc04-afc9-4387-9024-4a11a1edb7f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:16.326941 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.326798    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fc817e4-189d-400b-8370-c2be1d1e41d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bjxzv\" (UID: \"4fc817e4-189d-400b-8370-c2be1d1e41d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:16.338749 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.338719    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2kqs\" (UniqueName: \"kubernetes.io/projected/4fc817e4-189d-400b-8370-c2be1d1e41d7-kube-api-access-l2kqs\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-bjxzv\" (UID: \"4fc817e4-189d-400b-8370-c2be1d1e41d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:16.338954 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.338931    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6997\" (UniqueName: \"kubernetes.io/projected/acd837cc-ca7e-4d03-aa2d-cef42f9d6db9-kube-api-access-v6997\") pod \"limitador-operator-controller-manager-859d7b78bd-g46sm\" (UID: \"acd837cc-ca7e-4d03-aa2d-cef42f9d6db9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm"
Jul 09 13:36:16.339022 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.338970    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq4lx\" (UniqueName: \"kubernetes.io/projected/44f0dc04-afc9-4387-9024-4a11a1edb7f3-kube-api-access-bq4lx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pc75h\" (UID: \"44f0dc04-afc9-4387-9024-4a11a1edb7f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:16.356311 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.356270    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"
Jul 09 13:36:16.364138 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.364114    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:36:16.377570 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.377537    2583 generic.go:356] "Generic (PLEG): container finished" podID="a405fe2e-e96f-4cd7-a60a-14d8d9b5b632" containerID="cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d" exitCode=0
Jul 09 13:36:16.377754 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.377590    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5np22"
Jul 09 13:36:16.377754 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.377643    2583 scope.go:117] "RemoveContainer" containerID="cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d"
Jul 09 13:36:16.381026 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:16.381002    2583 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7" container="manager"
Jul 09 13:36:16.382614 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.382583    2583 generic.go:356] "Generic (PLEG): container finished" podID="9c6c7467-7e3f-49ca-913a-ea9791ba1914" containerID="b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc" exitCode=0
Jul 09 13:36:16.382721 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.382700    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t9j85"
Jul 09 13:36:16.389019 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.388994    2583 scope.go:117] "RemoveContainer" containerID="cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d"
Jul 09 13:36:16.389354 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:16.389336    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d\": container with ID starting with cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d not found: ID does not exist" containerID="cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d"
Jul 09 13:36:16.389438 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.389362    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d"} err="failed to get container status \"cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d\": rpc error: code = NotFound desc = could not find container \"cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d\": container with ID starting with cd35309a7829a5d00e68c3f66fcf21ddb1ae5e91547c9c7e0e1080b952cbbe7d not found: ID does not exist"
Jul 09 13:36:16.389438 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.389382    2583 scope.go:117] "RemoveContainer" containerID="b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc"
Jul 09 13:36:16.399664 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.399628    2583 scope.go:117] "RemoveContainer" containerID="b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc"
Jul 09 13:36:16.400045 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:16.399999    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc\": container with ID starting with b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc not found: ID does not exist" containerID="b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc"
Jul 09 13:36:16.400172 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.400042    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc"} err="failed to get container status \"b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc\": rpc error: code = NotFound desc = could not find container \"b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc\": container with ID starting with b74c33a309e3b134197b068fd4c9bfe1032c89372a1af95b975bb1f615969bcc not found: ID does not exist"
Jul 09 13:36:16.495114 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.495074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:16.502039 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.502015    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:16.508087 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.508060    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm"
Jul 09 13:36:16.528237 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.528208    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkwd7\" (UniqueName: \"kubernetes.io/projected/a405fe2e-e96f-4cd7-a60a-14d8d9b5b632-kube-api-access-kkwd7\") pod \"a405fe2e-e96f-4cd7-a60a-14d8d9b5b632\" (UID: \"a405fe2e-e96f-4cd7-a60a-14d8d9b5b632\") "
Jul 09 13:36:16.528472 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.528263    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c6c7467-7e3f-49ca-913a-ea9791ba1914-extensions-socket-volume\") pod \"9c6c7467-7e3f-49ca-913a-ea9791ba1914\" (UID: \"9c6c7467-7e3f-49ca-913a-ea9791ba1914\") "
Jul 09 13:36:16.528472 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.528330    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvcsd\" (UniqueName: \"kubernetes.io/projected/9c6c7467-7e3f-49ca-913a-ea9791ba1914-kube-api-access-xvcsd\") pod \"9c6c7467-7e3f-49ca-913a-ea9791ba1914\" (UID: \"9c6c7467-7e3f-49ca-913a-ea9791ba1914\") "
Jul 09 13:36:16.528800 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.528771    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c6c7467-7e3f-49ca-913a-ea9791ba1914-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c6c7467-7e3f-49ca-913a-ea9791ba1914" (UID: "9c6c7467-7e3f-49ca-913a-ea9791ba1914"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:36:16.530901 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.530876    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a405fe2e-e96f-4cd7-a60a-14d8d9b5b632-kube-api-access-kkwd7" (OuterVolumeSpecName: "kube-api-access-kkwd7") pod "a405fe2e-e96f-4cd7-a60a-14d8d9b5b632" (UID: "a405fe2e-e96f-4cd7-a60a-14d8d9b5b632"). InnerVolumeSpecName "kube-api-access-kkwd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:36:16.531103 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.531070    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c6c7467-7e3f-49ca-913a-ea9791ba1914-kube-api-access-xvcsd" (OuterVolumeSpecName: "kube-api-access-xvcsd") pod "9c6c7467-7e3f-49ca-913a-ea9791ba1914" (UID: "9c6c7467-7e3f-49ca-913a-ea9791ba1914"). InnerVolumeSpecName "kube-api-access-xvcsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:36:16.630014 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.629974    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkwd7\" (UniqueName: \"kubernetes.io/projected/a405fe2e-e96f-4cd7-a60a-14d8d9b5b632-kube-api-access-kkwd7\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:36:16.630168 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.630019    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c6c7467-7e3f-49ca-913a-ea9791ba1914-extensions-socket-volume\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:36:16.630168 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.630036    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvcsd\" (UniqueName: \"kubernetes.io/projected/9c6c7467-7e3f-49ca-913a-ea9791ba1914-kube-api-access-xvcsd\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:36:16.679322 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.679256    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"]
Jul 09 13:36:16.681416 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:36:16.681366    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f0dc04_afc9_4387_9024_4a11a1edb7f3.slice/crio-f1082ec2015f3c42d290c47d188a47c42067f83990eec1ca3857a2bbc5cb1b2e WatchSource:0}: Error finding container f1082ec2015f3c42d290c47d188a47c42067f83990eec1ca3857a2bbc5cb1b2e: Status 404 returned error can't find the container with id f1082ec2015f3c42d290c47d188a47c42067f83990eec1ca3857a2bbc5cb1b2e
Jul 09 13:36:16.692117 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:36:16.691655    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc817e4_189d_400b_8370_c2be1d1e41d7.slice/crio-865499441c2ebcb188373d1a274fa04fb307d4cf34c62587ddaf23ccaebe6c2e WatchSource:0}: Error finding container 865499441c2ebcb188373d1a274fa04fb307d4cf34c62587ddaf23ccaebe6c2e: Status 404 returned error can't find the container with id 865499441c2ebcb188373d1a274fa04fb307d4cf34c62587ddaf23ccaebe6c2e
Jul 09 13:36:16.692117 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.692039    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"]
Jul 09 13:36:16.703107 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.703081    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm"]
Jul 09 13:36:16.706494 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:36:16.706467    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd837cc_ca7e_4d03_aa2d_cef42f9d6db9.slice/crio-3a4c1bd72da7e5635ad668885773a583208e073b1184761adbed0dffa7829fe8 WatchSource:0}: Error finding container 3a4c1bd72da7e5635ad668885773a583208e073b1184761adbed0dffa7829fe8: Status 404 returned error can't find the container with id 3a4c1bd72da7e5635ad668885773a583208e073b1184761adbed0dffa7829fe8
Jul 09 13:36:16.921345 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:16.921221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:17.027923 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.027884    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:17.390013 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.389972    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm" event={"ID":"acd837cc-ca7e-4d03-aa2d-cef42f9d6db9","Type":"ContainerStarted","Data":"bc25ad6fb3bf93fdc4e348584595acf1867e8c323561d3c2ce119417e88708d9"}
Jul 09 13:36:17.390218 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.390038    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm" event={"ID":"acd837cc-ca7e-4d03-aa2d-cef42f9d6db9","Type":"ContainerStarted","Data":"3a4c1bd72da7e5635ad668885773a583208e073b1184761adbed0dffa7829fe8"}
Jul 09 13:36:17.390218 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.390139    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm"
Jul 09 13:36:17.392623 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.392596    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h" event={"ID":"44f0dc04-afc9-4387-9024-4a11a1edb7f3","Type":"ContainerStarted","Data":"f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409"}
Jul 09 13:36:17.392760 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.392643    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h" event={"ID":"44f0dc04-afc9-4387-9024-4a11a1edb7f3","Type":"ContainerStarted","Data":"f1082ec2015f3c42d290c47d188a47c42067f83990eec1ca3857a2bbc5cb1b2e"}
Jul 09 13:36:17.392760 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.392697    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:17.394367 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.394326    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7" podUID="0f92f424-817f-4694-a644-c6a9a06eda56" containerName="manager" containerID="cri-o://4c038ccf5a644dd0b341a1c30fd8de55b8f417821ce5c0918551799fc896a20a" gracePeriod=2
Jul 09 13:36:17.396796 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.396769    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv" event={"ID":"4fc817e4-189d-400b-8370-c2be1d1e41d7","Type":"ContainerStarted","Data":"1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed"}
Jul 09 13:36:17.396924 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.396812    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv" event={"ID":"4fc817e4-189d-400b-8370-c2be1d1e41d7","Type":"ContainerStarted","Data":"865499441c2ebcb188373d1a274fa04fb307d4cf34c62587ddaf23ccaebe6c2e"}
Jul 09 13:36:17.396986 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.396905    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:17.427369 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.427314    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm" podStartSLOduration=1.427280624 podStartE2EDuration="1.427280624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:36:17.424506645 +0000 UTC m=+423.636497060" watchObservedRunningTime="2026-07-09 13:36:17.427280624 +0000 UTC m=+423.639271108"
Jul 09 13:36:17.464913 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.464856    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h" podStartSLOduration=1.464837098 podStartE2EDuration="1.464837098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:36:17.46420837 +0000 UTC m=+423.676198786" watchObservedRunningTime="2026-07-09 13:36:17.464837098 +0000 UTC m=+423.676827515"
Jul 09 13:36:17.466890 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:17.466847    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-w92h7\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="0f92f424-817f-4694-a644-c6a9a06eda56" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:17.501264 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.501212    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv" podStartSLOduration=1.5011963750000001 podStartE2EDuration="1.501196375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:36:17.500968349 +0000 UTC m=+423.712958793" watchObservedRunningTime="2026-07-09 13:36:17.501196375 +0000 UTC m=+423.713186789"
Jul 09 13:36:17.575699 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.575658    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:17.651231 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.651158    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:17.653948 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:17.653890    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-w92h7\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="0f92f424-817f-4694-a644-c6a9a06eda56" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:17.669564 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.669534    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:17.739555 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.739516    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f92f424-817f-4694-a644-c6a9a06eda56-extensions-socket-volume\") pod \"0f92f424-817f-4694-a644-c6a9a06eda56\" (UID: \"0f92f424-817f-4694-a644-c6a9a06eda56\") "
Jul 09 13:36:17.739755 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.739608    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rdkl\" (UniqueName: \"kubernetes.io/projected/0f92f424-817f-4694-a644-c6a9a06eda56-kube-api-access-9rdkl\") pod \"0f92f424-817f-4694-a644-c6a9a06eda56\" (UID: \"0f92f424-817f-4694-a644-c6a9a06eda56\") "
Jul 09 13:36:17.739969 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.739943    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f92f424-817f-4694-a644-c6a9a06eda56-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0f92f424-817f-4694-a644-c6a9a06eda56" (UID: "0f92f424-817f-4694-a644-c6a9a06eda56"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:36:17.741737 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.741711    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f92f424-817f-4694-a644-c6a9a06eda56-kube-api-access-9rdkl" (OuterVolumeSpecName: "kube-api-access-9rdkl") pod "0f92f424-817f-4694-a644-c6a9a06eda56" (UID: "0f92f424-817f-4694-a644-c6a9a06eda56"). InnerVolumeSpecName "kube-api-access-9rdkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:36:17.840170 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.840132    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rdkl\" (UniqueName: \"kubernetes.io/projected/0f92f424-817f-4694-a644-c6a9a06eda56-kube-api-access-9rdkl\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:36:17.840170 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:17.840166    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f92f424-817f-4694-a644-c6a9a06eda56-extensions-socket-volume\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:36:18.316957 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:18.316918    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f92f424-817f-4694-a644-c6a9a06eda56" path="/var/lib/kubelet/pods/0f92f424-817f-4694-a644-c6a9a06eda56/volumes"
Jul 09 13:36:18.317318 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:18.317279    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c6c7467-7e3f-49ca-913a-ea9791ba1914" path="/var/lib/kubelet/pods/9c6c7467-7e3f-49ca-913a-ea9791ba1914/volumes"
Jul 09 13:36:18.317601 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:18.317589    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a405fe2e-e96f-4cd7-a60a-14d8d9b5b632" path="/var/lib/kubelet/pods/a405fe2e-e96f-4cd7-a60a-14d8d9b5b632/volumes"
Jul 09 13:36:18.403765 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:18.403731    2583 generic.go:356] "Generic (PLEG): container finished" podID="0f92f424-817f-4694-a644-c6a9a06eda56" containerID="4c038ccf5a644dd0b341a1c30fd8de55b8f417821ce5c0918551799fc896a20a" exitCode=0
Jul 09 13:36:18.403961 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:18.403782    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:18.403961 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:18.403880    2583 scope.go:117] "RemoveContainer" containerID="4c038ccf5a644dd0b341a1c30fd8de55b8f417821ce5c0918551799fc896a20a"
Jul 09 13:36:18.409344 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:18.409313    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-w92h7\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="0f92f424-817f-4694-a644-c6a9a06eda56" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-w92h7"
Jul 09 13:36:18.413187 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:18.413157    2583 scope.go:117] "RemoveContainer" containerID="4c038ccf5a644dd0b341a1c30fd8de55b8f417821ce5c0918551799fc896a20a"
Jul 09 13:36:18.413514 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:18.413488    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c038ccf5a644dd0b341a1c30fd8de55b8f417821ce5c0918551799fc896a20a\": container with ID starting with 4c038ccf5a644dd0b341a1c30fd8de55b8f417821ce5c0918551799fc896a20a not found: ID does not exist" containerID="4c038ccf5a644dd0b341a1c30fd8de55b8f417821ce5c0918551799fc896a20a"
Jul 09 13:36:18.413606 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:18.413522    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c038ccf5a644dd0b341a1c30fd8de55b8f417821ce5c0918551799fc896a20a"} err="failed to get container status \"4c038ccf5a644dd0b341a1c30fd8de55b8f417821ce5c0918551799fc896a20a\": rpc error: code = NotFound desc = could not find container \"4c038ccf5a644dd0b341a1c30fd8de55b8f417821ce5c0918551799fc896a20a\": container with ID starting with 4c038ccf5a644dd0b341a1c30fd8de55b8f417821ce5c0918551799fc896a20a not found: ID does not exist"
Jul 09 13:36:21.330776 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:21.330731    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:21.427487 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:21.427451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:23.333226 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:23.333177    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:23.436770 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:23.436738    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:27.881599 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:27.881553    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:27.981947 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:27.981905    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:28.406307 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.406257    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:28.406511 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.406471    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:28.406645 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.406528    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g46sm"
Jul 09 13:36:28.467155 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.467124    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"]
Jul 09 13:36:28.467502 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.467466    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h" podUID="44f0dc04-afc9-4387-9024-4a11a1edb7f3" containerName="manager" containerID="cri-o://f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409" gracePeriod=10
Jul 09 13:36:28.731600 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.731575    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:28.830006 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.829973    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq4lx\" (UniqueName: \"kubernetes.io/projected/44f0dc04-afc9-4387-9024-4a11a1edb7f3-kube-api-access-bq4lx\") pod \"44f0dc04-afc9-4387-9024-4a11a1edb7f3\" (UID: \"44f0dc04-afc9-4387-9024-4a11a1edb7f3\") "
Jul 09 13:36:28.832453 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.832418    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44f0dc04-afc9-4387-9024-4a11a1edb7f3-kube-api-access-bq4lx" (OuterVolumeSpecName: "kube-api-access-bq4lx") pod "44f0dc04-afc9-4387-9024-4a11a1edb7f3" (UID: "44f0dc04-afc9-4387-9024-4a11a1edb7f3"). InnerVolumeSpecName "kube-api-access-bq4lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:36:28.835265 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.835241    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"]
Jul 09 13:36:28.835811 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.835792    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44f0dc04-afc9-4387-9024-4a11a1edb7f3" containerName="manager"
Jul 09 13:36:28.835859 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.835818    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="44f0dc04-afc9-4387-9024-4a11a1edb7f3" containerName="manager"
Jul 09 13:36:28.835925 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.835912    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="44f0dc04-afc9-4387-9024-4a11a1edb7f3" containerName="manager"
Jul 09 13:36:28.838432 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.838409    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:36:28.858497 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.858466    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"]
Jul 09 13:36:28.930486 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.930453    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44f0dc04-afc9-4387-9024-4a11a1edb7f3-extensions-socket-volume\") pod \"44f0dc04-afc9-4387-9024-4a11a1edb7f3\" (UID: \"44f0dc04-afc9-4387-9024-4a11a1edb7f3\") "
Jul 09 13:36:28.930922 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.930588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgvtm\" (UniqueName: \"kubernetes.io/projected/fe298184-187c-4988-9fcb-76b0d62483a7-kube-api-access-mgvtm\") pod \"kuadrant-operator-controller-manager-86878c769f-zlqj4\" (UID: \"fe298184-187c-4988-9fcb-76b0d62483a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:36:28.930922 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.930622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe298184-187c-4988-9fcb-76b0d62483a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zlqj4\" (UID: \"fe298184-187c-4988-9fcb-76b0d62483a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:36:28.930922 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.930742    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq4lx\" (UniqueName: \"kubernetes.io/projected/44f0dc04-afc9-4387-9024-4a11a1edb7f3-kube-api-access-bq4lx\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:36:28.930922 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:28.930850    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44f0dc04-afc9-4387-9024-4a11a1edb7f3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "44f0dc04-afc9-4387-9024-4a11a1edb7f3" (UID: "44f0dc04-afc9-4387-9024-4a11a1edb7f3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:36:29.031241 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.031143    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgvtm\" (UniqueName: \"kubernetes.io/projected/fe298184-187c-4988-9fcb-76b0d62483a7-kube-api-access-mgvtm\") pod \"kuadrant-operator-controller-manager-86878c769f-zlqj4\" (UID: \"fe298184-187c-4988-9fcb-76b0d62483a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:36:29.031241 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.031192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe298184-187c-4988-9fcb-76b0d62483a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zlqj4\" (UID: \"fe298184-187c-4988-9fcb-76b0d62483a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:36:29.031526 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.031279    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44f0dc04-afc9-4387-9024-4a11a1edb7f3-extensions-socket-volume\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:36:29.031705 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.031678    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe298184-187c-4988-9fcb-76b0d62483a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zlqj4\" (UID: \"fe298184-187c-4988-9fcb-76b0d62483a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:36:29.055983 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.055952    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgvtm\" (UniqueName: \"kubernetes.io/projected/fe298184-187c-4988-9fcb-76b0d62483a7-kube-api-access-mgvtm\") pod \"kuadrant-operator-controller-manager-86878c769f-zlqj4\" (UID: \"fe298184-187c-4988-9fcb-76b0d62483a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:36:29.152895 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.152855    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:36:29.305131 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.305101    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"]
Jul 09 13:36:29.308067 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:36:29.308047    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe298184_187c_4988_9fcb_76b0d62483a7.slice/crio-e0ec8549269af43e6c077a589ee0f81ef0dd842899c7b0ffa13f73b1b3aadfbf WatchSource:0}: Error finding container e0ec8549269af43e6c077a589ee0f81ef0dd842899c7b0ffa13f73b1b3aadfbf: Status 404 returned error can't find the container with id e0ec8549269af43e6c077a589ee0f81ef0dd842899c7b0ffa13f73b1b3aadfbf
Jul 09 13:36:29.469135 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.469095    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4" event={"ID":"fe298184-187c-4988-9fcb-76b0d62483a7","Type":"ContainerStarted","Data":"331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0"}
Jul 09 13:36:29.469381 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.469183    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4" event={"ID":"fe298184-187c-4988-9fcb-76b0d62483a7","Type":"ContainerStarted","Data":"e0ec8549269af43e6c077a589ee0f81ef0dd842899c7b0ffa13f73b1b3aadfbf"}
Jul 09 13:36:29.469381 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.469314    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:36:29.470535 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.470512    2583 generic.go:356] "Generic (PLEG): container finished" podID="44f0dc04-afc9-4387-9024-4a11a1edb7f3" containerID="f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409" exitCode=0
Jul 09 13:36:29.470626 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.470545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h" event={"ID":"44f0dc04-afc9-4387-9024-4a11a1edb7f3","Type":"ContainerDied","Data":"f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409"}
Jul 09 13:36:29.470626 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.470554    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"
Jul 09 13:36:29.470626 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.470576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h" event={"ID":"44f0dc04-afc9-4387-9024-4a11a1edb7f3","Type":"ContainerDied","Data":"f1082ec2015f3c42d290c47d188a47c42067f83990eec1ca3857a2bbc5cb1b2e"}
Jul 09 13:36:29.470626 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.470596    2583 scope.go:117] "RemoveContainer" containerID="f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409"
Jul 09 13:36:29.480038 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.480017    2583 scope.go:117] "RemoveContainer" containerID="f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409"
Jul 09 13:36:29.480332 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:29.480305    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409\": container with ID starting with f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409 not found: ID does not exist" containerID="f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409"
Jul 09 13:36:29.480393 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.480340    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409"} err="failed to get container status \"f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409\": rpc error: code = NotFound desc = could not find container \"f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409\": container with ID starting with f4ec7218d1d72640e0a4ded49e8ccb60dff9e87f8021e069ba57f61880519409 not found: ID does not exist"
Jul 09 13:36:29.533557 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.533498    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4" podStartSLOduration=1.533477869 podStartE2EDuration="1.533477869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:36:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:36:29.50121761 +0000 UTC m=+435.713208026" watchObservedRunningTime="2026-07-09 13:36:29.533477869 +0000 UTC m=+435.745468644"
Jul 09 13:36:29.535494 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.535463    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"]
Jul 09 13:36:29.537580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:29.537556    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pc75h"]
Jul 09 13:36:30.316667 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:30.316636    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44f0dc04-afc9-4387-9024-4a11a1edb7f3" path="/var/lib/kubelet/pods/44f0dc04-afc9-4387-9024-4a11a1edb7f3/volumes"
Jul 09 13:36:40.480693 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:40.480598    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:36:40.569476 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:40.569437    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"]
Jul 09 13:36:40.569724 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:40.569696    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv" podUID="4fc817e4-189d-400b-8370-c2be1d1e41d7" containerName="manager" containerID="cri-o://1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed" gracePeriod=10
Jul 09 13:36:40.828994 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:40.828966    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:40.918115 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:40.918079    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fc817e4-189d-400b-8370-c2be1d1e41d7-extensions-socket-volume\") pod \"4fc817e4-189d-400b-8370-c2be1d1e41d7\" (UID: \"4fc817e4-189d-400b-8370-c2be1d1e41d7\") "
Jul 09 13:36:40.918345 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:40.918148    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2kqs\" (UniqueName: \"kubernetes.io/projected/4fc817e4-189d-400b-8370-c2be1d1e41d7-kube-api-access-l2kqs\") pod \"4fc817e4-189d-400b-8370-c2be1d1e41d7\" (UID: \"4fc817e4-189d-400b-8370-c2be1d1e41d7\") "
Jul 09 13:36:40.918589 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:40.918566    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc817e4-189d-400b-8370-c2be1d1e41d7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4fc817e4-189d-400b-8370-c2be1d1e41d7" (UID: "4fc817e4-189d-400b-8370-c2be1d1e41d7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:36:40.920326 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:40.920271    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fc817e4-189d-400b-8370-c2be1d1e41d7-kube-api-access-l2kqs" (OuterVolumeSpecName: "kube-api-access-l2kqs") pod "4fc817e4-189d-400b-8370-c2be1d1e41d7" (UID: "4fc817e4-189d-400b-8370-c2be1d1e41d7"). InnerVolumeSpecName "kube-api-access-l2kqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:36:41.019747 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:41.019646    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2kqs\" (UniqueName: \"kubernetes.io/projected/4fc817e4-189d-400b-8370-c2be1d1e41d7-kube-api-access-l2kqs\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:36:41.019747 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:41.019681    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fc817e4-189d-400b-8370-c2be1d1e41d7-extensions-socket-volume\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:36:41.540618 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:41.540579    2583 generic.go:356] "Generic (PLEG): container finished" podID="4fc817e4-189d-400b-8370-c2be1d1e41d7" containerID="1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed" exitCode=0
Jul 09 13:36:41.541070 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:41.540630    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"
Jul 09 13:36:41.541070 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:41.540661    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv" event={"ID":"4fc817e4-189d-400b-8370-c2be1d1e41d7","Type":"ContainerDied","Data":"1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed"}
Jul 09 13:36:41.541070 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:41.540721    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv" event={"ID":"4fc817e4-189d-400b-8370-c2be1d1e41d7","Type":"ContainerDied","Data":"865499441c2ebcb188373d1a274fa04fb307d4cf34c62587ddaf23ccaebe6c2e"}
Jul 09 13:36:41.541070 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:41.540749    2583 scope.go:117] "RemoveContainer" containerID="1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed"
Jul 09 13:36:41.550379 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:41.550360    2583 scope.go:117] "RemoveContainer" containerID="1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed"
Jul 09 13:36:41.550643 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:36:41.550621    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed\": container with ID starting with 1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed not found: ID does not exist" containerID="1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed"
Jul 09 13:36:41.550691 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:41.550666    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed"} err="failed to get container status \"1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed\": rpc error: code = NotFound desc = could not find container \"1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed\": container with ID starting with 1e3f6bc925b9aff90ba9f37ab74a996b18741989e970506b064d71686bcfa3ed not found: ID does not exist"
Jul 09 13:36:41.572509 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:41.572477    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"]
Jul 09 13:36:41.578849 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:41.578824    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-bjxzv"]
Jul 09 13:36:42.316265 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:42.316225    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fc817e4-189d-400b-8370-c2be1d1e41d7" path="/var/lib/kubelet/pods/4fc817e4-189d-400b-8370-c2be1d1e41d7/volumes"
Jul 09 13:36:44.245690 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:44.245651    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:44.344998 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:44.344953    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:44.964934 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:44.964897    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:45.061447 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:45.061403    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:59.877936 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.877894    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:59.878459 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.878436    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"]
Jul 09 13:36:59.878797 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.878784    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc817e4-189d-400b-8370-c2be1d1e41d7" containerName="manager"
Jul 09 13:36:59.878847 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.878798    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc817e4-189d-400b-8370-c2be1d1e41d7" containerName="manager"
Jul 09 13:36:59.878895 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.878860    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc817e4-189d-400b-8370-c2be1d1e41d7" containerName="manager"
Jul 09 13:36:59.881929 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.881912    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:36:59.885077 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.885060    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 13:36:59.885167 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.885147    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gc4qp\""
Jul 09 13:36:59.892129 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.892105    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"]
Jul 09 13:36:59.968272 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.968235    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"]
Jul 09 13:36:59.972621 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.972585    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:36:59.977569 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.977540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7knkh\" (UniqueName: \"kubernetes.io/projected/71597320-f7bd-48aa-ab1b-318a17dc3295-kube-api-access-7knkh\") pod \"limitador-limitador-64c94fd64f-vxgmz\" (UID: \"71597320-f7bd-48aa-ab1b-318a17dc3295\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:36:59.977716 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:36:59.977596    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71597320-f7bd-48aa-ab1b-318a17dc3295-config-file\") pod \"limitador-limitador-64c94fd64f-vxgmz\" (UID: \"71597320-f7bd-48aa-ab1b-318a17dc3295\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:37:00.041124 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.041070    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:00.078265 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.078223    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7knkh\" (UniqueName: \"kubernetes.io/projected/71597320-f7bd-48aa-ab1b-318a17dc3295-kube-api-access-7knkh\") pod \"limitador-limitador-64c94fd64f-vxgmz\" (UID: \"71597320-f7bd-48aa-ab1b-318a17dc3295\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:37:00.078483 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.078317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71597320-f7bd-48aa-ab1b-318a17dc3295-config-file\") pod \"limitador-limitador-64c94fd64f-vxgmz\" (UID: \"71597320-f7bd-48aa-ab1b-318a17dc3295\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:37:00.079022 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.078998    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71597320-f7bd-48aa-ab1b-318a17dc3295-config-file\") pod \"limitador-limitador-64c94fd64f-vxgmz\" (UID: \"71597320-f7bd-48aa-ab1b-318a17dc3295\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:37:00.088851 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.088816    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7knkh\" (UniqueName: \"kubernetes.io/projected/71597320-f7bd-48aa-ab1b-318a17dc3295-kube-api-access-7knkh\") pod \"limitador-limitador-64c94fd64f-vxgmz\" (UID: \"71597320-f7bd-48aa-ab1b-318a17dc3295\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:37:00.193499 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.193404    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:37:00.343468 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.343430    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"]
Jul 09 13:37:00.346764 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:37:00.346734    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71597320_f7bd_48aa_ab1b_318a17dc3295.slice/crio-e45c8d7c00a9781980611a15180b69b5168adc91941281e29ddf35dad9e3bdc9 WatchSource:0}: Error finding container e45c8d7c00a9781980611a15180b69b5168adc91941281e29ddf35dad9e3bdc9: Status 404 returned error can't find the container with id e45c8d7c00a9781980611a15180b69b5168adc91941281e29ddf35dad9e3bdc9
Jul 09 13:37:00.645959 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.645922    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz" event={"ID":"71597320-f7bd-48aa-ab1b-318a17dc3295","Type":"ContainerStarted","Data":"e45c8d7c00a9781980611a15180b69b5168adc91941281e29ddf35dad9e3bdc9"}
Jul 09 13:37:00.756880 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.756837    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:00.856750 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.856702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:00.981923 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.981842    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdld2"]
Jul 09 13:37:00.985204 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.985181    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fdld2"
Jul 09 13:37:00.988380 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.988360    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r6ftv\""
Jul 09 13:37:00.998690 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:00.998664    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdld2"]
Jul 09 13:37:01.088231 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:01.088183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mkt8\" (UniqueName: \"kubernetes.io/projected/57e870d0-2c95-416f-8ee3-42409b0ef794-kube-api-access-2mkt8\") pod \"authorino-75d556bd77-fdld2\" (UID: \"57e870d0-2c95-416f-8ee3-42409b0ef794\") " pod="kuadrant-system/authorino-75d556bd77-fdld2"
Jul 09 13:37:01.190410 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:01.189956    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mkt8\" (UniqueName: \"kubernetes.io/projected/57e870d0-2c95-416f-8ee3-42409b0ef794-kube-api-access-2mkt8\") pod \"authorino-75d556bd77-fdld2\" (UID: \"57e870d0-2c95-416f-8ee3-42409b0ef794\") " pod="kuadrant-system/authorino-75d556bd77-fdld2"
Jul 09 13:37:01.221898 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:01.212200    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mkt8\" (UniqueName: \"kubernetes.io/projected/57e870d0-2c95-416f-8ee3-42409b0ef794-kube-api-access-2mkt8\") pod \"authorino-75d556bd77-fdld2\" (UID: \"57e870d0-2c95-416f-8ee3-42409b0ef794\") " pod="kuadrant-system/authorino-75d556bd77-fdld2"
Jul 09 13:37:01.296833 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:01.296489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fdld2"
Jul 09 13:37:01.495276 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:01.495174    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdld2"]
Jul 09 13:37:01.498033 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:37:01.497940    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57e870d0_2c95_416f_8ee3_42409b0ef794.slice/crio-f592fe8b4e45f5f7a8afdb0abc7d27f102dbe280075e6f85f7b9f3cbd2ad8e30 WatchSource:0}: Error finding container f592fe8b4e45f5f7a8afdb0abc7d27f102dbe280075e6f85f7b9f3cbd2ad8e30: Status 404 returned error can't find the container with id f592fe8b4e45f5f7a8afdb0abc7d27f102dbe280075e6f85f7b9f3cbd2ad8e30
Jul 09 13:37:01.656502 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:01.656464    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fdld2" event={"ID":"57e870d0-2c95-416f-8ee3-42409b0ef794","Type":"ContainerStarted","Data":"f592fe8b4e45f5f7a8afdb0abc7d27f102dbe280075e6f85f7b9f3cbd2ad8e30"}
Jul 09 13:37:03.674116 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:03.674011    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz" event={"ID":"71597320-f7bd-48aa-ab1b-318a17dc3295","Type":"ContainerStarted","Data":"6c8619b3f2650266c1dd8c27e5f3dd23098b0633e3920d05433ab597eca617d0"}
Jul 09 13:37:03.674116 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:03.674079    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:37:03.703597 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:03.703530    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz" podStartSLOduration=1.7580410309999999 podStartE2EDuration="4.703503199s" totalImagesPullingTime="2.945462168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:37:03.700958115 +0000 UTC m=+469.912948531" watchObservedRunningTime="2026-07-09 13:37:03.703503199 +0000 UTC m=+469.915493617"
Jul 09 13:37:05.690087 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:05.689981    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fdld2" event={"ID":"57e870d0-2c95-416f-8ee3-42409b0ef794","Type":"ContainerStarted","Data":"043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000"}
Jul 09 13:37:05.707769 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:05.707701    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-fdld2" podStartSLOduration=1.8285648509999999 podStartE2EDuration="5.707677494s" totalImagesPullingTime="3.879112643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:37:05.706502075 +0000 UTC m=+471.918492491" watchObservedRunningTime="2026-07-09 13:37:05.707677494 +0000 UTC m=+471.919667912"
Jul 09 13:37:14.683852 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:14.683817    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:37:15.324371 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:15.324330    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"]
Jul 09 13:37:15.324605 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:15.324582    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz" podUID="71597320-f7bd-48aa-ab1b-318a17dc3295" containerName="limitador" containerID="cri-o://6c8619b3f2650266c1dd8c27e5f3dd23098b0633e3920d05433ab597eca617d0" gracePeriod=30
Jul 09 13:37:15.749842 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:15.749807    2583 generic.go:356] "Generic (PLEG): container finished" podID="71597320-f7bd-48aa-ab1b-318a17dc3295" containerID="6c8619b3f2650266c1dd8c27e5f3dd23098b0633e3920d05433ab597eca617d0" exitCode=0
Jul 09 13:37:15.750241 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:15.749900    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz" event={"ID":"71597320-f7bd-48aa-ab1b-318a17dc3295","Type":"ContainerDied","Data":"6c8619b3f2650266c1dd8c27e5f3dd23098b0633e3920d05433ab597eca617d0"}
Jul 09 13:37:15.876914 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:15.876882    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:37:16.021337 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:16.021218    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71597320-f7bd-48aa-ab1b-318a17dc3295-config-file\") pod \"71597320-f7bd-48aa-ab1b-318a17dc3295\" (UID: \"71597320-f7bd-48aa-ab1b-318a17dc3295\") "
Jul 09 13:37:16.021337 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:16.021263    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7knkh\" (UniqueName: \"kubernetes.io/projected/71597320-f7bd-48aa-ab1b-318a17dc3295-kube-api-access-7knkh\") pod \"71597320-f7bd-48aa-ab1b-318a17dc3295\" (UID: \"71597320-f7bd-48aa-ab1b-318a17dc3295\") "
Jul 09 13:37:16.021621 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:16.021593    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71597320-f7bd-48aa-ab1b-318a17dc3295-config-file" (OuterVolumeSpecName: "config-file") pod "71597320-f7bd-48aa-ab1b-318a17dc3295" (UID: "71597320-f7bd-48aa-ab1b-318a17dc3295"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:37:16.023432 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:16.023403    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71597320-f7bd-48aa-ab1b-318a17dc3295-kube-api-access-7knkh" (OuterVolumeSpecName: "kube-api-access-7knkh") pod "71597320-f7bd-48aa-ab1b-318a17dc3295" (UID: "71597320-f7bd-48aa-ab1b-318a17dc3295"). InnerVolumeSpecName "kube-api-access-7knkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:37:16.122110 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:16.122067    2583 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71597320-f7bd-48aa-ab1b-318a17dc3295-config-file\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:37:16.122110 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:16.122105    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7knkh\" (UniqueName: \"kubernetes.io/projected/71597320-f7bd-48aa-ab1b-318a17dc3295-kube-api-access-7knkh\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:37:16.756244 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:16.756154    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz" event={"ID":"71597320-f7bd-48aa-ab1b-318a17dc3295","Type":"ContainerDied","Data":"e45c8d7c00a9781980611a15180b69b5168adc91941281e29ddf35dad9e3bdc9"}
Jul 09 13:37:16.756244 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:16.756172    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"
Jul 09 13:37:16.756244 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:16.756216    2583 scope.go:117] "RemoveContainer" containerID="6c8619b3f2650266c1dd8c27e5f3dd23098b0633e3920d05433ab597eca617d0"
Jul 09 13:37:16.797641 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:16.797604    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"]
Jul 09 13:37:16.809405 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:16.809356    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vxgmz"]
Jul 09 13:37:18.316476 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:18.316434    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71597320-f7bd-48aa-ab1b-318a17dc3295" path="/var/lib/kubelet/pods/71597320-f7bd-48aa-ab1b-318a17dc3295/volumes"
Jul 09 13:37:18.952417 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:18.952377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:19.042412 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.042372    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:19.474675 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.474635    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"]
Jul 09 13:37:19.475235 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.475218    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71597320-f7bd-48aa-ab1b-318a17dc3295" containerName="limitador"
Jul 09 13:37:19.475306 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.475238    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="71597320-f7bd-48aa-ab1b-318a17dc3295" containerName="limitador"
Jul 09 13:37:19.475353 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.475344    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="71597320-f7bd-48aa-ab1b-318a17dc3295" containerName="limitador"
Jul 09 13:37:19.479739 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.479716    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"
Jul 09 13:37:19.484363 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.484329    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 13:37:19.484530 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.484412    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-96nwt\""
Jul 09 13:37:19.486116 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.486090    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 13:37:19.488475 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.488456    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 09 13:37:19.495060 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.495031    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"]
Jul 09 13:37:19.522809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.522743    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:19.654954 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.654910    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/75920b48-6248-4f33-94c3-1b67a9062e08-data\") pod \"postgres-69fb4594cf-dxvrc\" (UID: \"75920b48-6248-4f33-94c3-1b67a9062e08\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"
Jul 09 13:37:19.654954 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.654958    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jczm\" (UniqueName: \"kubernetes.io/projected/75920b48-6248-4f33-94c3-1b67a9062e08-kube-api-access-4jczm\") pod \"postgres-69fb4594cf-dxvrc\" (UID: \"75920b48-6248-4f33-94c3-1b67a9062e08\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"
Jul 09 13:37:19.755833 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.755730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/75920b48-6248-4f33-94c3-1b67a9062e08-data\") pod \"postgres-69fb4594cf-dxvrc\" (UID: \"75920b48-6248-4f33-94c3-1b67a9062e08\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"
Jul 09 13:37:19.755833 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.755771    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jczm\" (UniqueName: \"kubernetes.io/projected/75920b48-6248-4f33-94c3-1b67a9062e08-kube-api-access-4jczm\") pod \"postgres-69fb4594cf-dxvrc\" (UID: \"75920b48-6248-4f33-94c3-1b67a9062e08\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"
Jul 09 13:37:19.756138 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.756118    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/75920b48-6248-4f33-94c3-1b67a9062e08-data\") pod \"postgres-69fb4594cf-dxvrc\" (UID: \"75920b48-6248-4f33-94c3-1b67a9062e08\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"
Jul 09 13:37:19.764901 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.764872    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jczm\" (UniqueName: \"kubernetes.io/projected/75920b48-6248-4f33-94c3-1b67a9062e08-kube-api-access-4jczm\") pod \"postgres-69fb4594cf-dxvrc\" (UID: \"75920b48-6248-4f33-94c3-1b67a9062e08\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"
Jul 09 13:37:19.791464 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.791427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"
Jul 09 13:37:19.937889 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:19.937861    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"]
Jul 09 13:37:19.939932 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:37:19.939897    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75920b48_6248_4f33_94c3_1b67a9062e08.slice/crio-7237c93ff78f406aa689d3478a43eeb0e16f55ccf390c3a84edb3087509ffece WatchSource:0}: Error finding container 7237c93ff78f406aa689d3478a43eeb0e16f55ccf390c3a84edb3087509ffece: Status 404 returned error can't find the container with id 7237c93ff78f406aa689d3478a43eeb0e16f55ccf390c3a84edb3087509ffece
Jul 09 13:37:20.786991 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:20.786945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc" event={"ID":"75920b48-6248-4f33-94c3-1b67a9062e08","Type":"ContainerStarted","Data":"7237c93ff78f406aa689d3478a43eeb0e16f55ccf390c3a84edb3087509ffece"}
Jul 09 13:37:24.818259 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:24.818213    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc" event={"ID":"75920b48-6248-4f33-94c3-1b67a9062e08","Type":"ContainerStarted","Data":"9d1b6159b6ec304bbc6faece2e73aa3f4356e602d089dd9a13b5d6fd02c4ce8b"}
Jul 09 13:37:24.818740 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:24.818417    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"
Jul 09 13:37:24.838553 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:24.838499    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc" podStartSLOduration=1.1043968 podStartE2EDuration="5.838483302s" totalImagesPullingTime="4.734086502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:37:24.837843375 +0000 UTC m=+491.049833791" watchObservedRunningTime="2026-07-09 13:37:24.838483302 +0000 UTC m=+491.050473717"
Jul 09 13:37:30.854386 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:30.854348    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dxvrc"
Jul 09 13:37:31.181887 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.181791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:31.411659 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.411620    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kkxn5"]
Jul 09 13:37:31.418065 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.418040    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kkxn5"
Jul 09 13:37:31.422445 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.422417    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kkxn5"]
Jul 09 13:37:31.464446 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.464361    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk5l7\" (UniqueName: \"kubernetes.io/projected/fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f-kube-api-access-vk5l7\") pod \"authorino-5d4b67c446-kkxn5\" (UID: \"fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f\") " pod="kuadrant-system/authorino-5d4b67c446-kkxn5"
Jul 09 13:37:31.478828 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.478795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:31.565566 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.565523    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5l7\" (UniqueName: \"kubernetes.io/projected/fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f-kube-api-access-vk5l7\") pod \"authorino-5d4b67c446-kkxn5\" (UID: \"fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f\") " pod="kuadrant-system/authorino-5d4b67c446-kkxn5"
Jul 09 13:37:31.580047 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.580017    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk5l7\" (UniqueName: \"kubernetes.io/projected/fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f-kube-api-access-vk5l7\") pod \"authorino-5d4b67c446-kkxn5\" (UID: \"fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f\") " pod="kuadrant-system/authorino-5d4b67c446-kkxn5"
Jul 09 13:37:31.607188 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.607148    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:31.680643 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.680591    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kkxn5"]
Jul 09 13:37:31.680882 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.680867    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kkxn5"
Jul 09 13:37:31.713650 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.713614    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d57c45779-mc6ww"]
Jul 09 13:37:31.719259 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.719188    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d57c45779-mc6ww"
Jul 09 13:37:31.727197 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.727165    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d57c45779-mc6ww"]
Jul 09 13:37:31.766603 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.766568    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6k4h\" (UniqueName: \"kubernetes.io/projected/4b2282f0-440a-4358-878b-dd3d47fea503-kube-api-access-l6k4h\") pod \"authorino-d57c45779-mc6ww\" (UID: \"4b2282f0-440a-4358-878b-dd3d47fea503\") " pod="kuadrant-system/authorino-d57c45779-mc6ww"
Jul 09 13:37:31.804094 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.804060    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d57c45779-mc6ww"]
Jul 09 13:37:31.804390 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:37:31.804367    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-l6k4h], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-d57c45779-mc6ww" podUID="4b2282f0-440a-4358-878b-dd3d47fea503"
Jul 09 13:37:31.831868 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.831837    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kkxn5"]
Jul 09 13:37:31.834438 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:37:31.834409    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd26ba5d_7229_4c6f_98d8_4e7aa6bd811f.slice/crio-3c806cf93ab9dd345b4d8293254666cd003f6e87f748f3a0b1db4cff30e43a79 WatchSource:0}: Error finding container 3c806cf93ab9dd345b4d8293254666cd003f6e87f748f3a0b1db4cff30e43a79: Status 404 returned error can't find the container with id 3c806cf93ab9dd345b4d8293254666cd003f6e87f748f3a0b1db4cff30e43a79
Jul 09 13:37:31.834998 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.834976    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76b4744787-rhsn6"]
Jul 09 13:37:31.838975 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.838957    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b4744787-rhsn6"
Jul 09 13:37:31.841934 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.841912    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 13:37:31.848860 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.848834    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76b4744787-rhsn6"]
Jul 09 13:37:31.857899 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.857812    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kkxn5" event={"ID":"fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f","Type":"ContainerStarted","Data":"3c806cf93ab9dd345b4d8293254666cd003f6e87f748f3a0b1db4cff30e43a79"}
Jul 09 13:37:31.857899 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.857842    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d57c45779-mc6ww"
Jul 09 13:37:31.866241 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.866212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d57c45779-mc6ww"
Jul 09 13:37:31.867388 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.867366    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97518ccf-3b53-403a-9c21-c67ee081fe67-tls-cert\") pod \"authorino-76b4744787-rhsn6\" (UID: \"97518ccf-3b53-403a-9c21-c67ee081fe67\") " pod="kuadrant-system/authorino-76b4744787-rhsn6"
Jul 09 13:37:31.867504 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.867415    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzgw2\" (UniqueName: \"kubernetes.io/projected/97518ccf-3b53-403a-9c21-c67ee081fe67-kube-api-access-mzgw2\") pod \"authorino-76b4744787-rhsn6\" (UID: \"97518ccf-3b53-403a-9c21-c67ee081fe67\") " pod="kuadrant-system/authorino-76b4744787-rhsn6"
Jul 09 13:37:31.867504 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.867449    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6k4h\" (UniqueName: \"kubernetes.io/projected/4b2282f0-440a-4358-878b-dd3d47fea503-kube-api-access-l6k4h\") pod \"authorino-d57c45779-mc6ww\" (UID: \"4b2282f0-440a-4358-878b-dd3d47fea503\") " pod="kuadrant-system/authorino-d57c45779-mc6ww"
Jul 09 13:37:31.878741 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.878714    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6k4h\" (UniqueName: \"kubernetes.io/projected/4b2282f0-440a-4358-878b-dd3d47fea503-kube-api-access-l6k4h\") pod \"authorino-d57c45779-mc6ww\" (UID: \"4b2282f0-440a-4358-878b-dd3d47fea503\") " pod="kuadrant-system/authorino-d57c45779-mc6ww"
Jul 09 13:37:31.968573 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.968543    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6k4h\" (UniqueName: \"kubernetes.io/projected/4b2282f0-440a-4358-878b-dd3d47fea503-kube-api-access-l6k4h\") pod \"4b2282f0-440a-4358-878b-dd3d47fea503\" (UID: \"4b2282f0-440a-4358-878b-dd3d47fea503\") "
Jul 09 13:37:31.968772 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.968729    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97518ccf-3b53-403a-9c21-c67ee081fe67-tls-cert\") pod \"authorino-76b4744787-rhsn6\" (UID: \"97518ccf-3b53-403a-9c21-c67ee081fe67\") " pod="kuadrant-system/authorino-76b4744787-rhsn6"
Jul 09 13:37:31.968772 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.968761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzgw2\" (UniqueName: \"kubernetes.io/projected/97518ccf-3b53-403a-9c21-c67ee081fe67-kube-api-access-mzgw2\") pod \"authorino-76b4744787-rhsn6\" (UID: \"97518ccf-3b53-403a-9c21-c67ee081fe67\") " pod="kuadrant-system/authorino-76b4744787-rhsn6"
Jul 09 13:37:31.970835 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.970754    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b2282f0-440a-4358-878b-dd3d47fea503-kube-api-access-l6k4h" (OuterVolumeSpecName: "kube-api-access-l6k4h") pod "4b2282f0-440a-4358-878b-dd3d47fea503" (UID: "4b2282f0-440a-4358-878b-dd3d47fea503"). InnerVolumeSpecName "kube-api-access-l6k4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:37:31.971098 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.971080    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97518ccf-3b53-403a-9c21-c67ee081fe67-tls-cert\") pod \"authorino-76b4744787-rhsn6\" (UID: \"97518ccf-3b53-403a-9c21-c67ee081fe67\") " pod="kuadrant-system/authorino-76b4744787-rhsn6"
Jul 09 13:37:31.978002 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:31.977983    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzgw2\" (UniqueName: \"kubernetes.io/projected/97518ccf-3b53-403a-9c21-c67ee081fe67-kube-api-access-mzgw2\") pod \"authorino-76b4744787-rhsn6\" (UID: \"97518ccf-3b53-403a-9c21-c67ee081fe67\") " pod="kuadrant-system/authorino-76b4744787-rhsn6"
Jul 09 13:37:32.069138 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.069100    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6k4h\" (UniqueName: \"kubernetes.io/projected/4b2282f0-440a-4358-878b-dd3d47fea503-kube-api-access-l6k4h\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:37:32.151513 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.151474    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b4744787-rhsn6"
Jul 09 13:37:32.305080 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.305038    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76b4744787-rhsn6"]
Jul 09 13:37:32.307476 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:37:32.307447    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97518ccf_3b53_403a_9c21_c67ee081fe67.slice/crio-2c8035652d7356e6a294c66c73e93221e7543c6f1c15ebb44c0a6b9ac6d05c11 WatchSource:0}: Error finding container 2c8035652d7356e6a294c66c73e93221e7543c6f1c15ebb44c0a6b9ac6d05c11: Status 404 returned error can't find the container with id 2c8035652d7356e6a294c66c73e93221e7543c6f1c15ebb44c0a6b9ac6d05c11
Jul 09 13:37:32.866167 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.866056    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kkxn5" event={"ID":"fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f","Type":"ContainerStarted","Data":"f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7"}
Jul 09 13:37:32.866167 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.866062    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-kkxn5" podUID="fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f" containerName="authorino" containerID="cri-o://f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7" gracePeriod=30
Jul 09 13:37:32.868260 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.868230    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b4744787-rhsn6" event={"ID":"97518ccf-3b53-403a-9c21-c67ee081fe67","Type":"ContainerStarted","Data":"56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf"}
Jul 09 13:37:32.868417 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.868277    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b4744787-rhsn6" event={"ID":"97518ccf-3b53-403a-9c21-c67ee081fe67","Type":"ContainerStarted","Data":"2c8035652d7356e6a294c66c73e93221e7543c6f1c15ebb44c0a6b9ac6d05c11"}
Jul 09 13:37:32.868417 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.868317    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d57c45779-mc6ww"
Jul 09 13:37:32.886626 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.886566    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-kkxn5" podStartSLOduration=1.521383031 podStartE2EDuration="1.886545739s" totalImagesPullingTime="365.162708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:37:32.884367194 +0000 UTC m=+499.096357651" watchObservedRunningTime="2026-07-09 13:37:32.886545739 +0000 UTC m=+499.098536154"
Jul 09 13:37:32.911150 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.911115    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d57c45779-mc6ww"]
Jul 09 13:37:32.915835 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.915805    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d57c45779-mc6ww"]
Jul 09 13:37:32.931159 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.931093    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76b4744787-rhsn6" podStartSLOduration=1.5024731199999999 podStartE2EDuration="1.931069748s" totalImagesPullingTime="428.596628ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:37:32.930917592 +0000 UTC m=+499.142908032" watchObservedRunningTime="2026-07-09 13:37:32.931069748 +0000 UTC m=+499.143060168"
Jul 09 13:37:32.962169 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.962129    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdld2"]
Jul 09 13:37:32.962429 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:32.962395    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-fdld2" podUID="57e870d0-2c95-416f-8ee3-42409b0ef794" containerName="authorino" containerID="cri-o://043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000" gracePeriod=30
Jul 09 13:37:33.114389 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.114356    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kkxn5"
Jul 09 13:37:33.177799 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.177768    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk5l7\" (UniqueName: \"kubernetes.io/projected/fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f-kube-api-access-vk5l7\") pod \"fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f\" (UID: \"fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f\") "
Jul 09 13:37:33.179742 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.179713    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f-kube-api-access-vk5l7" (OuterVolumeSpecName: "kube-api-access-vk5l7") pod "fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f" (UID: "fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f"). InnerVolumeSpecName "kube-api-access-vk5l7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:37:33.214963 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.214935    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fdld2"
Jul 09 13:37:33.278661 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.278627    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mkt8\" (UniqueName: \"kubernetes.io/projected/57e870d0-2c95-416f-8ee3-42409b0ef794-kube-api-access-2mkt8\") pod \"57e870d0-2c95-416f-8ee3-42409b0ef794\" (UID: \"57e870d0-2c95-416f-8ee3-42409b0ef794\") "
Jul 09 13:37:33.278817 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.278806    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk5l7\" (UniqueName: \"kubernetes.io/projected/fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f-kube-api-access-vk5l7\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:37:33.280718 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.280685    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57e870d0-2c95-416f-8ee3-42409b0ef794-kube-api-access-2mkt8" (OuterVolumeSpecName: "kube-api-access-2mkt8") pod "57e870d0-2c95-416f-8ee3-42409b0ef794" (UID: "57e870d0-2c95-416f-8ee3-42409b0ef794"). InnerVolumeSpecName "kube-api-access-2mkt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:37:33.379270 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.379236    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mkt8\" (UniqueName: \"kubernetes.io/projected/57e870d0-2c95-416f-8ee3-42409b0ef794-kube-api-access-2mkt8\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:37:33.875995 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.875880    2583 generic.go:356] "Generic (PLEG): container finished" podID="fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f" containerID="f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7" exitCode=0
Jul 09 13:37:33.875995 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.875927    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kkxn5"
Jul 09 13:37:33.875995 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.875965    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kkxn5" event={"ID":"fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f","Type":"ContainerDied","Data":"f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7"}
Jul 09 13:37:33.876642 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.876012    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kkxn5" event={"ID":"fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f","Type":"ContainerDied","Data":"3c806cf93ab9dd345b4d8293254666cd003f6e87f748f3a0b1db4cff30e43a79"}
Jul 09 13:37:33.876642 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.876033    2583 scope.go:117] "RemoveContainer" containerID="f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7"
Jul 09 13:37:33.877692 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.877668    2583 generic.go:356] "Generic (PLEG): container finished" podID="57e870d0-2c95-416f-8ee3-42409b0ef794" containerID="043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000" exitCode=0
Jul 09 13:37:33.877782 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.877735    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fdld2"
Jul 09 13:37:33.877782 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.877764    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fdld2" event={"ID":"57e870d0-2c95-416f-8ee3-42409b0ef794","Type":"ContainerDied","Data":"043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000"}
Jul 09 13:37:33.877855 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.877800    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fdld2" event={"ID":"57e870d0-2c95-416f-8ee3-42409b0ef794","Type":"ContainerDied","Data":"f592fe8b4e45f5f7a8afdb0abc7d27f102dbe280075e6f85f7b9f3cbd2ad8e30"}
Jul 09 13:37:33.887135 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.887114    2583 scope.go:117] "RemoveContainer" containerID="f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7"
Jul 09 13:37:33.887460 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:37:33.887440    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7\": container with ID starting with f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7 not found: ID does not exist" containerID="f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7"
Jul 09 13:37:33.887537 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.887470    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7"} err="failed to get container status \"f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7\": rpc error: code = NotFound desc = could not find container \"f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7\": container with ID starting with f09c72639b523fdb2de80fc3ce9a5fbf98a855f7b1653dfb9cdce818e33928e7 not found: ID does not exist"
Jul 09 13:37:33.887537 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.887489    2583 scope.go:117] "RemoveContainer" containerID="043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000"
Jul 09 13:37:33.896775 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.896746    2583 scope.go:117] "RemoveContainer" containerID="043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000"
Jul 09 13:37:33.897121 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:37:33.897101    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000\": container with ID starting with 043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000 not found: ID does not exist" containerID="043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000"
Jul 09 13:37:33.897172 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.897130    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000"} err="failed to get container status \"043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000\": rpc error: code = NotFound desc = could not find container \"043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000\": container with ID starting with 043cf59f8b92b9e8fd69ea7fdc39b4ada2841c75216f40dce381ca9054dcd000 not found: ID does not exist"
Jul 09 13:37:33.901960 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.901931    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kkxn5"]
Jul 09 13:37:33.909881 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.909853    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kkxn5"]
Jul 09 13:37:33.922890 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.922859    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdld2"]
Jul 09 13:37:33.927747 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:33.927718    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdld2"]
Jul 09 13:37:34.317004 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:34.316978    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b2282f0-440a-4358-878b-dd3d47fea503" path="/var/lib/kubelet/pods/4b2282f0-440a-4358-878b-dd3d47fea503/volumes"
Jul 09 13:37:34.317207 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:34.317195    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57e870d0-2c95-416f-8ee3-42409b0ef794" path="/var/lib/kubelet/pods/57e870d0-2c95-416f-8ee3-42409b0ef794/volumes"
Jul 09 13:37:34.317543 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:34.317530    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f" path="/var/lib/kubelet/pods/fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f/volumes"
Jul 09 13:37:37.348046 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.347996    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:37.373672 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.373639    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fcc97bdd-47zn4"]
Jul 09 13:37:37.374028 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.374014    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f" containerName="authorino"
Jul 09 13:37:37.374091 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.374030    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f" containerName="authorino"
Jul 09 13:37:37.374091 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.374046    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e870d0-2c95-416f-8ee3-42409b0ef794" containerName="authorino"
Jul 09 13:37:37.374091 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.374052    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e870d0-2c95-416f-8ee3-42409b0ef794" containerName="authorino"
Jul 09 13:37:37.374224 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.374134    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd26ba5d-7229-4c6f-98d8-4e7aa6bd811f" containerName="authorino"
Jul 09 13:37:37.374224 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.374145    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="57e870d0-2c95-416f-8ee3-42409b0ef794" containerName="authorino"
Jul 09 13:37:37.398172 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.398136    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fcc97bdd-47zn4"]
Jul 09 13:37:37.398336 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.398247    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:37.401669 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.401488    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 13:37:37.401669 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.401503    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 13:37:37.401669 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.401577    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xnk68\""
Jul 09 13:37:37.416108 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.416079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32741463-e61f-48ae-af29-d996e37592c2-service-ca\") pod \"maas-controller-6fcc97bdd-47zn4\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") " pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:37.416263 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.416167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79qr5\" (UniqueName: \"kubernetes.io/projected/32741463-e61f-48ae-af29-d996e37592c2-kube-api-access-79qr5\") pod \"maas-controller-6fcc97bdd-47zn4\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") " pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:37.416381 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.416299    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32741463-e61f-48ae-af29-d996e37592c2-webhook-cert\") pod \"maas-controller-6fcc97bdd-47zn4\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") " pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:37.453680 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.453628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:37.517061 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.517026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79qr5\" (UniqueName: \"kubernetes.io/projected/32741463-e61f-48ae-af29-d996e37592c2-kube-api-access-79qr5\") pod \"maas-controller-6fcc97bdd-47zn4\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") " pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:37.517258 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.517082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32741463-e61f-48ae-af29-d996e37592c2-webhook-cert\") pod \"maas-controller-6fcc97bdd-47zn4\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") " pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:37.517258 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.517114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32741463-e61f-48ae-af29-d996e37592c2-service-ca\") pod \"maas-controller-6fcc97bdd-47zn4\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") " pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:37.517258 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:37:37.517234    2583 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 09 13:37:37.517460 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:37:37.517339    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32741463-e61f-48ae-af29-d996e37592c2-webhook-cert podName:32741463-e61f-48ae-af29-d996e37592c2 nodeName:}" failed. No retries permitted until 2026-07-09 13:37:38.017317833 +0000 UTC m=+504.229308235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/32741463-e61f-48ae-af29-d996e37592c2-webhook-cert") pod "maas-controller-6fcc97bdd-47zn4" (UID: "32741463-e61f-48ae-af29-d996e37592c2") : secret "maas-controller-webhook-cert" not found
Jul 09 13:37:37.517779 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.517760    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32741463-e61f-48ae-af29-d996e37592c2-service-ca\") pod \"maas-controller-6fcc97bdd-47zn4\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") " pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:37.518795 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.518765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:37.527004 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.526982    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79qr5\" (UniqueName: \"kubernetes.io/projected/32741463-e61f-48ae-af29-d996e37592c2-kube-api-access-79qr5\") pod \"maas-controller-6fcc97bdd-47zn4\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") " pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:37.568914 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.568878    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dcf598fd9-w6khk"]
Jul 09 13:37:37.577822 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.577794    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:37.582196 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.582163    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dcf598fd9-w6khk"]
Jul 09 13:37:37.618141 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.618059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/713254e4-6baa-4639-b252-0aaf09ee5f9d-webhook-cert\") pod \"maas-controller-7dcf598fd9-w6khk\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") " pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:37.618339 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.618163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8svs8\" (UniqueName: \"kubernetes.io/projected/713254e4-6baa-4639-b252-0aaf09ee5f9d-kube-api-access-8svs8\") pod \"maas-controller-7dcf598fd9-w6khk\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") " pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:37.618339 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.618212    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/713254e4-6baa-4639-b252-0aaf09ee5f9d-service-ca\") pod \"maas-controller-7dcf598fd9-w6khk\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") " pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:37.719635 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.719590    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/713254e4-6baa-4639-b252-0aaf09ee5f9d-webhook-cert\") pod \"maas-controller-7dcf598fd9-w6khk\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") " pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:37.719852 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.719657    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8svs8\" (UniqueName: \"kubernetes.io/projected/713254e4-6baa-4639-b252-0aaf09ee5f9d-kube-api-access-8svs8\") pod \"maas-controller-7dcf598fd9-w6khk\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") " pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:37.719852 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.719677    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/713254e4-6baa-4639-b252-0aaf09ee5f9d-service-ca\") pod \"maas-controller-7dcf598fd9-w6khk\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") " pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:37.719852 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:37:37.719772    2583 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 09 13:37:37.720018 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:37:37.719856    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713254e4-6baa-4639-b252-0aaf09ee5f9d-webhook-cert podName:713254e4-6baa-4639-b252-0aaf09ee5f9d nodeName:}" failed. No retries permitted until 2026-07-09 13:37:38.219834557 +0000 UTC m=+504.431824967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/713254e4-6baa-4639-b252-0aaf09ee5f9d-webhook-cert") pod "maas-controller-7dcf598fd9-w6khk" (UID: "713254e4-6baa-4639-b252-0aaf09ee5f9d") : secret "maas-controller-webhook-cert" not found
Jul 09 13:37:37.720347 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.720330    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/713254e4-6baa-4639-b252-0aaf09ee5f9d-service-ca\") pod \"maas-controller-7dcf598fd9-w6khk\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") " pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:37.731980 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.731949    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8svs8\" (UniqueName: \"kubernetes.io/projected/713254e4-6baa-4639-b252-0aaf09ee5f9d-kube-api-access-8svs8\") pod \"maas-controller-7dcf598fd9-w6khk\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") " pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:37.914492 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:37.914399    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:38.021961 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:38.021918    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32741463-e61f-48ae-af29-d996e37592c2-webhook-cert\") pod \"maas-controller-6fcc97bdd-47zn4\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") " pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:38.024460 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:38.024425    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32741463-e61f-48ae-af29-d996e37592c2-webhook-cert\") pod \"maas-controller-6fcc97bdd-47zn4\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") " pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:38.223366 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:38.223235    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/713254e4-6baa-4639-b252-0aaf09ee5f9d-webhook-cert\") pod \"maas-controller-7dcf598fd9-w6khk\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") " pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:38.225796 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:38.225769    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/713254e4-6baa-4639-b252-0aaf09ee5f9d-webhook-cert\") pod \"maas-controller-7dcf598fd9-w6khk\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") " pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:38.312579 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:38.312537    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:38.491453 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:38.491348    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:38.498227 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:38.498194    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fcc97bdd-47zn4"]
Jul 09 13:37:38.499381 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:37:38.499353    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32741463_e61f_48ae_af29_d996e37592c2.slice/crio-a837215a1962311cf648971f80bef3e89e9258dbc4ea5cd06801ebdf968194c0 WatchSource:0}: Error finding container a837215a1962311cf648971f80bef3e89e9258dbc4ea5cd06801ebdf968194c0: Status 404 returned error can't find the container with id a837215a1962311cf648971f80bef3e89e9258dbc4ea5cd06801ebdf968194c0
Jul 09 13:37:38.661209 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:38.661179    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dcf598fd9-w6khk"]
Jul 09 13:37:38.663561 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:37:38.663532    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713254e4_6baa_4639_b252_0aaf09ee5f9d.slice/crio-b19bc29de774fdf2964b8b54518d9d97bf11c8e42a5876857b8485da40f3fe95 WatchSource:0}: Error finding container b19bc29de774fdf2964b8b54518d9d97bf11c8e42a5876857b8485da40f3fe95: Status 404 returned error can't find the container with id b19bc29de774fdf2964b8b54518d9d97bf11c8e42a5876857b8485da40f3fe95
Jul 09 13:37:38.909375 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:38.909337    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcf598fd9-w6khk" event={"ID":"713254e4-6baa-4639-b252-0aaf09ee5f9d","Type":"ContainerStarted","Data":"b19bc29de774fdf2964b8b54518d9d97bf11c8e42a5876857b8485da40f3fe95"}
Jul 09 13:37:38.910473 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:38.910442    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fcc97bdd-47zn4" event={"ID":"32741463-e61f-48ae-af29-d996e37592c2","Type":"ContainerStarted","Data":"a837215a1962311cf648971f80bef3e89e9258dbc4ea5cd06801ebdf968194c0"}
Jul 09 13:37:41.117789 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:41.117749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:41.213856 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:41.213764    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:41.311355 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:41.311312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:37:41.935737 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:41.935693    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcf598fd9-w6khk" event={"ID":"713254e4-6baa-4639-b252-0aaf09ee5f9d","Type":"ContainerStarted","Data":"04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6"}
Jul 09 13:37:41.935945 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:41.935825    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:41.937464 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:41.937440    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fcc97bdd-47zn4" event={"ID":"32741463-e61f-48ae-af29-d996e37592c2","Type":"ContainerStarted","Data":"7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30"}
Jul 09 13:37:41.937589 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:41.937490    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:41.989737 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:41.989673    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dcf598fd9-w6khk" podStartSLOduration=2.752962849 podStartE2EDuration="4.989653606s" totalImagesPullingTime="2.236690757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:37:41.98715286 +0000 UTC m=+508.199143274" watchObservedRunningTime="2026-07-09 13:37:41.989653606 +0000 UTC m=+508.201644021"
Jul 09 13:37:42.013719 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:42.013666    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6fcc97bdd-47zn4" podStartSLOduration=2.60137508 podStartE2EDuration="5.013645871s" totalImagesPullingTime="2.412270791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:37:42.012858105 +0000 UTC m=+508.224848519" watchObservedRunningTime="2026-07-09 13:37:42.013645871 +0000 UTC m=+508.225636286"
Jul 09 13:37:52.951622 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:52.951590    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:52.952115 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:52.951823    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:37:53.029674 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.029641    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fcc97bdd-47zn4"]
Jul 09 13:37:53.029892 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.029856    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6fcc97bdd-47zn4" podUID="32741463-e61f-48ae-af29-d996e37592c2" containerName="manager" containerID="cri-o://7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30" gracePeriod=30
Jul 09 13:37:53.285834 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.285802    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:53.356795 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.356757    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32741463-e61f-48ae-af29-d996e37592c2-webhook-cert\") pod \"32741463-e61f-48ae-af29-d996e37592c2\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") "
Jul 09 13:37:53.356996 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.356813    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32741463-e61f-48ae-af29-d996e37592c2-service-ca\") pod \"32741463-e61f-48ae-af29-d996e37592c2\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") "
Jul 09 13:37:53.356996 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.356836    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79qr5\" (UniqueName: \"kubernetes.io/projected/32741463-e61f-48ae-af29-d996e37592c2-kube-api-access-79qr5\") pod \"32741463-e61f-48ae-af29-d996e37592c2\" (UID: \"32741463-e61f-48ae-af29-d996e37592c2\") "
Jul 09 13:37:53.357414 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.357223    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32741463-e61f-48ae-af29-d996e37592c2-service-ca" (OuterVolumeSpecName: "service-ca") pod "32741463-e61f-48ae-af29-d996e37592c2" (UID: "32741463-e61f-48ae-af29-d996e37592c2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:37:53.359172 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.359141    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32741463-e61f-48ae-af29-d996e37592c2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "32741463-e61f-48ae-af29-d996e37592c2" (UID: "32741463-e61f-48ae-af29-d996e37592c2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:37:53.359268 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.359142    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32741463-e61f-48ae-af29-d996e37592c2-kube-api-access-79qr5" (OuterVolumeSpecName: "kube-api-access-79qr5") pod "32741463-e61f-48ae-af29-d996e37592c2" (UID: "32741463-e61f-48ae-af29-d996e37592c2"). InnerVolumeSpecName "kube-api-access-79qr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:37:53.458472 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.458431    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32741463-e61f-48ae-af29-d996e37592c2-webhook-cert\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:37:53.458472 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.458464    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32741463-e61f-48ae-af29-d996e37592c2-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:37:53.458472 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:53.458475    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79qr5\" (UniqueName: \"kubernetes.io/projected/32741463-e61f-48ae-af29-d996e37592c2-kube-api-access-79qr5\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:37:54.008357 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:54.008312    2583 generic.go:356] "Generic (PLEG): container finished" podID="32741463-e61f-48ae-af29-d996e37592c2" containerID="7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30" exitCode=0
Jul 09 13:37:54.008899 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:54.008525    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fcc97bdd-47zn4" event={"ID":"32741463-e61f-48ae-af29-d996e37592c2","Type":"ContainerDied","Data":"7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30"}
Jul 09 13:37:54.008899 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:54.008621    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fcc97bdd-47zn4" event={"ID":"32741463-e61f-48ae-af29-d996e37592c2","Type":"ContainerDied","Data":"a837215a1962311cf648971f80bef3e89e9258dbc4ea5cd06801ebdf968194c0"}
Jul 09 13:37:54.008899 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:54.008671    2583 scope.go:117] "RemoveContainer" containerID="7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30"
Jul 09 13:37:54.008899 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:54.008880    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fcc97bdd-47zn4"
Jul 09 13:37:54.020304 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:54.020259    2583 scope.go:117] "RemoveContainer" containerID="7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30"
Jul 09 13:37:54.020610 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:37:54.020589    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30\": container with ID starting with 7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30 not found: ID does not exist" containerID="7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30"
Jul 09 13:37:54.020659 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:54.020620    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30"} err="failed to get container status \"7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30\": rpc error: code = NotFound desc = could not find container \"7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30\": container with ID starting with 7d2d69dfb1cd930ca029cd59cf380abd218d7773959c811131403a2ffa66fb30 not found: ID does not exist"
Jul 09 13:37:54.037677 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:54.037646    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fcc97bdd-47zn4"]
Jul 09 13:37:54.041947 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:54.041914    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6fcc97bdd-47zn4"]
Jul 09 13:37:54.316943 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:37:54.316916    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32741463-e61f-48ae-af29-d996e37592c2" path="/var/lib/kubelet/pods/32741463-e61f-48ae-af29-d996e37592c2/volumes"
Jul 09 13:38:09.135244 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:09.135148    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:12.591138 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:12.591101    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:13.214978 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.214937    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:13.349971 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.349940    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"]
Jul 09 13:38:13.350371 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.350357    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32741463-e61f-48ae-af29-d996e37592c2" containerName="manager"
Jul 09 13:38:13.350420 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.350372    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="32741463-e61f-48ae-af29-d996e37592c2" containerName="manager"
Jul 09 13:38:13.350456 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.350451    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="32741463-e61f-48ae-af29-d996e37592c2" containerName="manager"
Jul 09 13:38:13.354854 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.354836    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:13.358461 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.358438    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z2qnx\""
Jul 09 13:38:13.358556 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.358444    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 09 13:38:13.368045 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.368019    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"]
Jul 09 13:38:13.537816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.537724    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36ef458a-2021-4097-a8dc-1fd8a31235ed-maas-api-tls\") pod \"maas-api-5f8bfdccf8-kkm96\" (UID: \"36ef458a-2021-4097-a8dc-1fd8a31235ed\") " pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:13.537816 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.537783    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26sqn\" (UniqueName: \"kubernetes.io/projected/36ef458a-2021-4097-a8dc-1fd8a31235ed-kube-api-access-26sqn\") pod \"maas-api-5f8bfdccf8-kkm96\" (UID: \"36ef458a-2021-4097-a8dc-1fd8a31235ed\") " pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:13.538097 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.537846    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ef458a-2021-4097-a8dc-1fd8a31235ed-openshift-service-ca\") pod \"maas-api-5f8bfdccf8-kkm96\" (UID: \"36ef458a-2021-4097-a8dc-1fd8a31235ed\") " pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:13.638463 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.638418    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36ef458a-2021-4097-a8dc-1fd8a31235ed-maas-api-tls\") pod \"maas-api-5f8bfdccf8-kkm96\" (UID: \"36ef458a-2021-4097-a8dc-1fd8a31235ed\") " pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:13.638463 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.638461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26sqn\" (UniqueName: \"kubernetes.io/projected/36ef458a-2021-4097-a8dc-1fd8a31235ed-kube-api-access-26sqn\") pod \"maas-api-5f8bfdccf8-kkm96\" (UID: \"36ef458a-2021-4097-a8dc-1fd8a31235ed\") " pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:13.638995 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.638483    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ef458a-2021-4097-a8dc-1fd8a31235ed-openshift-service-ca\") pod \"maas-api-5f8bfdccf8-kkm96\" (UID: \"36ef458a-2021-4097-a8dc-1fd8a31235ed\") " pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:13.638995 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:38:13.638693    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 09 13:38:13.638995 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:38:13.638763    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36ef458a-2021-4097-a8dc-1fd8a31235ed-maas-api-tls podName:36ef458a-2021-4097-a8dc-1fd8a31235ed nodeName:}" failed. No retries permitted until 2026-07-09 13:38:14.138742461 +0000 UTC m=+540.350732873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/36ef458a-2021-4097-a8dc-1fd8a31235ed-maas-api-tls") pod "maas-api-5f8bfdccf8-kkm96" (UID: "36ef458a-2021-4097-a8dc-1fd8a31235ed") : secret "maas-api-serving-cert" not found
Jul 09 13:38:13.639181 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.639164    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36ef458a-2021-4097-a8dc-1fd8a31235ed-openshift-service-ca\") pod \"maas-api-5f8bfdccf8-kkm96\" (UID: \"36ef458a-2021-4097-a8dc-1fd8a31235ed\") " pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:13.661818 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.661794    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26sqn\" (UniqueName: \"kubernetes.io/projected/36ef458a-2021-4097-a8dc-1fd8a31235ed-kube-api-access-26sqn\") pod \"maas-api-5f8bfdccf8-kkm96\" (UID: \"36ef458a-2021-4097-a8dc-1fd8a31235ed\") " pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:13.732715 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.732678    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:13.835365 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.835326    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:13.936180 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.936132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:13.955213 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.955179    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-7rpv6"]
Jul 09 13:38:13.959016 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.958989    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6"
Jul 09 13:38:13.962759 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.962733    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kkpdc\""
Jul 09 13:38:13.968257 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.968223    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 13:38:13.970156 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:13.970135    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-7rpv6"]
Jul 09 13:38:14.143678 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.143596    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzgxv\" (UniqueName: \"kubernetes.io/projected/033da714-f9f7-4faf-8747-2070d82cdce8-kube-api-access-xzgxv\") pod \"payload-pre-processing-7964457696-7rpv6\" (UID: \"033da714-f9f7-4faf-8747-2070d82cdce8\") " pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6"
Jul 09 13:38:14.143678 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.143636    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/033da714-f9f7-4faf-8747-2070d82cdce8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-7rpv6\" (UID: \"033da714-f9f7-4faf-8747-2070d82cdce8\") " pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6"
Jul 09 13:38:14.143863 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.143717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36ef458a-2021-4097-a8dc-1fd8a31235ed-maas-api-tls\") pod \"maas-api-5f8bfdccf8-kkm96\" (UID: \"36ef458a-2021-4097-a8dc-1fd8a31235ed\") " pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:14.146068 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.146042    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36ef458a-2021-4097-a8dc-1fd8a31235ed-maas-api-tls\") pod \"maas-api-5f8bfdccf8-kkm96\" (UID: \"36ef458a-2021-4097-a8dc-1fd8a31235ed\") " pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:14.244908 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.244865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzgxv\" (UniqueName: \"kubernetes.io/projected/033da714-f9f7-4faf-8747-2070d82cdce8-kube-api-access-xzgxv\") pod \"payload-pre-processing-7964457696-7rpv6\" (UID: \"033da714-f9f7-4faf-8747-2070d82cdce8\") " pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6"
Jul 09 13:38:14.245096 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.244912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/033da714-f9f7-4faf-8747-2070d82cdce8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-7rpv6\" (UID: \"033da714-f9f7-4faf-8747-2070d82cdce8\") " pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6"
Jul 09 13:38:14.248316 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.248260    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 13:38:14.256391 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.256358    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/033da714-f9f7-4faf-8747-2070d82cdce8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-7rpv6\" (UID: \"033da714-f9f7-4faf-8747-2070d82cdce8\") " pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6"
Jul 09 13:38:14.256678 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.256657    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzgxv\" (UniqueName: \"kubernetes.io/projected/033da714-f9f7-4faf-8747-2070d82cdce8-kube-api-access-xzgxv\") pod \"payload-pre-processing-7964457696-7rpv6\" (UID: \"033da714-f9f7-4faf-8747-2070d82cdce8\") " pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6"
Jul 09 13:38:14.268931 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.268908    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z2qnx\""
Jul 09 13:38:14.273827 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.273810    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kkpdc\""
Jul 09 13:38:14.276149 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.276135    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:14.281336 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.281309    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6"
Jul 09 13:38:14.465059 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.465030    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"]
Jul 09 13:38:14.466460 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:38:14.466425    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ef458a_2021_4097_a8dc_1fd8a31235ed.slice/crio-4c43cdf1cd15d69e928357af00896ee77b95cec8b88820dadcc3dfe798aec578 WatchSource:0}: Error finding container 4c43cdf1cd15d69e928357af00896ee77b95cec8b88820dadcc3dfe798aec578: Status 404 returned error can't find the container with id 4c43cdf1cd15d69e928357af00896ee77b95cec8b88820dadcc3dfe798aec578
Jul 09 13:38:14.496523 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:14.496493    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-7rpv6"]
Jul 09 13:38:14.498102 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:38:14.498073    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod033da714_f9f7_4faf_8747_2070d82cdce8.slice/crio-9046d9478762e81f7ee58955df3a25695b444d697fde60e3b78ae9e0cf5a8e68 WatchSource:0}: Error finding container 9046d9478762e81f7ee58955df3a25695b444d697fde60e3b78ae9e0cf5a8e68: Status 404 returned error can't find the container with id 9046d9478762e81f7ee58955df3a25695b444d697fde60e3b78ae9e0cf5a8e68
Jul 09 13:38:15.133513 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:15.133467    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96" event={"ID":"36ef458a-2021-4097-a8dc-1fd8a31235ed","Type":"ContainerStarted","Data":"4c43cdf1cd15d69e928357af00896ee77b95cec8b88820dadcc3dfe798aec578"}
Jul 09 13:38:15.134963 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:15.134929    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6" event={"ID":"033da714-f9f7-4faf-8747-2070d82cdce8","Type":"ContainerStarted","Data":"9046d9478762e81f7ee58955df3a25695b444d697fde60e3b78ae9e0cf5a8e68"}
Jul 09 13:38:17.149343 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:17.149274    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96" event={"ID":"36ef458a-2021-4097-a8dc-1fd8a31235ed","Type":"ContainerStarted","Data":"e781853d78642ca4a292b0221256bb6aeeb58409ccfcd90e7758fc8002e1d526"}
Jul 09 13:38:17.149837 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:17.149364    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:17.150960 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:17.150932    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6" event={"ID":"033da714-f9f7-4faf-8747-2070d82cdce8","Type":"ContainerStarted","Data":"e10821c0e3f62659b84a5ca2261499097f383bb6c818c5306c04cab10c6e4fe1"}
Jul 09 13:38:17.151034 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:17.151023    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6"
Jul 09 13:38:17.171281 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:17.171227    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96" podStartSLOduration=2.360044207 podStartE2EDuration="4.171214201s" totalImagesPullingTime="1.811169994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:38:17.170335329 +0000 UTC m=+543.382325759" watchObservedRunningTime="2026-07-09 13:38:17.171214201 +0000 UTC m=+543.383204615"
Jul 09 13:38:17.193884 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:17.193831    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6" podStartSLOduration=2.412183224 podStartE2EDuration="4.193815226s" totalImagesPullingTime="1.781632002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:38:17.193642923 +0000 UTC m=+543.405633339" watchObservedRunningTime="2026-07-09 13:38:17.193815226 +0000 UTC m=+543.405805651"
Jul 09 13:38:18.131453 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:18.131414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:23.162829 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:23.162798    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5f8bfdccf8-kkm96"
Jul 09 13:38:24.152333 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:24.152272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:24.251436 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:24.251394    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:28.159339 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:28.159300    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-7rpv6"
Jul 09 13:38:40.523213 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.523174    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"]
Jul 09 13:38:40.526742 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.526721    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.531786 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.531754    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 13:38:40.532391 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.532369    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 13:38:40.533594 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.533575    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hq9dz\""
Jul 09 13:38:40.534081 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.534008    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 13:38:40.550497 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.550469    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"]
Jul 09 13:38:40.557242 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.557202    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:40.578981 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.578943    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.579135 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.578995    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6fj8\" (UniqueName: \"kubernetes.io/projected/f78311b8-933f-43a9-81b7-01f7b2f6e73d-kube-api-access-z6fj8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.579135 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.579078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.579135 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.579113    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f78311b8-933f-43a9-81b7-01f7b2f6e73d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.579297 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.579200    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.579297 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.579228    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.680261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.680221    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.680504 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.680317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.680504 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.680358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fj8\" (UniqueName: \"kubernetes.io/projected/f78311b8-933f-43a9-81b7-01f7b2f6e73d-kube-api-access-z6fj8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.680504 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.680397    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.680504 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.680426    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f78311b8-933f-43a9-81b7-01f7b2f6e73d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.680504 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.680475    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.680784 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.680680    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.680784 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.680707    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.680784 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.680766    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.682825 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.682788    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f78311b8-933f-43a9-81b7-01f7b2f6e73d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.683115 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.683096    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f78311b8-933f-43a9-81b7-01f7b2f6e73d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.691692 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.691658    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6fj8\" (UniqueName: \"kubernetes.io/projected/f78311b8-933f-43a9-81b7-01f7b2f6e73d-kube-api-access-z6fj8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8\" (UID: \"f78311b8-933f-43a9-81b7-01f7b2f6e73d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.837708 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.837675    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:40.989536 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:40.989504    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"]
Jul 09 13:38:40.991581 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:38:40.991553    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78311b8_933f_43a9_81b7_01f7b2f6e73d.slice/crio-61110d4cc908b322ac399f3dd7afe47e0735476afe2947df1c06e366426b1278 WatchSource:0}: Error finding container 61110d4cc908b322ac399f3dd7afe47e0735476afe2947df1c06e366426b1278: Status 404 returned error can't find the container with id 61110d4cc908b322ac399f3dd7afe47e0735476afe2947df1c06e366426b1278
Jul 09 13:38:41.294624 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:41.294534    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8" event={"ID":"f78311b8-933f-43a9-81b7-01f7b2f6e73d","Type":"ContainerStarted","Data":"61110d4cc908b322ac399f3dd7afe47e0735476afe2947df1c06e366426b1278"}
Jul 09 13:38:43.110137 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:43.110093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:43.209404 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:43.209361    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:38:43.307548 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:43.307505    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8" event={"ID":"f78311b8-933f-43a9-81b7-01f7b2f6e73d","Type":"ContainerStarted","Data":"01bee4d1baa7a31f47c0da0326bfde862b68dbefdc39bc7789600548c7435d23"}
Jul 09 13:38:43.334217 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:43.334152    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8" podStartSLOduration=1.904959142 podStartE2EDuration="3.334134305s" totalImagesPullingTime="1.429175163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:38:43.333492713 +0000 UTC m=+569.545483138" watchObservedRunningTime="2026-07-09 13:38:43.334134305 +0000 UTC m=+569.546124720"
Jul 09 13:38:50.837918 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:50.837885    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:50.838488 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:50.837958    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:50.851487 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:50.851454    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:51.364177 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:51.364148    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8"
Jul 09 13:38:54.679636 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:38:54.679591    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:39:01.075583 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.075543    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"]
Jul 09 13:39:01.080553 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.080531    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.083733 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.083716    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 09 13:39:01.091831 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.091803    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"]
Jul 09 13:39:01.161972 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.161935    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e143118-fe97-472b-838e-1621bbebd144-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.161972 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.161976    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.162191 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.162047    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.162191 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.162111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.162191 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.162154    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74l8c\" (UniqueName: \"kubernetes.io/projected/6e143118-fe97-472b-838e-1621bbebd144-kube-api-access-74l8c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.162330 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.162218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.169319 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.169273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:39:01.263721 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.263678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.263923 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.263731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e143118-fe97-472b-838e-1621bbebd144-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.263923 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.263762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.263923 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.263794    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.263923 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.263823    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.263923 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.263894    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74l8c\" (UniqueName: \"kubernetes.io/projected/6e143118-fe97-472b-838e-1621bbebd144-kube-api-access-74l8c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.264195 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.264157    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.264257 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.264230    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.264392 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.264254    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.266127 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.266104    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e143118-fe97-472b-838e-1621bbebd144-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.266254 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.266238    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e143118-fe97-472b-838e-1621bbebd144-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.275007 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.274984    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74l8c\" (UniqueName: \"kubernetes.io/projected/6e143118-fe97-472b-838e-1621bbebd144-kube-api-access-74l8c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krf6g\" (UID: \"6e143118-fe97-472b-838e-1621bbebd144\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.391500 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.391399    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:01.563340 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:01.563311    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"]
Jul 09 13:39:01.564362 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:39:01.564330    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e143118_fe97_472b_838e_1621bbebd144.slice/crio-1215506d343d121f2e012a7fd2b6ba26b8bf2e41908fa4b96bb7f12a18724926 WatchSource:0}: Error finding container 1215506d343d121f2e012a7fd2b6ba26b8bf2e41908fa4b96bb7f12a18724926: Status 404 returned error can't find the container with id 1215506d343d121f2e012a7fd2b6ba26b8bf2e41908fa4b96bb7f12a18724926
Jul 09 13:39:02.419248 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:02.419202    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g" event={"ID":"6e143118-fe97-472b-838e-1621bbebd144","Type":"ContainerStarted","Data":"26a2f41b0b1f132e15855f654ae94a6e9b917dac4ea8c7ac3674ee48fd9f0d42"}
Jul 09 13:39:02.419719 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:02.419258    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g" event={"ID":"6e143118-fe97-472b-838e-1621bbebd144","Type":"ContainerStarted","Data":"1215506d343d121f2e012a7fd2b6ba26b8bf2e41908fa4b96bb7f12a18724926"}
Jul 09 13:39:02.442066 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:02.441999    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g" podStartSLOduration=1.159560291 podStartE2EDuration="1.441979913s" totalImagesPullingTime="282.419622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:39:02.440636529 +0000 UTC m=+588.652626992" watchObservedRunningTime="2026-07-09 13:39:02.441979913 +0000 UTC m=+588.653970329"
Jul 09 13:39:04.302670 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:04.302615    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:39:11.392063 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:11.392001    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:11.392552 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:11.392085    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:11.404831 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:11.404804    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:11.480845 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:11.480815    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krf6g"
Jul 09 13:39:14.252744 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.252634    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:39:14.265399 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.253601    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:39:14.680619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.680579    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"]
Jul 09 13:39:14.684260 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.684235    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.687459 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.687436    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 09 13:39:14.708405 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.708365    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"]
Jul 09 13:39:14.719987 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.719942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:39:14.781858 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.781826    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.782051 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.781866    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.782051 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.781894    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a72915d-4606-4cd0-ae46-aaea655fd6b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.782051 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.781993    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.782185 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.782108    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kphln\" (UniqueName: \"kubernetes.io/projected/4a72915d-4606-4cd0-ae46-aaea655fd6b9-kube-api-access-kphln\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.782185 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.782161    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.882653 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.882613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a72915d-4606-4cd0-ae46-aaea655fd6b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.882844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.882660    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.882844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.882733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphln\" (UniqueName: \"kubernetes.io/projected/4a72915d-4606-4cd0-ae46-aaea655fd6b9-kube-api-access-kphln\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.882844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.882773    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.882844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.882812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.883062 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.882927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.883238 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.883202    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.883238 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.883227    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.883427 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.883370    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.885002 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.884983    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a72915d-4606-4cd0-ae46-aaea655fd6b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.885314 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.885279    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a72915d-4606-4cd0-ae46-aaea655fd6b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.901475 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.901446    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kphln\" (UniqueName: \"kubernetes.io/projected/4a72915d-4606-4cd0-ae46-aaea655fd6b9-kube-api-access-kphln\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xmz6n\" (UID: \"4a72915d-4606-4cd0-ae46-aaea655fd6b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:14.994923 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:14.994823    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:15.147653 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:15.147621    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"]
Jul 09 13:39:15.149368 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:39:15.149344    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a72915d_4606_4cd0_ae46_aaea655fd6b9.slice/crio-074751d36134e32422622384f2bcbeeb133371c14206a99999ed1713d83d50bb WatchSource:0}: Error finding container 074751d36134e32422622384f2bcbeeb133371c14206a99999ed1713d83d50bb: Status 404 returned error can't find the container with id 074751d36134e32422622384f2bcbeeb133371c14206a99999ed1713d83d50bb
Jul 09 13:39:15.494934 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:15.494897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n" event={"ID":"4a72915d-4606-4cd0-ae46-aaea655fd6b9","Type":"ContainerStarted","Data":"074751d36134e32422622384f2bcbeeb133371c14206a99999ed1713d83d50bb"}
Jul 09 13:39:16.504053 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:16.504016    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n" event={"ID":"4a72915d-4606-4cd0-ae46-aaea655fd6b9","Type":"ContainerStarted","Data":"a1bdac074669c5f020c55a660f03567e6f13a5bdbaa64d130b16d48da3b87005"}
Jul 09 13:39:16.528863 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:16.528803    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n" podStartSLOduration=1.2445582 podStartE2EDuration="2.528786379s" totalImagesPullingTime="1.284228179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:39:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:39:16.525589607 +0000 UTC m=+602.737580041" watchObservedRunningTime="2026-07-09 13:39:16.528786379 +0000 UTC m=+602.740776794"
Jul 09 13:39:22.231362 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:22.231324    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:39:24.995667 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:24.995629    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:24.996196 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:24.995700    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:25.008657 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:25.008625    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:39:25.569652 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:39:25.569616    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xmz6n"
Jul 09 13:40:04.886675 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:04.886635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:40:04.975754 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:04.975710    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:40:06.051244 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.051192    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:40:06.153811 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.153773    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:40:06.286461 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.286424    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76b4744787-rhsn6"]
Jul 09 13:40:06.286882 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.286850    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-76b4744787-rhsn6" podUID="97518ccf-3b53-403a-9c21-c67ee081fe67" containerName="authorino" containerID="cri-o://56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf" gracePeriod=30
Jul 09 13:40:06.547748 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.547716    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b4744787-rhsn6"
Jul 09 13:40:06.565150 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.565062    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzgw2\" (UniqueName: \"kubernetes.io/projected/97518ccf-3b53-403a-9c21-c67ee081fe67-kube-api-access-mzgw2\") pod \"97518ccf-3b53-403a-9c21-c67ee081fe67\" (UID: \"97518ccf-3b53-403a-9c21-c67ee081fe67\") "
Jul 09 13:40:06.565150 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.565125    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97518ccf-3b53-403a-9c21-c67ee081fe67-tls-cert\") pod \"97518ccf-3b53-403a-9c21-c67ee081fe67\" (UID: \"97518ccf-3b53-403a-9c21-c67ee081fe67\") "
Jul 09 13:40:06.567262 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.567231    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97518ccf-3b53-403a-9c21-c67ee081fe67-kube-api-access-mzgw2" (OuterVolumeSpecName: "kube-api-access-mzgw2") pod "97518ccf-3b53-403a-9c21-c67ee081fe67" (UID: "97518ccf-3b53-403a-9c21-c67ee081fe67"). InnerVolumeSpecName "kube-api-access-mzgw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:40:06.576692 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.576656    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97518ccf-3b53-403a-9c21-c67ee081fe67-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "97518ccf-3b53-403a-9c21-c67ee081fe67" (UID: "97518ccf-3b53-403a-9c21-c67ee081fe67"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:40:06.666258 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.666216    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97518ccf-3b53-403a-9c21-c67ee081fe67-tls-cert\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:40:06.666258 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.666250    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzgw2\" (UniqueName: \"kubernetes.io/projected/97518ccf-3b53-403a-9c21-c67ee081fe67-kube-api-access-mzgw2\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:40:06.803155 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.803118    2583 generic.go:356] "Generic (PLEG): container finished" podID="97518ccf-3b53-403a-9c21-c67ee081fe67" containerID="56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf" exitCode=0
Jul 09 13:40:06.803374 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.803162    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b4744787-rhsn6"
Jul 09 13:40:06.803374 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.803195    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b4744787-rhsn6" event={"ID":"97518ccf-3b53-403a-9c21-c67ee081fe67","Type":"ContainerDied","Data":"56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf"}
Jul 09 13:40:06.803374 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.803236    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b4744787-rhsn6" event={"ID":"97518ccf-3b53-403a-9c21-c67ee081fe67","Type":"ContainerDied","Data":"2c8035652d7356e6a294c66c73e93221e7543c6f1c15ebb44c0a6b9ac6d05c11"}
Jul 09 13:40:06.803374 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.803267    2583 scope.go:117] "RemoveContainer" containerID="56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf"
Jul 09 13:40:06.813477 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.813459    2583 scope.go:117] "RemoveContainer" containerID="56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf"
Jul 09 13:40:06.813755 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:40:06.813734    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf\": container with ID starting with 56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf not found: ID does not exist" containerID="56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf"
Jul 09 13:40:06.813801 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.813766    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf"} err="failed to get container status \"56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf\": rpc error: code = NotFound desc = could not find container \"56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf\": container with ID starting with 56f7278676de98948bd9b9df499913ad32ca7ac254d379d8c0d93a7b9fe726cf not found: ID does not exist"
Jul 09 13:40:06.828497 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.828465    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76b4744787-rhsn6"]
Jul 09 13:40:06.837053 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:06.837019    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76b4744787-rhsn6"]
Jul 09 13:40:08.316967 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:08.316920    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97518ccf-3b53-403a-9c21-c67ee081fe67" path="/var/lib/kubelet/pods/97518ccf-3b53-403a-9c21-c67ee081fe67/volumes"
Jul 09 13:40:14.230385 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:14.230344    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:40:14.335426 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:40:14.335386    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:41:17.613973 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:17.613878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:41:17.719364 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:17.719328    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dcf598fd9-w6khk"]
Jul 09 13:41:17.719606 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:17.719579    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7dcf598fd9-w6khk" podUID="713254e4-6baa-4639-b252-0aaf09ee5f9d" containerName="manager" containerID="cri-o://04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6" gracePeriod=30
Jul 09 13:41:17.967849 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:17.967817    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:41:18.115421 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.115380    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/713254e4-6baa-4639-b252-0aaf09ee5f9d-service-ca\") pod \"713254e4-6baa-4639-b252-0aaf09ee5f9d\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") "
Jul 09 13:41:18.115629 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.115460    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/713254e4-6baa-4639-b252-0aaf09ee5f9d-webhook-cert\") pod \"713254e4-6baa-4639-b252-0aaf09ee5f9d\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") "
Jul 09 13:41:18.115629 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.115481    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8svs8\" (UniqueName: \"kubernetes.io/projected/713254e4-6baa-4639-b252-0aaf09ee5f9d-kube-api-access-8svs8\") pod \"713254e4-6baa-4639-b252-0aaf09ee5f9d\" (UID: \"713254e4-6baa-4639-b252-0aaf09ee5f9d\") "
Jul 09 13:41:18.115863 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.115837    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/713254e4-6baa-4639-b252-0aaf09ee5f9d-service-ca" (OuterVolumeSpecName: "service-ca") pod "713254e4-6baa-4639-b252-0aaf09ee5f9d" (UID: "713254e4-6baa-4639-b252-0aaf09ee5f9d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:41:18.117670 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.117643    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/713254e4-6baa-4639-b252-0aaf09ee5f9d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "713254e4-6baa-4639-b252-0aaf09ee5f9d" (UID: "713254e4-6baa-4639-b252-0aaf09ee5f9d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:41:18.117785 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.117690    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/713254e4-6baa-4639-b252-0aaf09ee5f9d-kube-api-access-8svs8" (OuterVolumeSpecName: "kube-api-access-8svs8") pod "713254e4-6baa-4639-b252-0aaf09ee5f9d" (UID: "713254e4-6baa-4639-b252-0aaf09ee5f9d"). InnerVolumeSpecName "kube-api-access-8svs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:41:18.214710 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.214622    2583 generic.go:356] "Generic (PLEG): container finished" podID="713254e4-6baa-4639-b252-0aaf09ee5f9d" containerID="04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6" exitCode=0
Jul 09 13:41:18.214710 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.214671    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcf598fd9-w6khk"
Jul 09 13:41:18.214895 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.214713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcf598fd9-w6khk" event={"ID":"713254e4-6baa-4639-b252-0aaf09ee5f9d","Type":"ContainerDied","Data":"04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6"}
Jul 09 13:41:18.214895 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.214770    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcf598fd9-w6khk" event={"ID":"713254e4-6baa-4639-b252-0aaf09ee5f9d","Type":"ContainerDied","Data":"b19bc29de774fdf2964b8b54518d9d97bf11c8e42a5876857b8485da40f3fe95"}
Jul 09 13:41:18.214895 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.214799    2583 scope.go:117] "RemoveContainer" containerID="04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6"
Jul 09 13:41:18.216173 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.216153    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/713254e4-6baa-4639-b252-0aaf09ee5f9d-webhook-cert\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:41:18.216248 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.216178    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8svs8\" (UniqueName: \"kubernetes.io/projected/713254e4-6baa-4639-b252-0aaf09ee5f9d-kube-api-access-8svs8\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:41:18.216248 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.216195    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/713254e4-6baa-4639-b252-0aaf09ee5f9d-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:41:18.225308 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.225274    2583 scope.go:117] "RemoveContainer" containerID="04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6"
Jul 09 13:41:18.225595 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:41:18.225571    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6\": container with ID starting with 04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6 not found: ID does not exist" containerID="04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6"
Jul 09 13:41:18.225650 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.225605    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6"} err="failed to get container status \"04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6\": rpc error: code = NotFound desc = could not find container \"04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6\": container with ID starting with 04bb31b01143127eab159640ba5aff99564076c25870de53e19fde477fd60ca6 not found: ID does not exist"
Jul 09 13:41:18.240587 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.240563    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dcf598fd9-w6khk"]
Jul 09 13:41:18.246855 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.246834    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7dcf598fd9-w6khk"]
Jul 09 13:41:18.316923 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.316892    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="713254e4-6baa-4639-b252-0aaf09ee5f9d" path="/var/lib/kubelet/pods/713254e4-6baa-4639-b252-0aaf09ee5f9d/volumes"
Jul 09 13:41:18.934103 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:18.934059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:41:19.070035 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.070002    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dcf598fd9-bnlbc"]
Jul 09 13:41:19.070663 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.070635    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="713254e4-6baa-4639-b252-0aaf09ee5f9d" containerName="manager"
Jul 09 13:41:19.070663 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.070661    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="713254e4-6baa-4639-b252-0aaf09ee5f9d" containerName="manager"
Jul 09 13:41:19.070863 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.070686    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97518ccf-3b53-403a-9c21-c67ee081fe67" containerName="authorino"
Jul 09 13:41:19.070863 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.070697    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="97518ccf-3b53-403a-9c21-c67ee081fe67" containerName="authorino"
Jul 09 13:41:19.070863 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.070792    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="713254e4-6baa-4639-b252-0aaf09ee5f9d" containerName="manager"
Jul 09 13:41:19.070863 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.070806    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="97518ccf-3b53-403a-9c21-c67ee081fe67" containerName="authorino"
Jul 09 13:41:19.075140 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.075118    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:19.083880 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.083845    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 13:41:19.084175 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.084146    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xnk68\""
Jul 09 13:41:19.084375 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.084360    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 13:41:19.087217 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.087186    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dcf598fd9-bnlbc"]
Jul 09 13:41:19.226690 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.226597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0658267e-0c0e-43d9-ae2a-b4369d84ae26-service-ca\") pod \"maas-controller-7dcf598fd9-bnlbc\" (UID: \"0658267e-0c0e-43d9-ae2a-b4369d84ae26\") " pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:19.226690 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.226637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0658267e-0c0e-43d9-ae2a-b4369d84ae26-webhook-cert\") pod \"maas-controller-7dcf598fd9-bnlbc\" (UID: \"0658267e-0c0e-43d9-ae2a-b4369d84ae26\") " pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:19.226690 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.226667    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx6ws\" (UniqueName: \"kubernetes.io/projected/0658267e-0c0e-43d9-ae2a-b4369d84ae26-kube-api-access-rx6ws\") pod \"maas-controller-7dcf598fd9-bnlbc\" (UID: \"0658267e-0c0e-43d9-ae2a-b4369d84ae26\") " pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:19.327265 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.327229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx6ws\" (UniqueName: \"kubernetes.io/projected/0658267e-0c0e-43d9-ae2a-b4369d84ae26-kube-api-access-rx6ws\") pod \"maas-controller-7dcf598fd9-bnlbc\" (UID: \"0658267e-0c0e-43d9-ae2a-b4369d84ae26\") " pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:19.327487 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.327340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0658267e-0c0e-43d9-ae2a-b4369d84ae26-service-ca\") pod \"maas-controller-7dcf598fd9-bnlbc\" (UID: \"0658267e-0c0e-43d9-ae2a-b4369d84ae26\") " pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:19.327487 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.327367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0658267e-0c0e-43d9-ae2a-b4369d84ae26-webhook-cert\") pod \"maas-controller-7dcf598fd9-bnlbc\" (UID: \"0658267e-0c0e-43d9-ae2a-b4369d84ae26\") " pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:19.328025 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.327990    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0658267e-0c0e-43d9-ae2a-b4369d84ae26-service-ca\") pod \"maas-controller-7dcf598fd9-bnlbc\" (UID: \"0658267e-0c0e-43d9-ae2a-b4369d84ae26\") " pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:19.329773 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.329749    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0658267e-0c0e-43d9-ae2a-b4369d84ae26-webhook-cert\") pod \"maas-controller-7dcf598fd9-bnlbc\" (UID: \"0658267e-0c0e-43d9-ae2a-b4369d84ae26\") " pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:19.343629 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.343603    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx6ws\" (UniqueName: \"kubernetes.io/projected/0658267e-0c0e-43d9-ae2a-b4369d84ae26-kube-api-access-rx6ws\") pod \"maas-controller-7dcf598fd9-bnlbc\" (UID: \"0658267e-0c0e-43d9-ae2a-b4369d84ae26\") " pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:19.392520 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.392483    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:19.537614 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.537581    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dcf598fd9-bnlbc"]
Jul 09 13:41:19.538646 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:41:19.538611    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0658267e_0c0e_43d9_ae2a_b4369d84ae26.slice/crio-81ff120bde9fa8548d9d830cb74072509d7e5b228e2a583a382b876262baef3d WatchSource:0}: Error finding container 81ff120bde9fa8548d9d830cb74072509d7e5b228e2a583a382b876262baef3d: Status 404 returned error can't find the container with id 81ff120bde9fa8548d9d830cb74072509d7e5b228e2a583a382b876262baef3d
Jul 09 13:41:19.539956 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:19.539938    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 13:41:20.229109 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:20.229020    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcf598fd9-bnlbc" event={"ID":"0658267e-0c0e-43d9-ae2a-b4369d84ae26","Type":"ContainerStarted","Data":"8712842f7cbc7c5dbb6a142d2582d04f71915fd0297e500b652e5546f24b09a4"}
Jul 09 13:41:20.229109 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:20.229075    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dcf598fd9-bnlbc" event={"ID":"0658267e-0c0e-43d9-ae2a-b4369d84ae26","Type":"ContainerStarted","Data":"81ff120bde9fa8548d9d830cb74072509d7e5b228e2a583a382b876262baef3d"}
Jul 09 13:41:20.229109 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:20.229104    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:20.255599 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:20.255520    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dcf598fd9-bnlbc" podStartSLOduration=0.86706008 podStartE2EDuration="1.255501768s" totalImagesPullingTime="388.441688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:41:20.253587872 +0000 UTC m=+726.465578288" watchObservedRunningTime="2026-07-09 13:41:20.255501768 +0000 UTC m=+726.467492183"
Jul 09 13:41:24.272388 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:24.272352    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:41:28.893472 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:28.893408    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:41:31.242706 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:31.242672    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dcf598fd9-bnlbc"
Jul 09 13:41:49.042066 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:49.042030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:41:49.106735 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:41:49.106695    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:42:00.465346 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:42:00.465281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:42:00.561184 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:42:00.561132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:42:00.712843 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:42:00.712799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:42:07.851542 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:42:07.851500    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:42:07.969010 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:42:07.968976    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:42:08.059050 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:42:08.059014    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:42:08.241640 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:42:08.241542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:42:11.418498 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:42:11.418452    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:42:15.138123 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:42:15.138082    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:42:15.238600 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:42:15.238560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:44:14.289586 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:44:14.289476    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:44:14.293750 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:44:14.291789    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:46:09.850486 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:09.850450    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"]
Jul 09 13:46:09.851023 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:09.850702    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4" podUID="fe298184-187c-4988-9fcb-76b0d62483a7" containerName="manager" containerID="cri-o://331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0" gracePeriod=10
Jul 09 13:46:12.906258 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:12.906230    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:46:12.907223 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:12.907199    2583 generic.go:356] "Generic (PLEG): container finished" podID="fe298184-187c-4988-9fcb-76b0d62483a7" containerID="331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0" exitCode=0
Jul 09 13:46:12.907339 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:12.907270    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4" event={"ID":"fe298184-187c-4988-9fcb-76b0d62483a7","Type":"ContainerDied","Data":"331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0"}
Jul 09 13:46:12.907387 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:12.907376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4" event={"ID":"fe298184-187c-4988-9fcb-76b0d62483a7","Type":"ContainerDied","Data":"e0ec8549269af43e6c077a589ee0f81ef0dd842899c7b0ffa13f73b1b3aadfbf"}
Jul 09 13:46:12.907427 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:12.907415    2583 scope.go:117] "RemoveContainer" containerID="331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0"
Jul 09 13:46:12.916965 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:12.916945    2583 scope.go:117] "RemoveContainer" containerID="331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0"
Jul 09 13:46:12.917240 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:46:12.917217    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0\": container with ID starting with 331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0 not found: ID does not exist" containerID="331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0"
Jul 09 13:46:12.917360 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:12.917254    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0"} err="failed to get container status \"331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0\": rpc error: code = NotFound desc = could not find container \"331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0\": container with ID starting with 331b4ffc56e951b47ae69273bd049b4c3793977b4837689911e5264ee7a9edd0 not found: ID does not exist"
Jul 09 13:46:13.047354 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:13.047206    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe298184-187c-4988-9fcb-76b0d62483a7-extensions-socket-volume\") pod \"fe298184-187c-4988-9fcb-76b0d62483a7\" (UID: \"fe298184-187c-4988-9fcb-76b0d62483a7\") "
Jul 09 13:46:13.047528 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:13.047416    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgvtm\" (UniqueName: \"kubernetes.io/projected/fe298184-187c-4988-9fcb-76b0d62483a7-kube-api-access-mgvtm\") pod \"fe298184-187c-4988-9fcb-76b0d62483a7\" (UID: \"fe298184-187c-4988-9fcb-76b0d62483a7\") "
Jul 09 13:46:13.047638 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:13.047614    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe298184-187c-4988-9fcb-76b0d62483a7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fe298184-187c-4988-9fcb-76b0d62483a7" (UID: "fe298184-187c-4988-9fcb-76b0d62483a7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:46:13.049476 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:13.049455    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe298184-187c-4988-9fcb-76b0d62483a7-kube-api-access-mgvtm" (OuterVolumeSpecName: "kube-api-access-mgvtm") pod "fe298184-187c-4988-9fcb-76b0d62483a7" (UID: "fe298184-187c-4988-9fcb-76b0d62483a7"). InnerVolumeSpecName "kube-api-access-mgvtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:46:13.148178 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:13.148142    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgvtm\" (UniqueName: \"kubernetes.io/projected/fe298184-187c-4988-9fcb-76b0d62483a7-kube-api-access-mgvtm\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:46:13.148178 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:13.148174    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe298184-187c-4988-9fcb-76b0d62483a7-extensions-socket-volume\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:46:13.914707 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:13.914677    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"
Jul 09 13:46:13.941605 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:13.941569    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"]
Jul 09 13:46:13.944461 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:13.944435    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlqj4"]
Jul 09 13:46:14.316482 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:46:14.316453    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe298184-187c-4988-9fcb-76b0d62483a7" path="/var/lib/kubelet/pods/fe298184-187c-4988-9fcb-76b0d62483a7/volumes"
Jul 09 13:47:11.084994 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.084905    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"]
Jul 09 13:47:11.085480 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.085385    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe298184-187c-4988-9fcb-76b0d62483a7" containerName="manager"
Jul 09 13:47:11.085480 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.085402    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe298184-187c-4988-9fcb-76b0d62483a7" containerName="manager"
Jul 09 13:47:11.085560 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.085493    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe298184-187c-4988-9fcb-76b0d62483a7" containerName="manager"
Jul 09 13:47:11.088720 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.088701    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"
Jul 09 13:47:11.092544 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.092521    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hr285\""
Jul 09 13:47:11.106952 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.106921    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"]
Jul 09 13:47:11.172407 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.172370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wsrs\" (UniqueName: \"kubernetes.io/projected/721f1f3f-8136-4b3d-896d-e9247bb9fb4d-kube-api-access-5wsrs\") pod \"kuadrant-operator-controller-manager-86878c769f-zfbzx\" (UID: \"721f1f3f-8136-4b3d-896d-e9247bb9fb4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"
Jul 09 13:47:11.172599 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.172425    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/721f1f3f-8136-4b3d-896d-e9247bb9fb4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zfbzx\" (UID: \"721f1f3f-8136-4b3d-896d-e9247bb9fb4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"
Jul 09 13:47:11.273171 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.273127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wsrs\" (UniqueName: \"kubernetes.io/projected/721f1f3f-8136-4b3d-896d-e9247bb9fb4d-kube-api-access-5wsrs\") pod \"kuadrant-operator-controller-manager-86878c769f-zfbzx\" (UID: \"721f1f3f-8136-4b3d-896d-e9247bb9fb4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"
Jul 09 13:47:11.273398 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.273181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/721f1f3f-8136-4b3d-896d-e9247bb9fb4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zfbzx\" (UID: \"721f1f3f-8136-4b3d-896d-e9247bb9fb4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"
Jul 09 13:47:11.273569 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.273551    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/721f1f3f-8136-4b3d-896d-e9247bb9fb4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zfbzx\" (UID: \"721f1f3f-8136-4b3d-896d-e9247bb9fb4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"
Jul 09 13:47:11.286446 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.286418    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wsrs\" (UniqueName: \"kubernetes.io/projected/721f1f3f-8136-4b3d-896d-e9247bb9fb4d-kube-api-access-5wsrs\") pod \"kuadrant-operator-controller-manager-86878c769f-zfbzx\" (UID: \"721f1f3f-8136-4b3d-896d-e9247bb9fb4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"
Jul 09 13:47:11.399524 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.399424    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"
Jul 09 13:47:11.546768 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:11.546741    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"]
Jul 09 13:47:11.549001 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:47:11.548964    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721f1f3f_8136_4b3d_896d_e9247bb9fb4d.slice/crio-e64e8bdb76eceda3613e2588e863691b25fc654107e0fda39dd9e3bae3b6f4f6 WatchSource:0}: Error finding container e64e8bdb76eceda3613e2588e863691b25fc654107e0fda39dd9e3bae3b6f4f6: Status 404 returned error can't find the container with id e64e8bdb76eceda3613e2588e863691b25fc654107e0fda39dd9e3bae3b6f4f6
Jul 09 13:47:12.239413 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:12.239374    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx" event={"ID":"721f1f3f-8136-4b3d-896d-e9247bb9fb4d","Type":"ContainerStarted","Data":"e8eaacda37868e17c17fe88afa49a5496867b43dc790002c7c600e33d062de4a"}
Jul 09 13:47:12.239809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:12.239435    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"
Jul 09 13:47:12.239809 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:12.239453    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx" event={"ID":"721f1f3f-8136-4b3d-896d-e9247bb9fb4d","Type":"ContainerStarted","Data":"e64e8bdb76eceda3613e2588e863691b25fc654107e0fda39dd9e3bae3b6f4f6"}
Jul 09 13:47:12.279247 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:12.279194    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx" podStartSLOduration=1.279175884 podStartE2EDuration="1.279175884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:47:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:47:12.274568317 +0000 UTC m=+1078.486558759" watchObservedRunningTime="2026-07-09 13:47:12.279175884 +0000 UTC m=+1078.491166725"
Jul 09 13:47:23.248166 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:23.248063    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zfbzx"
Jul 09 13:47:44.095076 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:44.095039    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:47:45.348760 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:47:45.348725    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:49:14.327893 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:49:14.327867    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:49:14.338666 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:49:14.338644    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:49:21.888843 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:49:21.888806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:50:09.124695 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:50:09.124602    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:11.099182 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:11.099103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:12.684772 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:12.684736    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:18.662892 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:18.662854    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:18.759688 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:18.759649    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:18.920995 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:18.920918    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:19.018991 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:19.018961    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:20.070579 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.070545    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:20.164570 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.164542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:20.308419 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.308386    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"]
Jul 09 13:53:20.313032 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.313001    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:20.317509 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.317484    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b83f08aa-serving-cert\""
Jul 09 13:53:20.328473 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.328441    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"]
Jul 09 13:53:20.349155 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.349126    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:20.423282 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.423247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184279c4-c41f-4832-8de6-a25e7f910216-maas-api-tls\") pod \"maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:20.423487 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.423366    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184279c4-c41f-4832-8de6-a25e7f910216-openshift-service-ca\") pod \"maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:20.423487 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.423450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcppq\" (UniqueName: \"kubernetes.io/projected/184279c4-c41f-4832-8de6-a25e7f910216-kube-api-access-tcppq\") pod \"maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:20.524166 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.524127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184279c4-c41f-4832-8de6-a25e7f910216-openshift-service-ca\") pod \"maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:20.524384 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.524181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcppq\" (UniqueName: \"kubernetes.io/projected/184279c4-c41f-4832-8de6-a25e7f910216-kube-api-access-tcppq\") pod \"maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:20.524384 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.524215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184279c4-c41f-4832-8de6-a25e7f910216-maas-api-tls\") pod \"maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:20.524384 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:53:20.524355    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-serving-cert: secret "maas-api-e2e-ait-b83f08aa-serving-cert" not found
Jul 09 13:53:20.524611 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:53:20.524432    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184279c4-c41f-4832-8de6-a25e7f910216-maas-api-tls podName:184279c4-c41f-4832-8de6-a25e7f910216 nodeName:}" failed. No retries permitted until 2026-07-09 13:53:21.024416258 +0000 UTC m=+1447.236406651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/184279c4-c41f-4832-8de6-a25e7f910216-maas-api-tls") pod "maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4" (UID: "184279c4-c41f-4832-8de6-a25e7f910216") : secret "maas-api-e2e-ait-b83f08aa-serving-cert" not found
Jul 09 13:53:20.524869 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.524848    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184279c4-c41f-4832-8de6-a25e7f910216-openshift-service-ca\") pod \"maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:20.535105 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.535076    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcppq\" (UniqueName: \"kubernetes.io/projected/184279c4-c41f-4832-8de6-a25e7f910216-kube-api-access-tcppq\") pod \"maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:20.680402 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:20.680323    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:21.028248 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:21.028167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184279c4-c41f-4832-8de6-a25e7f910216-maas-api-tls\") pod \"maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:21.030607 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:21.030583    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184279c4-c41f-4832-8de6-a25e7f910216-maas-api-tls\") pod \"maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:21.037539 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:21.037504    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:21.138010 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:21.137975    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:21.226778 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:21.226745    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:21.380306 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:21.380261    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"]
Jul 09 13:53:21.381341 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:53:21.381308    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184279c4_c41f_4832_8de6_a25e7f910216.slice/crio-a74b2a2208007a4078fdb0220105985a841cce3d3154f4ebeb3d548c50239765 WatchSource:0}: Error finding container a74b2a2208007a4078fdb0220105985a841cce3d3154f4ebeb3d548c50239765: Status 404 returned error can't find the container with id a74b2a2208007a4078fdb0220105985a841cce3d3154f4ebeb3d548c50239765
Jul 09 13:53:21.382672 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:21.382651    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 13:53:22.336559 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:22.336523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4" event={"ID":"184279c4-c41f-4832-8de6-a25e7f910216","Type":"ContainerStarted","Data":"df84e30467daf658df8b4e50c31718f595440ea04d5f7bc9d3188128e5b98167"}
Jul 09 13:53:22.336970 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:22.336591    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:22.336970 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:22.336615    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4" event={"ID":"184279c4-c41f-4832-8de6-a25e7f910216","Type":"ContainerStarted","Data":"a74b2a2208007a4078fdb0220105985a841cce3d3154f4ebeb3d548c50239765"}
Jul 09 13:53:22.374886 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:22.374833    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4" podStartSLOduration=1.804588842 podStartE2EDuration="2.374817565s" totalImagesPullingTime="570.228723ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:53:22.374275044 +0000 UTC m=+1448.586265456" watchObservedRunningTime="2026-07-09 13:53:22.374817565 +0000 UTC m=+1448.586807980"
Jul 09 13:53:22.612544 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:22.612455    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:28.135858 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.135825    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"]
Jul 09 13:53:28.136266 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.136012    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4" podUID="184279c4-c41f-4832-8de6-a25e7f910216" containerName="maas-api" containerID="cri-o://df84e30467daf658df8b4e50c31718f595440ea04d5f7bc9d3188128e5b98167" gracePeriod=30
Jul 09 13:53:28.141914 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.141891    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:28.161604 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.161559    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:28.224139 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.224109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:28.351909 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.351878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:28.374418 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.374387    2583 generic.go:356] "Generic (PLEG): container finished" podID="184279c4-c41f-4832-8de6-a25e7f910216" containerID="df84e30467daf658df8b4e50c31718f595440ea04d5f7bc9d3188128e5b98167" exitCode=0
Jul 09 13:53:28.374539 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.374453    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4" event={"ID":"184279c4-c41f-4832-8de6-a25e7f910216","Type":"ContainerDied","Data":"df84e30467daf658df8b4e50c31718f595440ea04d5f7bc9d3188128e5b98167"}
Jul 09 13:53:28.374539 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.374500    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4" event={"ID":"184279c4-c41f-4832-8de6-a25e7f910216","Type":"ContainerDied","Data":"a74b2a2208007a4078fdb0220105985a841cce3d3154f4ebeb3d548c50239765"}
Jul 09 13:53:28.374539 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.374518    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a74b2a2208007a4078fdb0220105985a841cce3d3154f4ebeb3d548c50239765"
Jul 09 13:53:28.385643 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.385624    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:28.467742 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.467644    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:28.495801 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.495771    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184279c4-c41f-4832-8de6-a25e7f910216-openshift-service-ca\") pod \"184279c4-c41f-4832-8de6-a25e7f910216\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") "
Jul 09 13:53:28.495948 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.495807    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcppq\" (UniqueName: \"kubernetes.io/projected/184279c4-c41f-4832-8de6-a25e7f910216-kube-api-access-tcppq\") pod \"184279c4-c41f-4832-8de6-a25e7f910216\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") "
Jul 09 13:53:28.495948 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.495837    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184279c4-c41f-4832-8de6-a25e7f910216-maas-api-tls\") pod \"184279c4-c41f-4832-8de6-a25e7f910216\" (UID: \"184279c4-c41f-4832-8de6-a25e7f910216\") "
Jul 09 13:53:28.496220 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.496198    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/184279c4-c41f-4832-8de6-a25e7f910216-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "184279c4-c41f-4832-8de6-a25e7f910216" (UID: "184279c4-c41f-4832-8de6-a25e7f910216"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:53:28.497929 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.497911    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/184279c4-c41f-4832-8de6-a25e7f910216-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "184279c4-c41f-4832-8de6-a25e7f910216" (UID: "184279c4-c41f-4832-8de6-a25e7f910216"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:53:28.498036 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.498019    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/184279c4-c41f-4832-8de6-a25e7f910216-kube-api-access-tcppq" (OuterVolumeSpecName: "kube-api-access-tcppq") pod "184279c4-c41f-4832-8de6-a25e7f910216" (UID: "184279c4-c41f-4832-8de6-a25e7f910216"). InnerVolumeSpecName "kube-api-access-tcppq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:53:28.597061 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.597029    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/184279c4-c41f-4832-8de6-a25e7f910216-openshift-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:53:28.597061 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.597056    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcppq\" (UniqueName: \"kubernetes.io/projected/184279c4-c41f-4832-8de6-a25e7f910216-kube-api-access-tcppq\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:53:28.597061 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:28.597066    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/184279c4-c41f-4832-8de6-a25e7f910216-maas-api-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:53:29.379565 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:29.379526    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"
Jul 09 13:53:29.411697 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:29.411059    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"]
Jul 09 13:53:29.411697 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:29.411108    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b83f08aa-79585499f6-lt4j4"]
Jul 09 13:53:30.317542 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:30.317507    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="184279c4-c41f-4832-8de6-a25e7f910216" path="/var/lib/kubelet/pods/184279c4-c41f-4832-8de6-a25e7f910216/volumes"
Jul 09 13:53:31.167753 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:31.167716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:33.254567 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:33.254536    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:35.377514 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:35.377481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:35.440354 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:35.440323    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:35.625752 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:35.625716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:35.725105 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:35.725023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:36.816621 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.816573    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:36.898825 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.898788    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"]
Jul 09 13:53:36.899348 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.899327    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184279c4-c41f-4832-8de6-a25e7f910216" containerName="maas-api"
Jul 09 13:53:36.899348 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.899348    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="184279c4-c41f-4832-8de6-a25e7f910216" containerName="maas-api"
Jul 09 13:53:36.899544 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.899442    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="184279c4-c41f-4832-8de6-a25e7f910216" containerName="maas-api"
Jul 09 13:53:36.900923 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.900899    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:36.902959 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.902942    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:36.905789 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.905771    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-13dc4fa5-serving-cert\""
Jul 09 13:53:36.916145 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.916119    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"]
Jul 09 13:53:36.978802 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.978770    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef9edb4f-ac74-44d2-936c-6df37d290ffe-maas-api-tls\") pod \"maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:36.978965 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.978806    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdqkg\" (UniqueName: \"kubernetes.io/projected/ef9edb4f-ac74-44d2-936c-6df37d290ffe-kube-api-access-bdqkg\") pod \"maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:36.978965 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.978835    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef9edb4f-ac74-44d2-936c-6df37d290ffe-openshift-service-ca\") pod \"maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:36.987585 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:36.987555    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:37.079729 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.079649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef9edb4f-ac74-44d2-936c-6df37d290ffe-maas-api-tls\") pod \"maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:37.079729 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.079689    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdqkg\" (UniqueName: \"kubernetes.io/projected/ef9edb4f-ac74-44d2-936c-6df37d290ffe-kube-api-access-bdqkg\") pod \"maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:37.079729 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.079717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef9edb4f-ac74-44d2-936c-6df37d290ffe-openshift-service-ca\") pod \"maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:37.080008 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:53:37.079874    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-serving-cert: secret "maas-api-e2e-ait-13dc4fa5-serving-cert" not found
Jul 09 13:53:37.080008 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:53:37.079962    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef9edb4f-ac74-44d2-936c-6df37d290ffe-maas-api-tls podName:ef9edb4f-ac74-44d2-936c-6df37d290ffe nodeName:}" failed. No retries permitted until 2026-07-09 13:53:37.579939297 +0000 UTC m=+1463.791929690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef9edb4f-ac74-44d2-936c-6df37d290ffe-maas-api-tls") pod "maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72" (UID: "ef9edb4f-ac74-44d2-936c-6df37d290ffe") : secret "maas-api-e2e-ait-13dc4fa5-serving-cert" not found
Jul 09 13:53:37.080348 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.080330    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef9edb4f-ac74-44d2-936c-6df37d290ffe-openshift-service-ca\") pod \"maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:37.094479 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.094454    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdqkg\" (UniqueName: \"kubernetes.io/projected/ef9edb4f-ac74-44d2-936c-6df37d290ffe-kube-api-access-bdqkg\") pod \"maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:37.482585 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.482492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:37.582224 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.582177    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:37.584422 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.584395    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef9edb4f-ac74-44d2-936c-6df37d290ffe-maas-api-tls\") pod \"maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:37.586936 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.586910    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef9edb4f-ac74-44d2-936c-6df37d290ffe-maas-api-tls\") pod \"maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:37.690064 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.690025    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:37.815503 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.815411    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:37.970025 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:37.969994    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"]
Jul 09 13:53:37.971939 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:53:37.971910    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9edb4f_ac74_44d2_936c_6df37d290ffe.slice/crio-8a8b31de2d5a4da51739a3f3881e9e88bd1eabd474e229d9c64628fa33750907 WatchSource:0}: Error finding container 8a8b31de2d5a4da51739a3f3881e9e88bd1eabd474e229d9c64628fa33750907: Status 404 returned error can't find the container with id 8a8b31de2d5a4da51739a3f3881e9e88bd1eabd474e229d9c64628fa33750907
Jul 09 13:53:38.430629 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:38.430584    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72" event={"ID":"ef9edb4f-ac74-44d2-936c-6df37d290ffe","Type":"ContainerStarted","Data":"2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb"}
Jul 09 13:53:38.430798 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:38.430653    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72" event={"ID":"ef9edb4f-ac74-44d2-936c-6df37d290ffe","Type":"ContainerStarted","Data":"8a8b31de2d5a4da51739a3f3881e9e88bd1eabd474e229d9c64628fa33750907"}
Jul 09 13:53:38.430798 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:38.430742    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:39.699864 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:39.699832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:44.443507 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:44.443482    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:44.469893 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:44.469840    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72" podStartSLOduration=8.101135568 podStartE2EDuration="8.469823801s" totalImagesPullingTime="368.688233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:53:38.460169758 +0000 UTC m=+1464.672160174" watchObservedRunningTime="2026-07-09 13:53:44.469823801 +0000 UTC m=+1470.681814216"
Jul 09 13:53:44.866721 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:44.866684    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"]
Jul 09 13:53:44.866986 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:44.866903    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72" podUID="ef9edb4f-ac74-44d2-936c-6df37d290ffe" containerName="maas-api" containerID="cri-o://2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb" gracePeriod=30
Jul 09 13:53:44.894275 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:44.894249    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:44.997125 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:44.997095    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:45.126186 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.126127    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:45.253206 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.253166    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef9edb4f-ac74-44d2-936c-6df37d290ffe-openshift-service-ca\") pod \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") "
Jul 09 13:53:45.253410 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.253230    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdqkg\" (UniqueName: \"kubernetes.io/projected/ef9edb4f-ac74-44d2-936c-6df37d290ffe-kube-api-access-bdqkg\") pod \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") "
Jul 09 13:53:45.253410 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.253395    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef9edb4f-ac74-44d2-936c-6df37d290ffe-maas-api-tls\") pod \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\" (UID: \"ef9edb4f-ac74-44d2-936c-6df37d290ffe\") "
Jul 09 13:53:45.253655 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.253632    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef9edb4f-ac74-44d2-936c-6df37d290ffe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef9edb4f-ac74-44d2-936c-6df37d290ffe" (UID: "ef9edb4f-ac74-44d2-936c-6df37d290ffe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:53:45.253743 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.253730    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef9edb4f-ac74-44d2-936c-6df37d290ffe-openshift-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:53:45.255435 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.255411    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef9edb4f-ac74-44d2-936c-6df37d290ffe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef9edb4f-ac74-44d2-936c-6df37d290ffe" (UID: "ef9edb4f-ac74-44d2-936c-6df37d290ffe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:53:45.255501 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.255417    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef9edb4f-ac74-44d2-936c-6df37d290ffe-kube-api-access-bdqkg" (OuterVolumeSpecName: "kube-api-access-bdqkg") pod "ef9edb4f-ac74-44d2-936c-6df37d290ffe" (UID: "ef9edb4f-ac74-44d2-936c-6df37d290ffe"). InnerVolumeSpecName "kube-api-access-bdqkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:53:45.354574 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.354536    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdqkg\" (UniqueName: \"kubernetes.io/projected/ef9edb4f-ac74-44d2-936c-6df37d290ffe-kube-api-access-bdqkg\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:53:45.354574 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.354565    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef9edb4f-ac74-44d2-936c-6df37d290ffe-maas-api-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:53:45.474124 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.474031    2583 generic.go:356] "Generic (PLEG): container finished" podID="ef9edb4f-ac74-44d2-936c-6df37d290ffe" containerID="2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb" exitCode=0
Jul 09 13:53:45.474124 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.474073    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"
Jul 09 13:53:45.474649 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.474122    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72" event={"ID":"ef9edb4f-ac74-44d2-936c-6df37d290ffe","Type":"ContainerDied","Data":"2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb"}
Jul 09 13:53:45.474649 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.474177    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72" event={"ID":"ef9edb4f-ac74-44d2-936c-6df37d290ffe","Type":"ContainerDied","Data":"8a8b31de2d5a4da51739a3f3881e9e88bd1eabd474e229d9c64628fa33750907"}
Jul 09 13:53:45.474649 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.474219    2583 scope.go:117] "RemoveContainer" containerID="2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb"
Jul 09 13:53:45.483783 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.483763    2583 scope.go:117] "RemoveContainer" containerID="2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb"
Jul 09 13:53:45.484037 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:53:45.484018    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb\": container with ID starting with 2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb not found: ID does not exist" containerID="2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb"
Jul 09 13:53:45.484083 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.484047    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb"} err="failed to get container status \"2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb\": rpc error: code = NotFound desc = could not find container \"2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb\": container with ID starting with 2925d2e177a6e0c8ac76e378e8aa3414ed1476d87a7b059c12e5acf5afb7eaeb not found: ID does not exist"
Jul 09 13:53:45.502976 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.502948    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"]
Jul 09 13:53:45.509378 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.509356    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-13dc4fa5-6fcf9c6f4d-s2t72"]
Jul 09 13:53:45.896220 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.896169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:45.983840 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:45.983806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:46.317334 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:46.317305    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef9edb4f-ac74-44d2-936c-6df37d290ffe" path="/var/lib/kubelet/pods/ef9edb4f-ac74-44d2-936c-6df37d290ffe/volumes"
Jul 09 13:53:47.430510 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:47.430477    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:52.180430 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:52.180392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:53.300705 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:53.300668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:53.399908 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:53.399874    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:53.650844 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:53.650808    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:53.739434 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:53.739398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:54.742175 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.742135    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:54.841360 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.841319    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:54.853454 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.853423    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"]
Jul 09 13:53:54.853864 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.853847    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef9edb4f-ac74-44d2-936c-6df37d290ffe" containerName="maas-api"
Jul 09 13:53:54.853921 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.853866    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef9edb4f-ac74-44d2-936c-6df37d290ffe" containerName="maas-api"
Jul 09 13:53:54.853963 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.853949    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef9edb4f-ac74-44d2-936c-6df37d290ffe" containerName="maas-api"
Jul 09 13:53:54.858563 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.858542    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:54.861476 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.861455    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b98481aa-serving-cert\""
Jul 09 13:53:54.868209 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.868188    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"]
Jul 09 13:53:54.939458 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.939430    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:54.947659 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.947630    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-maas-api-tls\") pod \"maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:54.947802 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.947688    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdhb2\" (UniqueName: \"kubernetes.io/projected/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-kube-api-access-bdhb2\") pod \"maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:54.947802 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:54.947758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-openshift-service-ca\") pod \"maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:55.048737 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.048652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-maas-api-tls\") pod \"maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:55.048737 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.048705    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdhb2\" (UniqueName: \"kubernetes.io/projected/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-kube-api-access-bdhb2\") pod \"maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:55.048969 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.048750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-openshift-service-ca\") pod \"maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:55.048969 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:53:55.048809    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-serving-cert: secret "maas-api-e2e-derive-b98481aa-serving-cert" not found
Jul 09 13:53:55.048969 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:53:55.048877    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-maas-api-tls podName:670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0 nodeName:}" failed. No retries permitted until 2026-07-09 13:53:55.548854835 +0000 UTC m=+1481.760845230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-maas-api-tls") pod "maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z" (UID: "670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0") : secret "maas-api-e2e-derive-b98481aa-serving-cert" not found
Jul 09 13:53:55.049483 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.049463    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-openshift-service-ca\") pod \"maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:55.061737 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.061712    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdhb2\" (UniqueName: \"kubernetes.io/projected/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-kube-api-access-bdhb2\") pod \"maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:55.214638 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.214601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:55.381440 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.381406    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:55.481111 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.481074    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:53:55.554969 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.554930    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-maas-api-tls\") pod \"maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:55.557342 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.557321    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-maas-api-tls\") pod \"maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:55.771502 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.771407    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:55.928174 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:55.928147    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"]
Jul 09 13:53:55.929642 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:53:55.929614    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670e1fc1_0ff7_4622_91c9_ee4e37e8c0a0.slice/crio-178df1984ba4b1caf418b91a9e43efc89aad02a6b963e9d696dbbd2a06c78660 WatchSource:0}: Error finding container 178df1984ba4b1caf418b91a9e43efc89aad02a6b963e9d696dbbd2a06c78660: Status 404 returned error can't find the container with id 178df1984ba4b1caf418b91a9e43efc89aad02a6b963e9d696dbbd2a06c78660
Jul 09 13:53:56.543804 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:56.543773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z" event={"ID":"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0","Type":"ContainerStarted","Data":"68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79"}
Jul 09 13:53:56.543928 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:56.543833    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:53:56.543928 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:56.543853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z" event={"ID":"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0","Type":"ContainerStarted","Data":"178df1984ba4b1caf418b91a9e43efc89aad02a6b963e9d696dbbd2a06c78660"}
Jul 09 13:53:56.566579 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:56.566533    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z" podStartSLOduration=2.026019488 podStartE2EDuration="2.566518156s" totalImagesPullingTime="540.498668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:53:56.56418804 +0000 UTC m=+1482.776178497" watchObservedRunningTime="2026-07-09 13:53:56.566518156 +0000 UTC m=+1482.778508571"
Jul 09 13:53:57.732523 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:53:57.732487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:02.072120 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.072085    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"]
Jul 09 13:54:02.072557 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.072268    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z" podUID="670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0" containerName="maas-api" containerID="cri-o://68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79" gracePeriod=30
Jul 09 13:54:02.077935 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.077914    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:54:02.106745 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.106666    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:02.191963 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.191930    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:02.284945 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.284915    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:02.329401 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.329341    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:54:02.391235 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.391203    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:02.418416 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.418381    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-openshift-service-ca\") pod \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") "
Jul 09 13:54:02.418580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.418425    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdhb2\" (UniqueName: \"kubernetes.io/projected/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-kube-api-access-bdhb2\") pod \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") "
Jul 09 13:54:02.418580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.418444    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-maas-api-tls\") pod \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\" (UID: \"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0\") "
Jul 09 13:54:02.418820 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.418794    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0" (UID: "670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:54:02.420629 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.420604    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-kube-api-access-bdhb2" (OuterVolumeSpecName: "kube-api-access-bdhb2") pod "670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0" (UID: "670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0"). InnerVolumeSpecName "kube-api-access-bdhb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:54:02.420736 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.420713    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0" (UID: "670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:54:02.519681 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.519647    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-openshift-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:54:02.519681 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.519676    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdhb2\" (UniqueName: \"kubernetes.io/projected/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-kube-api-access-bdhb2\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:54:02.519681 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.519687    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0-maas-api-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:54:02.578255 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.578223    2583 generic.go:356] "Generic (PLEG): container finished" podID="670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0" containerID="68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79" exitCode=0
Jul 09 13:54:02.578436 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.578271    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"
Jul 09 13:54:02.578436 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.578310    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z" event={"ID":"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0","Type":"ContainerDied","Data":"68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79"}
Jul 09 13:54:02.578436 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.578372    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z" event={"ID":"670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0","Type":"ContainerDied","Data":"178df1984ba4b1caf418b91a9e43efc89aad02a6b963e9d696dbbd2a06c78660"}
Jul 09 13:54:02.578436 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.578398    2583 scope.go:117] "RemoveContainer" containerID="68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79"
Jul 09 13:54:02.594658 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.594639    2583 scope.go:117] "RemoveContainer" containerID="68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79"
Jul 09 13:54:02.594914 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:54:02.594895    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79\": container with ID starting with 68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79 not found: ID does not exist" containerID="68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79"
Jul 09 13:54:02.594993 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.594921    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79"} err="failed to get container status \"68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79\": rpc error: code = NotFound desc = could not find container \"68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79\": container with ID starting with 68b2a4031a84372794904d78c71daa03e477cacf1348ec4d6c2a39bb638a1f79 not found: ID does not exist"
Jul 09 13:54:02.611496 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.611471    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"]
Jul 09 13:54:02.616343 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:02.616322    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b98481aa-65f4cdfff8-p5c2z"]
Jul 09 13:54:04.318364 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:04.318334    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0" path="/var/lib/kubelet/pods/670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0/volumes"
Jul 09 13:54:04.335529 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:04.335498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:09.047419 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:09.047387    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:09.146973 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:09.146938    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:09.531842 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:09.531809    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:09.633902 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:09.633871    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:09.731220 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:09.731191    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:14.364775 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:14.364663    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:54:14.382261 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:14.376401    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:54:41.047758 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:41.047646    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:47.843320 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:47.843253    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:51.457804 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:51.457768    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:54.164199 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:54.164160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:54.226528 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:54.226488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:54.316835 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:54.316801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:54.417619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:54.415116    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:54.514974 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:54.514942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:54:54.918606 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:54:54.918576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:55:20.910231 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:55:20.910197    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:55:27.090443 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:55:27.090402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:55:27.194151 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:55:27.194120    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:55:27.292421 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:55:27.292378    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:55:43.210422 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:55:43.210390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:55:49.634056 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:55:49.634015    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:55:49.703445 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:55:49.703400    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:55:49.792014 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:55:49.791974    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:55:49.901866 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:55:49.901773    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:55:56.682969 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:55:56.682926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:00.371403 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:00.371364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:01.174128 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:01.174095    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:07.687949 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:07.687858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:07.755377 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:07.755341    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:07.836083 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:07.836051    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:07.936383 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:07.936335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:08.038125 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:08.038036    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:08.765392 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:08.765359    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:08.862159 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:08.862125    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:08.967650 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:08.967616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:40.130516 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:40.130483    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:40.230456 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:40.230417    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:40.487432 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:40.487333    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:42.595072 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:42.595038    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:47.006513 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:47.006475    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:52.962373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:52.962340    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:56:53.022772 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:56:53.022730    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:23.601361 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:23.601324    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:30.115220 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:30.115179    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:36.638533 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:36.638447    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:36.738573 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:36.738529    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:36.972225 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:36.972134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:37.267846 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:37.267764    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:37.584828 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:37.584794    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:40.532747 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.532714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:40.630625 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.630589    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:40.860977 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.860939    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"]
Jul 09 13:57:40.861603 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.861582    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0" containerName="maas-api"
Jul 09 13:57:40.861603 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.861603    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0" containerName="maas-api"
Jul 09 13:57:40.861794 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.861705    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="670e1fc1-0ff7-4622-91c9-ee4e37e8c0a0" containerName="maas-api"
Jul 09 13:57:40.865232 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.865209    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:40.868252 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.868228    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ca4936b3-serving-cert\""
Jul 09 13:57:40.881518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.881494    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"]
Jul 09 13:57:40.927066 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.927040    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:40.953344 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.953314    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2202939b-1530-4fc5-b73f-b4c9bef51ffb-openshift-service-ca\") pod \"maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:40.953489 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.953369    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpb6v\" (UniqueName: \"kubernetes.io/projected/2202939b-1530-4fc5-b73f-b4c9bef51ffb-kube-api-access-wpb6v\") pod \"maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:40.953489 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:40.953429    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2202939b-1530-4fc5-b73f-b4c9bef51ffb-maas-api-tls\") pod \"maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:41.054124 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.054095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpb6v\" (UniqueName: \"kubernetes.io/projected/2202939b-1530-4fc5-b73f-b4c9bef51ffb-kube-api-access-wpb6v\") pod \"maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:41.054318 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.054144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2202939b-1530-4fc5-b73f-b4c9bef51ffb-maas-api-tls\") pod \"maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:41.054318 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.054196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2202939b-1530-4fc5-b73f-b4c9bef51ffb-openshift-service-ca\") pod \"maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:41.054419 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:57:41.054338    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-serving-cert: secret "maas-api-e2e-mt-ca4936b3-serving-cert" not found
Jul 09 13:57:41.054419 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:57:41.054410    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2202939b-1530-4fc5-b73f-b4c9bef51ffb-maas-api-tls podName:2202939b-1530-4fc5-b73f-b4c9bef51ffb nodeName:}" failed. No retries permitted until 2026-07-09 13:57:41.554387753 +0000 UTC m=+1707.766378146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2202939b-1530-4fc5-b73f-b4c9bef51ffb-maas-api-tls") pod "maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v" (UID: "2202939b-1530-4fc5-b73f-b4c9bef51ffb") : secret "maas-api-e2e-mt-ca4936b3-serving-cert" not found
Jul 09 13:57:41.054866 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.054849    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2202939b-1530-4fc5-b73f-b4c9bef51ffb-openshift-service-ca\") pod \"maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:41.064391 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.064370    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpb6v\" (UniqueName: \"kubernetes.io/projected/2202939b-1530-4fc5-b73f-b4c9bef51ffb-kube-api-access-wpb6v\") pod \"maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:41.410627 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.410583    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:41.559924 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.559890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2202939b-1530-4fc5-b73f-b4c9bef51ffb-maas-api-tls\") pod \"maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:41.562434 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.562406    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2202939b-1530-4fc5-b73f-b4c9bef51ffb-maas-api-tls\") pod \"maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:41.591423 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.591385    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:41.692220 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.692133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:41.775545 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.775512    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:41.926318 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:41.924388    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"]
Jul 09 13:57:42.836137 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:42.836095    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v" event={"ID":"2202939b-1530-4fc5-b73f-b4c9bef51ffb","Type":"ContainerStarted","Data":"89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260"}
Jul 09 13:57:42.836555 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:42.836236    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:42.836555 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:42.836262    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v" event={"ID":"2202939b-1530-4fc5-b73f-b4c9bef51ffb","Type":"ContainerStarted","Data":"3d2cbeb74ac4318116d10abe75cd1bae1f4942d9375d826875c24513a29a2f3f"}
Jul 09 13:57:42.868269 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:42.868218    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v" podStartSLOduration=2.295234429 podStartE2EDuration="2.868203909s" totalImagesPullingTime="572.96948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:57:42.861319142 +0000 UTC m=+1709.073309564" watchObservedRunningTime="2026-07-09 13:57:42.868203909 +0000 UTC m=+1709.080194323"
Jul 09 13:57:45.040653 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:45.040618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:45.735571 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:45.735540    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:45.825893 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:45.825859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:46.141996 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:46.141967    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:48.847621 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:48.847587    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:52.527443 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:52.527396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:52.583500 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:52.583459    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:52.966235 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:52.966194    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:53.344453 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.344412    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:53.397914 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.397885    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"]
Jul 09 13:57:53.398116 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.398078    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v" podUID="2202939b-1530-4fc5-b73f-b4c9bef51ffb" containerName="maas-api" containerID="cri-o://89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260" gracePeriod=30
Jul 09 13:57:53.422149 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.422126    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:57:53.652853 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.652828    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:53.766472 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.766442    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2202939b-1530-4fc5-b73f-b4c9bef51ffb-maas-api-tls\") pod \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") "
Jul 09 13:57:53.766619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.766509    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2202939b-1530-4fc5-b73f-b4c9bef51ffb-openshift-service-ca\") pod \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") "
Jul 09 13:57:53.766619 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.766541    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpb6v\" (UniqueName: \"kubernetes.io/projected/2202939b-1530-4fc5-b73f-b4c9bef51ffb-kube-api-access-wpb6v\") pod \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\" (UID: \"2202939b-1530-4fc5-b73f-b4c9bef51ffb\") "
Jul 09 13:57:53.766897 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.766869    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2202939b-1530-4fc5-b73f-b4c9bef51ffb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2202939b-1530-4fc5-b73f-b4c9bef51ffb" (UID: "2202939b-1530-4fc5-b73f-b4c9bef51ffb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:57:53.768423 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.768401    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2202939b-1530-4fc5-b73f-b4c9bef51ffb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2202939b-1530-4fc5-b73f-b4c9bef51ffb" (UID: "2202939b-1530-4fc5-b73f-b4c9bef51ffb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:57:53.768686 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.768666    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2202939b-1530-4fc5-b73f-b4c9bef51ffb-kube-api-access-wpb6v" (OuterVolumeSpecName: "kube-api-access-wpb6v") pod "2202939b-1530-4fc5-b73f-b4c9bef51ffb" (UID: "2202939b-1530-4fc5-b73f-b4c9bef51ffb"). InnerVolumeSpecName "kube-api-access-wpb6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:57:53.867580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.867552    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2202939b-1530-4fc5-b73f-b4c9bef51ffb-openshift-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:57:53.867580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.867574    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpb6v\" (UniqueName: \"kubernetes.io/projected/2202939b-1530-4fc5-b73f-b4c9bef51ffb-kube-api-access-wpb6v\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:57:53.867580 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.867584    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2202939b-1530-4fc5-b73f-b4c9bef51ffb-maas-api-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:57:53.899795 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.899728    2583 generic.go:356] "Generic (PLEG): container finished" podID="2202939b-1530-4fc5-b73f-b4c9bef51ffb" containerID="89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260" exitCode=0
Jul 09 13:57:53.899795 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.899785    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"
Jul 09 13:57:53.899795 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.899789    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v" event={"ID":"2202939b-1530-4fc5-b73f-b4c9bef51ffb","Type":"ContainerDied","Data":"89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260"}
Jul 09 13:57:53.899990 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.899826    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v" event={"ID":"2202939b-1530-4fc5-b73f-b4c9bef51ffb","Type":"ContainerDied","Data":"3d2cbeb74ac4318116d10abe75cd1bae1f4942d9375d826875c24513a29a2f3f"}
Jul 09 13:57:53.899990 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.899847    2583 scope.go:117] "RemoveContainer" containerID="89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260"
Jul 09 13:57:53.909751 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.909729    2583 scope.go:117] "RemoveContainer" containerID="89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260"
Jul 09 13:57:53.910185 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:57:53.910160    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260\": container with ID starting with 89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260 not found: ID does not exist" containerID="89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260"
Jul 09 13:57:53.910315 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.910193    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260"} err="failed to get container status \"89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260\": rpc error: code = NotFound desc = could not find container \"89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260\": container with ID starting with 89ad94accd166a5bb2a0667f2f169315669f11a00a2886af4137c3cb090a7260 not found: ID does not exist"
Jul 09 13:57:53.926386 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.926359    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"]
Jul 09 13:57:53.928955 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:53.928937    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca4936b3-6b97f6d899-q289v"]
Jul 09 13:57:54.317439 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:57:54.317410    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2202939b-1530-4fc5-b73f-b4c9bef51ffb" path="/var/lib/kubelet/pods/2202939b-1530-4fc5-b73f-b4c9bef51ffb/volumes"
Jul 09 13:58:00.155747 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:00.155714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:00.221764 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:00.221721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:00.445063 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:00.444982    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:00.658451 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:00.658415    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:00.756800 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:00.756703    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:00.856282 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:00.856252    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:00.988478 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:00.988437    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:07.814271 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:07.814230    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:07.917987 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:07.917943    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:08.016260 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:08.016222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:08.217208 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:08.217172    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:14.449346 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:14.449314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:15.857224 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:15.857195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:21.232325 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:21.232275    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:21.593145 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:21.593107    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:21.914571 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:21.914496    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:24.718226 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.718186    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:24.803728 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.803684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:24.805622 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.805595    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"]
Jul 09 13:58:24.806059 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.806046    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2202939b-1530-4fc5-b73f-b4c9bef51ffb" containerName="maas-api"
Jul 09 13:58:24.806103 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.806061    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2202939b-1530-4fc5-b73f-b4c9bef51ffb" containerName="maas-api"
Jul 09 13:58:24.806138 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.806132    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2202939b-1530-4fc5-b73f-b4c9bef51ffb" containerName="maas-api"
Jul 09 13:58:24.809482 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.809459    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:24.812166 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.812147    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d7d5695b-serving-cert\""
Jul 09 13:58:24.822104 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.822084    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"]
Jul 09 13:58:24.825526 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.825497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5426708e-6e1c-420a-afd2-d3719a413a8b-maas-api-tls\") pod \"maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:24.825640 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.825562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47hz9\" (UniqueName: \"kubernetes.io/projected/5426708e-6e1c-420a-afd2-d3719a413a8b-kube-api-access-47hz9\") pod \"maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:24.825727 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.825703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5426708e-6e1c-420a-afd2-d3719a413a8b-openshift-service-ca\") pod \"maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:24.870297 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.870247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:24.926106 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.926073    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5426708e-6e1c-420a-afd2-d3719a413a8b-openshift-service-ca\") pod \"maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:24.926307 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.926126    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5426708e-6e1c-420a-afd2-d3719a413a8b-maas-api-tls\") pod \"maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:24.926307 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.926179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47hz9\" (UniqueName: \"kubernetes.io/projected/5426708e-6e1c-420a-afd2-d3719a413a8b-kube-api-access-47hz9\") pod \"maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:24.926865 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.926839    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5426708e-6e1c-420a-afd2-d3719a413a8b-openshift-service-ca\") pod \"maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:24.928584 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.928565    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5426708e-6e1c-420a-afd2-d3719a413a8b-maas-api-tls\") pod \"maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:24.936073 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.936043    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47hz9\" (UniqueName: \"kubernetes.io/projected/5426708e-6e1c-420a-afd2-d3719a413a8b-kube-api-access-47hz9\") pod \"maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:24.976511 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:24.976445    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:25.120655 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:25.120609    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:25.208395 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:25.208353    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:25.265791 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:25.265766    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"]
Jul 09 13:58:25.268365 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:58:25.268337    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5426708e_6e1c_420a_afd2_d3719a413a8b.slice/crio-a705575868d51761a93aa6c006f5f96dfc540566100f3b1c791ff22084acad8e WatchSource:0}: Error finding container a705575868d51761a93aa6c006f5f96dfc540566100f3b1c791ff22084acad8e: Status 404 returned error can't find the container with id a705575868d51761a93aa6c006f5f96dfc540566100f3b1c791ff22084acad8e
Jul 09 13:58:25.269679 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:25.269655    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 13:58:25.320916 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:25.320885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:25.423557 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:25.423524    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:26.089765 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:26.089732    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4" event={"ID":"5426708e-6e1c-420a-afd2-d3719a413a8b","Type":"ContainerStarted","Data":"cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b"}
Jul 09 13:58:26.090165 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:26.089798    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:26.090165 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:26.089819    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4" event={"ID":"5426708e-6e1c-420a-afd2-d3719a413a8b","Type":"ContainerStarted","Data":"a705575868d51761a93aa6c006f5f96dfc540566100f3b1c791ff22084acad8e"}
Jul 09 13:58:26.113518 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:26.113468    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4" podStartSLOduration=1.638345275 podStartE2EDuration="2.113451968s" totalImagesPullingTime="475.106693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:26.112227262 +0000 UTC m=+1752.324217690" watchObservedRunningTime="2026-07-09 13:58:26.113451968 +0000 UTC m=+1752.325442382"
Jul 09 13:58:29.202145 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:29.202114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:32.101080 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:32.101048    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:33.072537 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.072495    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"]
Jul 09 13:58:33.076526 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.076499    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.079450 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.079427    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d7d5695b\"/\"openshift-service-ca.crt\""
Jul 09 13:58:33.079582 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.079562    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d7d5695b\"/\"kube-root-ca.crt\""
Jul 09 13:58:33.081072 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.081051    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d7d5695b\"/\"e2e-lifecycle-model-d7d5695b-kserve-self-signed-certs\""
Jul 09 13:58:33.081173 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.081102    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d7d5695b\"/\"default-dockercfg-v8xh2\""
Jul 09 13:58:33.087035 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.087014    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"]
Jul 09 13:58:33.089993 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.089974    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-dshm\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.090100 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.090007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tls-certs\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.090100 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.090041    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-model-cache\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.090100 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.090080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nfmw\" (UniqueName: \"kubernetes.io/projected/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-kube-api-access-8nfmw\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.090209 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.090101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tmp-dir\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.090209 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.090188    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-home\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.180722 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.180692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:33.190799 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.190762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-home\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.190944 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.190816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-dshm\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.190944 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.190847    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tls-certs\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.190944 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.190899    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-model-cache\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.190944 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.190937    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfmw\" (UniqueName: \"kubernetes.io/projected/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-kube-api-access-8nfmw\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.191164 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.190965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tmp-dir\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.191228 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.191199    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-home\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.191354 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.191332    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tmp-dir\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.191430 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.191355    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-model-cache\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.193054 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.193035    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-dshm\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.193227 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.193211    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tls-certs\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.201113 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.201072    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nfmw\" (UniqueName: \"kubernetes.io/projected/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-kube-api-access-8nfmw\") pod \"e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") " pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.386737 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.386662    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:33.527112 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:33.527089    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"]
Jul 09 13:58:33.528980 ip-10-0-134-240 kubenswrapper[2583]: W0709 13:58:33.528953    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6d11c75_1e4e_484b_9d5a_a6c51ea51c0b.slice/crio-356b60a36c576e9d73bec0d1ccf5b7300372a144e128cd02a2a89b52db9f195e WatchSource:0}: Error finding container 356b60a36c576e9d73bec0d1ccf5b7300372a144e128cd02a2a89b52db9f195e: Status 404 returned error can't find the container with id 356b60a36c576e9d73bec0d1ccf5b7300372a144e128cd02a2a89b52db9f195e
Jul 09 13:58:34.138622 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:34.138583    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n" event={"ID":"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b","Type":"ContainerStarted","Data":"9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92"}
Jul 09 13:58:34.138622 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:34.138628    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n" event={"ID":"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b","Type":"ContainerStarted","Data":"356b60a36c576e9d73bec0d1ccf5b7300372a144e128cd02a2a89b52db9f195e"}
Jul 09 13:58:34.159929 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:34.159879    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n" podStartSLOduration=1.159865417 podStartE2EDuration="1.159865417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:58:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:58:34.157585709 +0000 UTC m=+1760.369576143" watchObservedRunningTime="2026-07-09 13:58:34.159865417 +0000 UTC m=+1760.371855832"
Jul 09 13:58:43.387495 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:43.387462    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:43.387495 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:43.387505    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:43.399964 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:43.399941    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:44.207081 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:44.207053    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:58:56.502968 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:56.502932    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:56.874908 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:56.874870    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"]
Jul 09 13:58:56.875160 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:56.875135    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4" podUID="5426708e-6e1c-420a-afd2-d3719a413a8b" containerName="maas-api" containerID="cri-o://cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b" gracePeriod=30
Jul 09 13:58:56.890811 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:56.890776    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:58:57.136522 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.136455    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:57.206394 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.206364    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47hz9\" (UniqueName: \"kubernetes.io/projected/5426708e-6e1c-420a-afd2-d3719a413a8b-kube-api-access-47hz9\") pod \"5426708e-6e1c-420a-afd2-d3719a413a8b\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") "
Jul 09 13:58:57.206579 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.206414    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5426708e-6e1c-420a-afd2-d3719a413a8b-openshift-service-ca\") pod \"5426708e-6e1c-420a-afd2-d3719a413a8b\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") "
Jul 09 13:58:57.206579 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.206486    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5426708e-6e1c-420a-afd2-d3719a413a8b-maas-api-tls\") pod \"5426708e-6e1c-420a-afd2-d3719a413a8b\" (UID: \"5426708e-6e1c-420a-afd2-d3719a413a8b\") "
Jul 09 13:58:57.206785 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.206760    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5426708e-6e1c-420a-afd2-d3719a413a8b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5426708e-6e1c-420a-afd2-d3719a413a8b" (UID: "5426708e-6e1c-420a-afd2-d3719a413a8b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 13:58:57.208634 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.208590    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5426708e-6e1c-420a-afd2-d3719a413a8b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5426708e-6e1c-420a-afd2-d3719a413a8b" (UID: "5426708e-6e1c-420a-afd2-d3719a413a8b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:58:57.208882 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.208855    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5426708e-6e1c-420a-afd2-d3719a413a8b-kube-api-access-47hz9" (OuterVolumeSpecName: "kube-api-access-47hz9") pod "5426708e-6e1c-420a-afd2-d3719a413a8b" (UID: "5426708e-6e1c-420a-afd2-d3719a413a8b"). InnerVolumeSpecName "kube-api-access-47hz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:58:57.275100 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.275065    2583 generic.go:356] "Generic (PLEG): container finished" podID="5426708e-6e1c-420a-afd2-d3719a413a8b" containerID="cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b" exitCode=0
Jul 09 13:58:57.275237 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.275108    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4" event={"ID":"5426708e-6e1c-420a-afd2-d3719a413a8b","Type":"ContainerDied","Data":"cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b"}
Jul 09 13:58:57.275237 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.275178    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4" event={"ID":"5426708e-6e1c-420a-afd2-d3719a413a8b","Type":"ContainerDied","Data":"a705575868d51761a93aa6c006f5f96dfc540566100f3b1c791ff22084acad8e"}
Jul 09 13:58:57.275237 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.275109    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"
Jul 09 13:58:57.275373 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.275204    2583 scope.go:117] "RemoveContainer" containerID="cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b"
Jul 09 13:58:57.284706 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.284690    2583 scope.go:117] "RemoveContainer" containerID="cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b"
Jul 09 13:58:57.284946 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:58:57.284931    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b\": container with ID starting with cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b not found: ID does not exist" containerID="cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b"
Jul 09 13:58:57.285025 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.284954    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b"} err="failed to get container status \"cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b\": rpc error: code = NotFound desc = could not find container \"cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b\": container with ID starting with cd5559f4f9d7246006b91ef3fc3549bd60cf6c161c3e7a9895e76898f86c031b not found: ID does not exist"
Jul 09 13:58:57.299161 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.299138    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"]
Jul 09 13:58:57.308021 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.307999    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47hz9\" (UniqueName: \"kubernetes.io/projected/5426708e-6e1c-420a-afd2-d3719a413a8b-kube-api-access-47hz9\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:58:57.308122 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.308023    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5426708e-6e1c-420a-afd2-d3719a413a8b-openshift-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:58:57.308122 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.308038    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5426708e-6e1c-420a-afd2-d3719a413a8b-maas-api-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:58:57.313529 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:57.313510    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4"]
Jul 09 13:58:58.316847 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:58:58.316812    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5426708e-6e1c-420a-afd2-d3719a413a8b" path="/var/lib/kubelet/pods/5426708e-6e1c-420a-afd2-d3719a413a8b/volumes"
Jul 09 13:59:00.096017 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:00.095967    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d7d5695b-bbffbd84d-m7xb4" podUID="5426708e-6e1c-420a-afd2-d3719a413a8b" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.67:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 09 13:59:02.566953 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:02.566925    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:05.742951 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:05.742910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:05.844394 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:05.844308    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:07.546912 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:07.546873    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"]
Jul 09 13:59:07.597227 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:07.597193    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:14.406276 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:14.406163    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:59:14.421053 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:14.415359    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 13:59:22.567720 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.567659    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n" podUID="a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" containerName="main" containerID="cri-o://9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92" gracePeriod=45
Jul 09 13:59:22.827758 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.827697    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:59:22.942168 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.942128    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-dshm\") pod \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") "
Jul 09 13:59:22.942406 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.942243    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tls-certs\") pod \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") "
Jul 09 13:59:22.942406 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.942278    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nfmw\" (UniqueName: \"kubernetes.io/projected/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-kube-api-access-8nfmw\") pod \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") "
Jul 09 13:59:22.942406 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.942369    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tmp-dir\") pod \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") "
Jul 09 13:59:22.942582 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.942408    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-model-cache\") pod \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") "
Jul 09 13:59:22.942582 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.942435    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-home\") pod \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\" (UID: \"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b\") "
Jul 09 13:59:22.942733 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.942682    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" (UID: "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:59:22.942790 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.942743    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-model-cache" (OuterVolumeSpecName: "model-cache") pod "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" (UID: "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:59:22.942790 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.942765    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-home" (OuterVolumeSpecName: "home") pod "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" (UID: "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:59:22.944511 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.944487    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-dshm" (OuterVolumeSpecName: "dshm") pod "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" (UID: "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 13:59:22.944626 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.944522    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" (UID: "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 13:59:22.944626 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:22.944544    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-kube-api-access-8nfmw" (OuterVolumeSpecName: "kube-api-access-8nfmw") pod "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" (UID: "a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b"). InnerVolumeSpecName "kube-api-access-8nfmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 13:59:23.043938 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.043894    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tmp-dir\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:59:23.043938 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.043930    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-model-cache\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:59:23.043938 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.043942    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-home\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:59:23.044183 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.043952    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-dshm\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:59:23.044183 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.043963    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-tls-certs\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:59:23.044183 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.043974    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nfmw\" (UniqueName: \"kubernetes.io/projected/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b-kube-api-access-8nfmw\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 13:59:23.427972 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.427936    2583 generic.go:356] "Generic (PLEG): container finished" podID="a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" containerID="9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92" exitCode=0
Jul 09 13:59:23.428172 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.427984    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"
Jul 09 13:59:23.428172 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.428018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n" event={"ID":"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b","Type":"ContainerDied","Data":"9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92"}
Jul 09 13:59:23.428172 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.428061    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n" event={"ID":"a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b","Type":"ContainerDied","Data":"356b60a36c576e9d73bec0d1ccf5b7300372a144e128cd02a2a89b52db9f195e"}
Jul 09 13:59:23.428172 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.428078    2583 scope.go:117] "RemoveContainer" containerID="9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92"
Jul 09 13:59:23.438039 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.438022    2583 scope.go:117] "RemoveContainer" containerID="9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92"
Jul 09 13:59:23.438320 ip-10-0-134-240 kubenswrapper[2583]: E0709 13:59:23.438298    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92\": container with ID starting with 9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92 not found: ID does not exist" containerID="9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92"
Jul 09 13:59:23.438385 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.438331    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92"} err="failed to get container status \"9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92\": rpc error: code = NotFound desc = could not find container \"9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92\": container with ID starting with 9bdaa680405864763f506f4bb328068a31a35194a344d1a233e419ff04a8ac92 not found: ID does not exist"
Jul 09 13:59:23.453191 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.453166    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"]
Jul 09 13:59:23.455614 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:23.455591    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-d7d5695b/e2e-lifecycle-model-d7d5695b-kserve-7678bd9c5f-5pg4n"]
Jul 09 13:59:24.317173 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:24.317138    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" path="/var/lib/kubelet/pods/a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b/volumes"
Jul 09 13:59:43.720582 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:43.720542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:46.272457 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:46.272421    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:53.220728 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:53.220689    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:53.285673 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:53.285643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:53.514982 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:53.514898    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:53.738070 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:53.738035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:54.783898 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:54.783862    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:54.874522 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:54.874485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:54.975480 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:54.975424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:55.707564 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:55.707517    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:55.807602 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:55.807563    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 13:59:55.907045 ip-10-0-134-240 kubenswrapper[2583]: I0709 13:59:55.907008    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:00:05.642783 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:00:05.642746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:00:14.619753 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:00:14.619719    2583 scope.go:117] "RemoveContainer" containerID="df84e30467daf658df8b4e50c31718f595440ea04d5f7bc9d3188128e5b98167"
Jul 09 14:00:27.187546 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:00:27.187514    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:00:30.759858 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:00:30.759825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:00:30.860334 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:00:30.860252    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:00:33.707671 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:00:33.707629    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:00:39.773459 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:00:39.773346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:00:39.833853 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:00:39.833817    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:01:10.397703 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:01:10.397664    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:01:17.061397 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:01:17.061359    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:01:23.246810 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:01:23.246776    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:01:23.315735 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:01:23.315698    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:01:23.382734 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:01:23.382699    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:01:23.488656 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:01:23.488621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:01:34.007502 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:01:34.007463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:01:34.404364 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:01:34.404322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:01:41.035137 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:01:41.035088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:01:42.011214 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:01:42.011171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:01:55.548863 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:01:55.548830    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:01.704092 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:01.704054    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:01.771330 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:01.771268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:02.042391 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:02.042272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:02.354826 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:02.354797    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:02.501192 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:02.501155    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:04.981242 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:04.981206    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:05.052092 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.052046    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"]
Jul 09 14:02:05.052618 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.052599    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5426708e-6e1c-420a-afd2-d3719a413a8b" containerName="maas-api"
Jul 09 14:02:05.052618 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.052616    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5426708e-6e1c-420a-afd2-d3719a413a8b" containerName="maas-api"
Jul 09 14:02:05.052797 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.052639    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" containerName="main"
Jul 09 14:02:05.052797 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.052644    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" containerName="main"
Jul 09 14:02:05.052797 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.052720    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5426708e-6e1c-420a-afd2-d3719a413a8b" containerName="maas-api"
Jul 09 14:02:05.052797 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.052728    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6d11c75-1e4e-484b-9d5a-a6c51ea51c0b" containerName="main"
Jul 09 14:02:05.055847 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.055825    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:05.058930 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.058900    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-440311-serving-cert\""
Jul 09 14:02:05.069999 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.069974    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"]
Jul 09 14:02:05.153601 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.153552    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tw7v\" (UniqueName: \"kubernetes.io/projected/c5e9a454-8258-4fa0-a28f-7a1005af58c1-kube-api-access-5tw7v\") pod \"maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:05.153813 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.153616    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5e9a454-8258-4fa0-a28f-7a1005af58c1-maas-api-tls\") pod \"maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:05.153813 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.153741    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5e9a454-8258-4fa0-a28f-7a1005af58c1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:05.254405 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.254313    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tw7v\" (UniqueName: \"kubernetes.io/projected/c5e9a454-8258-4fa0-a28f-7a1005af58c1-kube-api-access-5tw7v\") pod \"maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:05.254405 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.254362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5e9a454-8258-4fa0-a28f-7a1005af58c1-maas-api-tls\") pod \"maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:05.254641 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.254430    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5e9a454-8258-4fa0-a28f-7a1005af58c1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:05.254641 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:02:05.254528    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-serving-cert: secret "maas-api-e2e-inf-a-440311-serving-cert" not found
Jul 09 14:02:05.254641 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:02:05.254596    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e9a454-8258-4fa0-a28f-7a1005af58c1-maas-api-tls podName:c5e9a454-8258-4fa0-a28f-7a1005af58c1 nodeName:}" failed. No retries permitted until 2026-07-09 14:02:05.754581227 +0000 UTC m=+1971.966571625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c5e9a454-8258-4fa0-a28f-7a1005af58c1-maas-api-tls") pod "maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd" (UID: "c5e9a454-8258-4fa0-a28f-7a1005af58c1") : secret "maas-api-e2e-inf-a-440311-serving-cert" not found
Jul 09 14:02:05.255002 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.254985    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5e9a454-8258-4fa0-a28f-7a1005af58c1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:05.264234 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.264210    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tw7v\" (UniqueName: \"kubernetes.io/projected/c5e9a454-8258-4fa0-a28f-7a1005af58c1-kube-api-access-5tw7v\") pod \"maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:05.696472 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.696433    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:05.759195 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.759153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5e9a454-8258-4fa0-a28f-7a1005af58c1-maas-api-tls\") pod \"maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:05.761681 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.761651    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5e9a454-8258-4fa0-a28f-7a1005af58c1-maas-api-tls\") pod \"maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:05.795169 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.795135    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:05.970262 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:05.970122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:06.117499 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:06.117467    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"]
Jul 09 14:02:06.118956 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:02:06.118928    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e9a454_8258_4fa0_a28f_7a1005af58c1.slice/crio-ce602b182ca07299e7976c2a9907326552d909f595fa15199467c682dca265c4 WatchSource:0}: Error finding container ce602b182ca07299e7976c2a9907326552d909f595fa15199467c682dca265c4: Status 404 returned error can't find the container with id ce602b182ca07299e7976c2a9907326552d909f595fa15199467c682dca265c4
Jul 09 14:02:06.368052 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:06.368010    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd" event={"ID":"c5e9a454-8258-4fa0-a28f-7a1005af58c1","Type":"ContainerStarted","Data":"ce602b182ca07299e7976c2a9907326552d909f595fa15199467c682dca265c4"}
Jul 09 14:02:07.374983 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:07.374945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd" event={"ID":"c5e9a454-8258-4fa0-a28f-7a1005af58c1","Type":"ContainerStarted","Data":"a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8"}
Jul 09 14:02:07.375511 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:07.375156    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:07.395408 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:07.395355    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd" podStartSLOduration=1.969971833 podStartE2EDuration="2.395339246s" totalImagesPullingTime="425.367413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:02:07.393428019 +0000 UTC m=+1973.605418455" watchObservedRunningTime="2026-07-09 14:02:07.395339246 +0000 UTC m=+1973.607329661"
Jul 09 14:02:09.423209 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:09.423172    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:09.751277 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:09.751184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:10.039186 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:10.039102    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:10.327994 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:10.327954    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:13.019567 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.019533    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:13.074934 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.074895    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"]
Jul 09 14:02:13.078803 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.078779    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:13.081689 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.081667    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-505c59-serving-cert\""
Jul 09 14:02:13.092151 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.092122    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"]
Jul 09 14:02:13.093102 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.093060    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:13.127639 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.127595    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:13.127827 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.127674    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-maas-api-tls\") pod \"maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:13.127827 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.127721    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xddhp\" (UniqueName: \"kubernetes.io/projected/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-kube-api-access-xddhp\") pod \"maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:13.147957 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.147911    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:13.228458 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.228419    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xddhp\" (UniqueName: \"kubernetes.io/projected/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-kube-api-access-xddhp\") pod \"maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:13.228661 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.228486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:13.228661 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.228528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-maas-api-tls\") pod \"maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:13.228661 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:02:13.228625    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-serving-cert: secret "maas-api-e2e-inf-b-505c59-serving-cert" not found
Jul 09 14:02:13.228828 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:02:13.228676    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-maas-api-tls podName:178a0723-1b8e-4cab-9637-1c46ca2ad7fc nodeName:}" failed. No retries permitted until 2026-07-09 14:02:13.72865974 +0000 UTC m=+1979.940650133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-maas-api-tls") pod "maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm" (UID: "178a0723-1b8e-4cab-9637-1c46ca2ad7fc") : secret "maas-api-e2e-inf-b-505c59-serving-cert" not found
Jul 09 14:02:13.229176 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.229140    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:13.239659 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.239634    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xddhp\" (UniqueName: \"kubernetes.io/projected/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-kube-api-access-xddhp\") pod \"maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:13.385734 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.385703    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:02:13.473673 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.473637    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:13.685755 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.685666    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:13.733198 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.733167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-maas-api-tls\") pod \"maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:13.735636 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.735616    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-maas-api-tls\") pod \"maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:13.786164 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.786114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:13.992734 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:13.992649    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:14.144274 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:14.144244    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"]
Jul 09 14:02:14.145413 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:02:14.145391    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178a0723_1b8e_4cab_9637_1c46ca2ad7fc.slice/crio-2e9c4467f09b94db2f80615caa838642eb4b4d039b562fb3f6c7b1d9a9078576 WatchSource:0}: Error finding container 2e9c4467f09b94db2f80615caa838642eb4b4d039b562fb3f6c7b1d9a9078576: Status 404 returned error can't find the container with id 2e9c4467f09b94db2f80615caa838642eb4b4d039b562fb3f6c7b1d9a9078576
Jul 09 14:02:14.417380 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:14.417339    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm" event={"ID":"178a0723-1b8e-4cab-9637-1c46ca2ad7fc","Type":"ContainerStarted","Data":"2e9c4467f09b94db2f80615caa838642eb4b4d039b562fb3f6c7b1d9a9078576"}
Jul 09 14:02:15.425692 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:15.425648    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm" event={"ID":"178a0723-1b8e-4cab-9637-1c46ca2ad7fc","Type":"ContainerStarted","Data":"2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c"}
Jul 09 14:02:15.426191 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:15.425952    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:15.445644 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:15.445592    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm" podStartSLOduration=1.943695676 podStartE2EDuration="2.445577843s" totalImagesPullingTime="501.882167ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:02:15.443878484 +0000 UTC m=+1981.655868900" watchObservedRunningTime="2026-07-09 14:02:15.445577843 +0000 UTC m=+1981.657568258"
Jul 09 14:02:17.394263 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:17.394229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:21.436823 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:21.436792    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:02:25.970103 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:25.970067    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"]
Jul 09 14:02:25.974271 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:25.974237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:25.978654 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:25.978617    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-440311\"/\"default-dockercfg-9z98x\""
Jul 09 14:02:25.978789 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:25.978650    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-440311\"/\"kube-root-ca.crt\""
Jul 09 14:02:25.978789 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:25.978685    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-440311\"/\"openshift-service-ca.crt\""
Jul 09 14:02:25.978789 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:25.978622    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-440311\"/\"test-model-440311-kserve-self-signed-certs\""
Jul 09 14:02:25.988026 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:25.988004    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"]
Jul 09 14:02:26.016626 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.016586    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:26.047989 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.047954    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-tmp-dir\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.047989 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.047989    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hvmn\" (UniqueName: \"kubernetes.io/projected/af034814-a392-4047-a742-a92f4633490a-kube-api-access-7hvmn\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.048193 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.048071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-model-cache\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.048193 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.048143    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-dshm\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.048193 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.048165    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af034814-a392-4047-a742-a92f4633490a-tls-certs\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.048326 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.048192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-home\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.148744 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.148706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-tmp-dir\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.148744 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.148746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hvmn\" (UniqueName: \"kubernetes.io/projected/af034814-a392-4047-a742-a92f4633490a-kube-api-access-7hvmn\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.148986 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.148793    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-model-cache\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.148986 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.148828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-dshm\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.148986 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.148857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af034814-a392-4047-a742-a92f4633490a-tls-certs\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.148986 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.148893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-home\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.149240 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.149208    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-model-cache\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.149331 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.149248    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-tmp-dir\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.149331 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.149306    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-home\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.151085 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.151064    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-dshm\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.151380 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.151361    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af034814-a392-4047-a742-a92f4633490a-tls-certs\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.163781 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.163758    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hvmn\" (UniqueName: \"kubernetes.io/projected/af034814-a392-4047-a742-a92f4633490a-kube-api-access-7hvmn\") pod \"test-model-440311-kserve-5b5875475-qrk6j\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") " pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.286127 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.286032    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:26.411922 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.411875    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:26.443502 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.443478    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"]
Jul 09 14:02:26.445761 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:02:26.445734    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf034814_a392_4047_a742_a92f4633490a.slice/crio-1f0a1bc35bf7842f44df44927dce950b46e38a907706f6b8b35e76a3ab6e2ee0 WatchSource:0}: Error finding container 1f0a1bc35bf7842f44df44927dce950b46e38a907706f6b8b35e76a3ab6e2ee0: Status 404 returned error can't find the container with id 1f0a1bc35bf7842f44df44927dce950b46e38a907706f6b8b35e76a3ab6e2ee0
Jul 09 14:02:26.493873 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.493840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j" event={"ID":"af034814-a392-4047-a742-a92f4633490a","Type":"ContainerStarted","Data":"1f0a1bc35bf7842f44df44927dce950b46e38a907706f6b8b35e76a3ab6e2ee0"}
Jul 09 14:02:26.511547 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:26.511511    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:27.501183 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:27.501146    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j" event={"ID":"af034814-a392-4047-a742-a92f4633490a","Type":"ContainerStarted","Data":"f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf"}
Jul 09 14:02:27.520576 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:27.520525    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j" podStartSLOduration=2.520509507 podStartE2EDuration="2.520509507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:02:27.520088915 +0000 UTC m=+1993.732079330" watchObservedRunningTime="2026-07-09 14:02:27.520509507 +0000 UTC m=+1993.732499921"
Jul 09 14:02:35.540850 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:35.540816    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:35.641648 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:35.641590    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:02:36.287027 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:36.286992    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:36.287217 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:36.287069    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:36.299720 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:36.299694    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:36.563958 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:36.563869    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:02:54.194357 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:02:54.194318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:15.354841 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:15.354809    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:15.676073 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:15.675981    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:15.874017 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:15.873987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:18.309970 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.309930    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:18.386495 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.386449    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:18.467864 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.467831    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"]
Jul 09 14:03:18.471477 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.471455    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:18.474340 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.474267    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-reuse-d43b1d-serving-cert\""
Jul 09 14:03:18.483728 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.483705    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"]
Jul 09 14:03:18.502134 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.502104    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:18.513541 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.513505    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0c0e7dd-d80d-455c-8063-10965b5e3939-maas-api-tls\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-czb8v\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:18.513667 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.513593    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0c0e7dd-d80d-455c-8063-10965b5e3939-openshift-service-ca\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-czb8v\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:18.513667 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.513623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx5pt\" (UniqueName: \"kubernetes.io/projected/d0c0e7dd-d80d-455c-8063-10965b5e3939-kube-api-access-qx5pt\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-czb8v\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:18.614739 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.614710    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0c0e7dd-d80d-455c-8063-10965b5e3939-maas-api-tls\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-czb8v\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:18.614922 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.614769    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0c0e7dd-d80d-455c-8063-10965b5e3939-openshift-service-ca\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-czb8v\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:18.614922 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.614799    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx5pt\" (UniqueName: \"kubernetes.io/projected/d0c0e7dd-d80d-455c-8063-10965b5e3939-kube-api-access-qx5pt\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-czb8v\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:18.614922 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:03:18.614863    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-serving-cert: secret "maas-api-e2e-reuse-d43b1d-serving-cert" not found
Jul 09 14:03:18.615113 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:03:18.614956    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0c0e7dd-d80d-455c-8063-10965b5e3939-maas-api-tls podName:d0c0e7dd-d80d-455c-8063-10965b5e3939 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:19.114939156 +0000 UTC m=+2045.326929555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d0c0e7dd-d80d-455c-8063-10965b5e3939-maas-api-tls") pod "maas-api-e2e-reuse-d43b1d-7f5c845-czb8v" (UID: "d0c0e7dd-d80d-455c-8063-10965b5e3939") : secret "maas-api-e2e-reuse-d43b1d-serving-cert" not found
Jul 09 14:03:18.615565 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.615539    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0c0e7dd-d80d-455c-8063-10965b5e3939-openshift-service-ca\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-czb8v\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:18.623990 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.623961    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx5pt\" (UniqueName: \"kubernetes.io/projected/d0c0e7dd-d80d-455c-8063-10965b5e3939-kube-api-access-qx5pt\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-czb8v\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:18.927113 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:18.927023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:19.030242 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:19.030196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:19.120273 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:19.120239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0c0e7dd-d80d-455c-8063-10965b5e3939-maas-api-tls\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-czb8v\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:19.122636 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:19.122606    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0c0e7dd-d80d-455c-8063-10965b5e3939-maas-api-tls\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-czb8v\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:19.125169 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:19.125143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:19.384093 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:19.384053    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:19.530388 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:19.530358    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"]
Jul 09 14:03:19.531896 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:03:19.531871    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c0e7dd_d80d_455c_8063_10965b5e3939.slice/crio-33a8876c35edc937dc4c1d5e4b1f37e6d67dadb1d7d3bdd8f6a6182df6ac13cc WatchSource:0}: Error finding container 33a8876c35edc937dc4c1d5e4b1f37e6d67dadb1d7d3bdd8f6a6182df6ac13cc: Status 404 returned error can't find the container with id 33a8876c35edc937dc4c1d5e4b1f37e6d67dadb1d7d3bdd8f6a6182df6ac13cc
Jul 09 14:03:19.815654 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:19.815560    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v" event={"ID":"d0c0e7dd-d80d-455c-8063-10965b5e3939","Type":"ContainerStarted","Data":"33a8876c35edc937dc4c1d5e4b1f37e6d67dadb1d7d3bdd8f6a6182df6ac13cc"}
Jul 09 14:03:20.823392 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:20.823349    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v" event={"ID":"d0c0e7dd-d80d-455c-8063-10965b5e3939","Type":"ContainerStarted","Data":"af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a"}
Jul 09 14:03:20.823790 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:20.823427    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:20.844686 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:20.844629    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v" podStartSLOduration=2.447698666 podStartE2EDuration="2.844613708s" totalImagesPullingTime="396.915042ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:20.843121866 +0000 UTC m=+2047.055112283" watchObservedRunningTime="2026-07-09 14:03:20.844613708 +0000 UTC m=+2047.056604123"
Jul 09 14:03:22.811637 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:22.811593    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:26.835456 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:26.835426    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:29.842159 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:29.842120    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:44.776179 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:44.776082    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:45.134721 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.134684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:45.168631 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.168597    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"]
Jul 09 14:03:45.169089 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.169049    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v" podUID="d0c0e7dd-d80d-455c-8063-10965b5e3939" containerName="maas-api" containerID="cri-o://af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a" gracePeriod=30
Jul 09 14:03:45.200118 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.200085    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:03:45.441586 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.441556    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:45.569732 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.569698    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx5pt\" (UniqueName: \"kubernetes.io/projected/d0c0e7dd-d80d-455c-8063-10965b5e3939-kube-api-access-qx5pt\") pod \"d0c0e7dd-d80d-455c-8063-10965b5e3939\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") "
Jul 09 14:03:45.569916 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.569756    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0c0e7dd-d80d-455c-8063-10965b5e3939-openshift-service-ca\") pod \"d0c0e7dd-d80d-455c-8063-10965b5e3939\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") "
Jul 09 14:03:45.569916 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.569792    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0c0e7dd-d80d-455c-8063-10965b5e3939-maas-api-tls\") pod \"d0c0e7dd-d80d-455c-8063-10965b5e3939\" (UID: \"d0c0e7dd-d80d-455c-8063-10965b5e3939\") "
Jul 09 14:03:45.570093 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.570068    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0c0e7dd-d80d-455c-8063-10965b5e3939-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d0c0e7dd-d80d-455c-8063-10965b5e3939" (UID: "d0c0e7dd-d80d-455c-8063-10965b5e3939"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:03:45.571779 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.571751    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0c0e7dd-d80d-455c-8063-10965b5e3939-kube-api-access-qx5pt" (OuterVolumeSpecName: "kube-api-access-qx5pt") pod "d0c0e7dd-d80d-455c-8063-10965b5e3939" (UID: "d0c0e7dd-d80d-455c-8063-10965b5e3939"). InnerVolumeSpecName "kube-api-access-qx5pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:03:45.571891 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.571835    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0c0e7dd-d80d-455c-8063-10965b5e3939-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d0c0e7dd-d80d-455c-8063-10965b5e3939" (UID: "d0c0e7dd-d80d-455c-8063-10965b5e3939"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:03:45.670758 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.670662    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx5pt\" (UniqueName: \"kubernetes.io/projected/d0c0e7dd-d80d-455c-8063-10965b5e3939-kube-api-access-qx5pt\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:03:45.670758 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.670695    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0c0e7dd-d80d-455c-8063-10965b5e3939-openshift-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:03:45.670758 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.670705    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0c0e7dd-d80d-455c-8063-10965b5e3939-maas-api-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:03:45.967124 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.967029    2583 generic.go:356] "Generic (PLEG): container finished" podID="d0c0e7dd-d80d-455c-8063-10965b5e3939" containerID="af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a" exitCode=0
Jul 09 14:03:45.967124 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.967077    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"
Jul 09 14:03:45.967578 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.967115    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v" event={"ID":"d0c0e7dd-d80d-455c-8063-10965b5e3939","Type":"ContainerDied","Data":"af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a"}
Jul 09 14:03:45.967578 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.967174    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v" event={"ID":"d0c0e7dd-d80d-455c-8063-10965b5e3939","Type":"ContainerDied","Data":"33a8876c35edc937dc4c1d5e4b1f37e6d67dadb1d7d3bdd8f6a6182df6ac13cc"}
Jul 09 14:03:45.967578 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.967188    2583 scope.go:117] "RemoveContainer" containerID="af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a"
Jul 09 14:03:45.978193 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.978160    2583 scope.go:117] "RemoveContainer" containerID="af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a"
Jul 09 14:03:45.978503 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:03:45.978482    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a\": container with ID starting with af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a not found: ID does not exist" containerID="af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a"
Jul 09 14:03:45.978569 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.978514    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a"} err="failed to get container status \"af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a\": rpc error: code = NotFound desc = could not find container \"af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a\": container with ID starting with af5d5a3b0329d91d5a0d1e5ce2557406c6d8c7641fabc3452c8cf95254d0a97a not found: ID does not exist"
Jul 09 14:03:45.999494 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:45.999460    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"]
Jul 09 14:03:46.006031 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:46.006006    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-czb8v"]
Jul 09 14:03:46.319600 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:46.319569    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0c0e7dd-d80d-455c-8063-10965b5e3939" path="/var/lib/kubelet/pods/d0c0e7dd-d80d-455c-8063-10965b5e3939/volumes"
Jul 09 14:03:50.216759 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:03:50.216716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:14.444174 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:14.444074    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 14:04:14.455001 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:14.454972    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 14:04:26.415600 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:26.415562    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:27.955573 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:27.955539    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:34.109703 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:34.109668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:34.211077 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:34.211023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:34.409142 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:34.409003    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:34.653341 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:34.653302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:36.038018 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:36.037982    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:36.133281 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:36.133247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:37.175417 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.175380    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:37.258384 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.258347    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:37.262817 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.262780    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"]
Jul 09 14:04:37.263847 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.263822    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0c0e7dd-d80d-455c-8063-10965b5e3939" containerName="maas-api"
Jul 09 14:04:37.263847 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.263848    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0c0e7dd-d80d-455c-8063-10965b5e3939" containerName="maas-api"
Jul 09 14:04:37.264086 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.264073    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0c0e7dd-d80d-455c-8063-10965b5e3939" containerName="maas-api"
Jul 09 14:04:37.268226 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.268203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:37.272215 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.272186    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-reuse-d43b1d-serving-cert\""
Jul 09 14:04:37.275213 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.275191    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"]
Jul 09 14:04:37.320358 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.320325    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:37.451986 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.451897    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12e1c485-33dd-42bc-9187-bc9361f16e69-maas-api-tls\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:37.451986 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.451978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8wj4\" (UniqueName: \"kubernetes.io/projected/12e1c485-33dd-42bc-9187-bc9361f16e69-kube-api-access-q8wj4\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:37.452180 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.452019    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e1c485-33dd-42bc-9187-bc9361f16e69-openshift-service-ca\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:37.474359 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.474322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:37.553231 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.553192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12e1c485-33dd-42bc-9187-bc9361f16e69-maas-api-tls\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:37.553444 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.553282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8wj4\" (UniqueName: \"kubernetes.io/projected/12e1c485-33dd-42bc-9187-bc9361f16e69-kube-api-access-q8wj4\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:37.553444 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.553358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e1c485-33dd-42bc-9187-bc9361f16e69-openshift-service-ca\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:37.554040 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.554020    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e1c485-33dd-42bc-9187-bc9361f16e69-openshift-service-ca\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:37.555694 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.555678    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12e1c485-33dd-42bc-9187-bc9361f16e69-maas-api-tls\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:37.565373 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.565347    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8wj4\" (UniqueName: \"kubernetes.io/projected/12e1c485-33dd-42bc-9187-bc9361f16e69-kube-api-access-q8wj4\") pod \"maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:37.582281 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.582244    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:37.751499 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:04:37.751469    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e1c485_33dd_42bc_9187_bc9361f16e69.slice/crio-0088f04209a0e332cfa06dd1cf4abd77924cf0a14398e8a171170dca718baced WatchSource:0}: Error finding container 0088f04209a0e332cfa06dd1cf4abd77924cf0a14398e8a171170dca718baced: Status 404 returned error can't find the container with id 0088f04209a0e332cfa06dd1cf4abd77924cf0a14398e8a171170dca718baced
Jul 09 14:04:37.752485 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.752454    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"]
Jul 09 14:04:37.753207 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:37.753188    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 14:04:38.271018 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:38.270983    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw" event={"ID":"12e1c485-33dd-42bc-9187-bc9361f16e69","Type":"ContainerStarted","Data":"0088f04209a0e332cfa06dd1cf4abd77924cf0a14398e8a171170dca718baced"}
Jul 09 14:04:39.278523 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:39.278479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw" event={"ID":"12e1c485-33dd-42bc-9187-bc9361f16e69","Type":"ContainerStarted","Data":"50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd"}
Jul 09 14:04:39.279024 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:39.278551    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:39.298266 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:39.298201    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw" podStartSLOduration=1.6073973110000002 podStartE2EDuration="2.298186268s" totalImagesPullingTime="690.788957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:39.296075288 +0000 UTC m=+2125.508065718" watchObservedRunningTime="2026-07-09 14:04:39.298186268 +0000 UTC m=+2125.510176683"
Jul 09 14:04:41.702434 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:41.702400    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:45.289954 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:45.289918    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:04:54.042237 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:54.042196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:04:54.793701 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:04:54.793644    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:05:11.340355 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:11.340236    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:05:19.734983 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:19.734944    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"]
Jul 09 14:05:19.736100 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:19.735213    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw" podUID="12e1c485-33dd-42bc-9187-bc9361f16e69" containerName="maas-api" containerID="cri-o://50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd" gracePeriod=30
Jul 09 14:05:19.993631 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:19.993565    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:05:20.068414 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.068382    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8wj4\" (UniqueName: \"kubernetes.io/projected/12e1c485-33dd-42bc-9187-bc9361f16e69-kube-api-access-q8wj4\") pod \"12e1c485-33dd-42bc-9187-bc9361f16e69\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") "
Jul 09 14:05:20.068576 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.068426    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12e1c485-33dd-42bc-9187-bc9361f16e69-maas-api-tls\") pod \"12e1c485-33dd-42bc-9187-bc9361f16e69\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") "
Jul 09 14:05:20.068576 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.068498    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e1c485-33dd-42bc-9187-bc9361f16e69-openshift-service-ca\") pod \"12e1c485-33dd-42bc-9187-bc9361f16e69\" (UID: \"12e1c485-33dd-42bc-9187-bc9361f16e69\") "
Jul 09 14:05:20.068902 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.068878    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12e1c485-33dd-42bc-9187-bc9361f16e69-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12e1c485-33dd-42bc-9187-bc9361f16e69" (UID: "12e1c485-33dd-42bc-9187-bc9361f16e69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:05:20.070561 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.070535    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12e1c485-33dd-42bc-9187-bc9361f16e69-kube-api-access-q8wj4" (OuterVolumeSpecName: "kube-api-access-q8wj4") pod "12e1c485-33dd-42bc-9187-bc9361f16e69" (UID: "12e1c485-33dd-42bc-9187-bc9361f16e69"). InnerVolumeSpecName "kube-api-access-q8wj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:05:20.070561 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.070539    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12e1c485-33dd-42bc-9187-bc9361f16e69-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12e1c485-33dd-42bc-9187-bc9361f16e69" (UID: "12e1c485-33dd-42bc-9187-bc9361f16e69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:05:20.169648 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.169608    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e1c485-33dd-42bc-9187-bc9361f16e69-openshift-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:05:20.169648 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.169641    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8wj4\" (UniqueName: \"kubernetes.io/projected/12e1c485-33dd-42bc-9187-bc9361f16e69-kube-api-access-q8wj4\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:05:20.169648 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.169653    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12e1c485-33dd-42bc-9187-bc9361f16e69-maas-api-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:05:20.238454 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.238424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:05:20.292567 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.292486    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:05:20.516391 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.516356    2583 generic.go:356] "Generic (PLEG): container finished" podID="12e1c485-33dd-42bc-9187-bc9361f16e69" containerID="50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd" exitCode=0
Jul 09 14:05:20.516578 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.516403    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"
Jul 09 14:05:20.516578 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.516440    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw" event={"ID":"12e1c485-33dd-42bc-9187-bc9361f16e69","Type":"ContainerDied","Data":"50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd"}
Jul 09 14:05:20.516578 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.516494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw" event={"ID":"12e1c485-33dd-42bc-9187-bc9361f16e69","Type":"ContainerDied","Data":"0088f04209a0e332cfa06dd1cf4abd77924cf0a14398e8a171170dca718baced"}
Jul 09 14:05:20.516578 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.516517    2583 scope.go:117] "RemoveContainer" containerID="50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd"
Jul 09 14:05:20.527410 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.527378    2583 scope.go:117] "RemoveContainer" containerID="50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd"
Jul 09 14:05:20.529642 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:05:20.529609    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd\": container with ID starting with 50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd not found: ID does not exist" containerID="50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd"
Jul 09 14:05:20.529838 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.529813    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd"} err="failed to get container status \"50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd\": rpc error: code = NotFound desc = could not find container \"50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd\": container with ID starting with 50b4274ac5bd26d1e8fc2778e064710dba8446c266329debea8ebbf64590b9cd not found: ID does not exist"
Jul 09 14:05:20.540326 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.540297    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"]
Jul 09 14:05:20.542640 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:20.542590    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-d43b1d-7f5c845-qs4fw"]
Jul 09 14:05:22.318895 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:22.318863    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12e1c485-33dd-42bc-9187-bc9361f16e69" path="/var/lib/kubelet/pods/12e1c485-33dd-42bc-9187-bc9361f16e69/volumes"
Jul 09 14:05:25.251241 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:05:25.251208    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:01.964322 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:01.964264    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:03.143483 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:03.143443    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:09.727846 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:09.727811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:09.803905 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:09.803867    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:10.032184 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:10.032093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:10.267154 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:10.267118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:11.297227 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:11.297195    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"]
Jul 09 14:06:11.313162 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:11.313137    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:12.303590 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:12.303556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:12.575654 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:12.575624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:12.951479 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:12.951381    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:13.133219 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.133184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:13.232322 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.232200    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:13.400351 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.400317    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"]
Jul 09 14:06:13.400811 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.400572    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd" podUID="c5e9a454-8258-4fa0-a28f-7a1005af58c1" containerName="maas-api" containerID="cri-o://a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8" gracePeriod=30
Jul 09 14:06:13.424439 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.424407    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:13.657637 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.657611    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:06:13.757545 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.757502    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5e9a454-8258-4fa0-a28f-7a1005af58c1-maas-api-tls\") pod \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") "
Jul 09 14:06:13.757545 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.757547    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5e9a454-8258-4fa0-a28f-7a1005af58c1-openshift-service-ca\") pod \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") "
Jul 09 14:06:13.757754 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.757596    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tw7v\" (UniqueName: \"kubernetes.io/projected/c5e9a454-8258-4fa0-a28f-7a1005af58c1-kube-api-access-5tw7v\") pod \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\" (UID: \"c5e9a454-8258-4fa0-a28f-7a1005af58c1\") "
Jul 09 14:06:13.758006 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.757977    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5e9a454-8258-4fa0-a28f-7a1005af58c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c5e9a454-8258-4fa0-a28f-7a1005af58c1" (UID: "c5e9a454-8258-4fa0-a28f-7a1005af58c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:06:13.759606 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.759576    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5e9a454-8258-4fa0-a28f-7a1005af58c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c5e9a454-8258-4fa0-a28f-7a1005af58c1" (UID: "c5e9a454-8258-4fa0-a28f-7a1005af58c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:06:13.759724 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.759627    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5e9a454-8258-4fa0-a28f-7a1005af58c1-kube-api-access-5tw7v" (OuterVolumeSpecName: "kube-api-access-5tw7v") pod "c5e9a454-8258-4fa0-a28f-7a1005af58c1" (UID: "c5e9a454-8258-4fa0-a28f-7a1005af58c1"). InnerVolumeSpecName "kube-api-access-5tw7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:06:13.819100 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.819045    2583 generic.go:356] "Generic (PLEG): container finished" podID="c5e9a454-8258-4fa0-a28f-7a1005af58c1" containerID="a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8" exitCode=0
Jul 09 14:06:13.819100 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.819082    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"
Jul 09 14:06:13.819362 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.819135    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd" event={"ID":"c5e9a454-8258-4fa0-a28f-7a1005af58c1","Type":"ContainerDied","Data":"a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8"}
Jul 09 14:06:13.819362 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.819193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd" event={"ID":"c5e9a454-8258-4fa0-a28f-7a1005af58c1","Type":"ContainerDied","Data":"ce602b182ca07299e7976c2a9907326552d909f595fa15199467c682dca265c4"}
Jul 09 14:06:13.819362 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.819221    2583 scope.go:117] "RemoveContainer" containerID="a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8"
Jul 09 14:06:13.829762 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.829744    2583 scope.go:117] "RemoveContainer" containerID="a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8"
Jul 09 14:06:13.830046 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:06:13.830028    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8\": container with ID starting with a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8 not found: ID does not exist" containerID="a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8"
Jul 09 14:06:13.830093 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.830058    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8"} err="failed to get container status \"a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8\": rpc error: code = NotFound desc = could not find container \"a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8\": container with ID starting with a3594515548757cefeba953ab3e09549fa89fa05df03b4cf45c347c7703a37a8 not found: ID does not exist"
Jul 09 14:06:13.848266 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.848238    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"]
Jul 09 14:06:13.855425 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.855398    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-440311-7cd5fb59f7-gzkfd"]
Jul 09 14:06:13.858804 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.858789    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tw7v\" (UniqueName: \"kubernetes.io/projected/c5e9a454-8258-4fa0-a28f-7a1005af58c1-kube-api-access-5tw7v\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:13.858860 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.858807    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5e9a454-8258-4fa0-a28f-7a1005af58c1-maas-api-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:13.858860 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:13.858819    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5e9a454-8258-4fa0-a28f-7a1005af58c1-openshift-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:14.317767 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:14.317735    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5e9a454-8258-4fa0-a28f-7a1005af58c1" path="/var/lib/kubelet/pods/c5e9a454-8258-4fa0-a28f-7a1005af58c1/volumes"
Jul 09 14:06:18.028267 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:18.028233    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:26.320248 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.320201    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j" podUID="af034814-a392-4047-a742-a92f4633490a" containerName="main" containerID="cri-o://f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf" gracePeriod=45
Jul 09 14:06:26.575392 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.575332    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:06:26.678152 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.678113    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-model-cache\") pod \"af034814-a392-4047-a742-a92f4633490a\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") "
Jul 09 14:06:26.678325 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.678166    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af034814-a392-4047-a742-a92f4633490a-tls-certs\") pod \"af034814-a392-4047-a742-a92f4633490a\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") "
Jul 09 14:06:26.678325 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.678201    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-tmp-dir\") pod \"af034814-a392-4047-a742-a92f4633490a\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") "
Jul 09 14:06:26.678325 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.678238    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hvmn\" (UniqueName: \"kubernetes.io/projected/af034814-a392-4047-a742-a92f4633490a-kube-api-access-7hvmn\") pod \"af034814-a392-4047-a742-a92f4633490a\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") "
Jul 09 14:06:26.678325 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.678258    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-home\") pod \"af034814-a392-4047-a742-a92f4633490a\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") "
Jul 09 14:06:26.678549 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.678345    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-dshm\") pod \"af034814-a392-4047-a742-a92f4633490a\" (UID: \"af034814-a392-4047-a742-a92f4633490a\") "
Jul 09 14:06:26.678549 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.678434    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-model-cache" (OuterVolumeSpecName: "model-cache") pod "af034814-a392-4047-a742-a92f4633490a" (UID: "af034814-a392-4047-a742-a92f4633490a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:06:26.678549 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.678540    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af034814-a392-4047-a742-a92f4633490a" (UID: "af034814-a392-4047-a742-a92f4633490a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:06:26.678704 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.678643    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-home" (OuterVolumeSpecName: "home") pod "af034814-a392-4047-a742-a92f4633490a" (UID: "af034814-a392-4047-a742-a92f4633490a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:06:26.678759 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.678741    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-tmp-dir\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:26.678813 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.678764    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-model-cache\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:26.680567 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.680542    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af034814-a392-4047-a742-a92f4633490a-kube-api-access-7hvmn" (OuterVolumeSpecName: "kube-api-access-7hvmn") pod "af034814-a392-4047-a742-a92f4633490a" (UID: "af034814-a392-4047-a742-a92f4633490a"). InnerVolumeSpecName "kube-api-access-7hvmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:06:26.680712 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.680572    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-dshm" (OuterVolumeSpecName: "dshm") pod "af034814-a392-4047-a742-a92f4633490a" (UID: "af034814-a392-4047-a742-a92f4633490a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:06:26.680712 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.680661    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af034814-a392-4047-a742-a92f4633490a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af034814-a392-4047-a742-a92f4633490a" (UID: "af034814-a392-4047-a742-a92f4633490a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:06:26.779991 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.779950    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hvmn\" (UniqueName: \"kubernetes.io/projected/af034814-a392-4047-a742-a92f4633490a-kube-api-access-7hvmn\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:26.779991 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.779985    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-home\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:26.779991 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.779995    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af034814-a392-4047-a742-a92f4633490a-dshm\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:26.779991 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.780003    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af034814-a392-4047-a742-a92f4633490a-tls-certs\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:26.893805 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.893718    2583 generic.go:356] "Generic (PLEG): container finished" podID="af034814-a392-4047-a742-a92f4633490a" containerID="f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf" exitCode=0
Jul 09 14:06:26.893805 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.893760    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"
Jul 09 14:06:26.893805 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.893783    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j" event={"ID":"af034814-a392-4047-a742-a92f4633490a","Type":"ContainerDied","Data":"f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf"}
Jul 09 14:06:26.894045 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.893821    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j" event={"ID":"af034814-a392-4047-a742-a92f4633490a","Type":"ContainerDied","Data":"1f0a1bc35bf7842f44df44927dce950b46e38a907706f6b8b35e76a3ab6e2ee0"}
Jul 09 14:06:26.894045 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.893842    2583 scope.go:117] "RemoveContainer" containerID="f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf"
Jul 09 14:06:26.903385 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.903364    2583 scope.go:117] "RemoveContainer" containerID="f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf"
Jul 09 14:06:26.903651 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:06:26.903632    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf\": container with ID starting with f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf not found: ID does not exist" containerID="f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf"
Jul 09 14:06:26.903716 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.903659    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf"} err="failed to get container status \"f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf\": rpc error: code = NotFound desc = could not find container \"f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf\": container with ID starting with f2ba02c53efa0f350014d47ac117f4638b97ac8daa147d51d320f795c50e3bdf not found: ID does not exist"
Jul 09 14:06:26.917799 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.917776    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"]
Jul 09 14:06:26.923615 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:26.923591    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j"]
Jul 09 14:06:28.316937 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:28.316901    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af034814-a392-4047-a742-a92f4633490a" path="/var/lib/kubelet/pods/af034814-a392-4047-a742-a92f4633490a/volumes"
Jul 09 14:06:31.552626 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:31.552582    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-a-440311/test-model-440311-kserve-5b5875475-qrk6j" podUID="af034814-a392-4047-a742-a92f4633490a" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Jul 09 14:06:38.977236 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:38.977159    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:41.963856 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:41.963796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:42.061363 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:42.061332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:55.738549 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:55.738513    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:56.006363 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:56.006269    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:56.241032 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:56.240994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:56.417277 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:56.417248    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:56.889265 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:56.889211    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:56.988605 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:56.988549    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:57.124366 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.124330    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"]
Jul 09 14:06:57.124643 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.124614    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm" podUID="178a0723-1b8e-4cab-9637-1c46ca2ad7fc" containerName="maas-api" containerID="cri-o://2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c" gracePeriod=30
Jul 09 14:06:57.144843 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.144819    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:06:57.369525 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.369495    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:06:57.437004 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.436910    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xddhp\" (UniqueName: \"kubernetes.io/projected/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-kube-api-access-xddhp\") pod \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") "
Jul 09 14:06:57.437004 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.436956    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-maas-api-tls\") pod \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") "
Jul 09 14:06:57.437236 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.437032    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-openshift-service-ca\") pod \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\" (UID: \"178a0723-1b8e-4cab-9637-1c46ca2ad7fc\") "
Jul 09 14:06:57.437441 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.437408    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "178a0723-1b8e-4cab-9637-1c46ca2ad7fc" (UID: "178a0723-1b8e-4cab-9637-1c46ca2ad7fc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:06:57.439043 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.439018    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "178a0723-1b8e-4cab-9637-1c46ca2ad7fc" (UID: "178a0723-1b8e-4cab-9637-1c46ca2ad7fc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:06:57.439135 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.439080    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-kube-api-access-xddhp" (OuterVolumeSpecName: "kube-api-access-xddhp") pod "178a0723-1b8e-4cab-9637-1c46ca2ad7fc" (UID: "178a0723-1b8e-4cab-9637-1c46ca2ad7fc"). InnerVolumeSpecName "kube-api-access-xddhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:06:57.537657 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.537623    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-openshift-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:57.537657 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.537650    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xddhp\" (UniqueName: \"kubernetes.io/projected/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-kube-api-access-xddhp\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:57.537657 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:57.537661    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/178a0723-1b8e-4cab-9637-1c46ca2ad7fc-maas-api-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:06:58.066912 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:58.066868    2583 generic.go:356] "Generic (PLEG): container finished" podID="178a0723-1b8e-4cab-9637-1c46ca2ad7fc" containerID="2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c" exitCode=0
Jul 09 14:06:58.066912 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:58.066913    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"
Jul 09 14:06:58.067472 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:58.066955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm" event={"ID":"178a0723-1b8e-4cab-9637-1c46ca2ad7fc","Type":"ContainerDied","Data":"2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c"}
Jul 09 14:06:58.067472 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:58.067010    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm" event={"ID":"178a0723-1b8e-4cab-9637-1c46ca2ad7fc","Type":"ContainerDied","Data":"2e9c4467f09b94db2f80615caa838642eb4b4d039b562fb3f6c7b1d9a9078576"}
Jul 09 14:06:58.067472 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:58.067026    2583 scope.go:117] "RemoveContainer" containerID="2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c"
Jul 09 14:06:58.077046 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:58.077025    2583 scope.go:117] "RemoveContainer" containerID="2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c"
Jul 09 14:06:58.077333 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:06:58.077316    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c\": container with ID starting with 2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c not found: ID does not exist" containerID="2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c"
Jul 09 14:06:58.077389 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:58.077339    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c"} err="failed to get container status \"2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c\": rpc error: code = NotFound desc = could not find container \"2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c\": container with ID starting with 2b7e8b261aeeaf071c4806c77904d01403f555d52942ede2386fcfb7eac1726c not found: ID does not exist"
Jul 09 14:06:58.089943 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:58.089916    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"]
Jul 09 14:06:58.094911 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:58.094889    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-505c59-7c6f6cd648-mp6tm"]
Jul 09 14:06:58.318243 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:06:58.318155    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="178a0723-1b8e-4cab-9637-1c46ca2ad7fc" path="/var/lib/kubelet/pods/178a0723-1b8e-4cab-9637-1c46ca2ad7fc/volumes"
Jul 09 14:07:03.364454 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:03.364417    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:03.427476 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:03.427449    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:03.636605 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:03.636518    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:03.856221 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:03.856188    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:04.191234 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:04.191201    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:04.520342 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:04.520240    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:04.887633 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:04.887598    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:07.644353 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.644318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:07.737266 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.737229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:07.882987 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.882956    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"]
Jul 09 14:07:07.883431 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883418    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="178a0723-1b8e-4cab-9637-1c46ca2ad7fc" containerName="maas-api"
Jul 09 14:07:07.883495 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883433    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="178a0723-1b8e-4cab-9637-1c46ca2ad7fc" containerName="maas-api"
Jul 09 14:07:07.883495 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883449    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e9a454-8258-4fa0-a28f-7a1005af58c1" containerName="maas-api"
Jul 09 14:07:07.883495 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883454    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e9a454-8258-4fa0-a28f-7a1005af58c1" containerName="maas-api"
Jul 09 14:07:07.883495 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883470    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af034814-a392-4047-a742-a92f4633490a" containerName="main"
Jul 09 14:07:07.883495 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883475    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="af034814-a392-4047-a742-a92f4633490a" containerName="main"
Jul 09 14:07:07.883495 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883482    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e1c485-33dd-42bc-9187-bc9361f16e69" containerName="maas-api"
Jul 09 14:07:07.883495 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883486    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e1c485-33dd-42bc-9187-bc9361f16e69" containerName="maas-api"
Jul 09 14:07:07.883741 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883549    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5e9a454-8258-4fa0-a28f-7a1005af58c1" containerName="maas-api"
Jul 09 14:07:07.883741 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883557    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="178a0723-1b8e-4cab-9637-1c46ca2ad7fc" containerName="maas-api"
Jul 09 14:07:07.883741 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883562    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e1c485-33dd-42bc-9187-bc9361f16e69" containerName="maas-api"
Jul 09 14:07:07.883741 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.883568    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="af034814-a392-4047-a742-a92f4633490a" containerName="main"
Jul 09 14:07:07.888042 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.888021    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:07.890547 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.890525    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-5c1b98-serving-cert\""
Jul 09 14:07:07.899134 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.899111    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"]
Jul 09 14:07:07.916601 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.916570    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:07.924872 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.924843    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ae8776-1261-4f80-9751-30b7d00a4086-openshift-service-ca\") pod \"maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:07.924994 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.924908    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95ae8776-1261-4f80-9751-30b7d00a4086-maas-api-tls\") pod \"maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:07.924994 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:07.924942    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5lmx\" (UniqueName: \"kubernetes.io/projected/95ae8776-1261-4f80-9751-30b7d00a4086-kube-api-access-v5lmx\") pod \"maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:08.026068 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:08.026031    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95ae8776-1261-4f80-9751-30b7d00a4086-maas-api-tls\") pod \"maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:08.026068 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:08.026072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5lmx\" (UniqueName: \"kubernetes.io/projected/95ae8776-1261-4f80-9751-30b7d00a4086-kube-api-access-v5lmx\") pod \"maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:08.026332 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:08.026133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ae8776-1261-4f80-9751-30b7d00a4086-openshift-service-ca\") pod \"maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:08.026804 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:08.026782    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ae8776-1261-4f80-9751-30b7d00a4086-openshift-service-ca\") pod \"maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:08.028559 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:08.028539    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95ae8776-1261-4f80-9751-30b7d00a4086-maas-api-tls\") pod \"maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:08.037986 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:08.037957    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5lmx\" (UniqueName: \"kubernetes.io/projected/95ae8776-1261-4f80-9751-30b7d00a4086-kube-api-access-v5lmx\") pod \"maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:08.058990 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:08.058963    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:08.200192 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:08.200106    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:08.347163 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:08.347042    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"]
Jul 09 14:07:08.350130 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:07:08.350105    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ae8776_1261_4f80_9751_30b7d00a4086.slice/crio-1aa2fb34bccb00acfd23c2a7b739fc3e74e07bf1ff219e140e8ec82f5a3477d7 WatchSource:0}: Error finding container 1aa2fb34bccb00acfd23c2a7b739fc3e74e07bf1ff219e140e8ec82f5a3477d7: Status 404 returned error can't find the container with id 1aa2fb34bccb00acfd23c2a7b739fc3e74e07bf1ff219e140e8ec82f5a3477d7
Jul 09 14:07:08.371192 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:08.371165    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:08.471139 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:08.471052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:09.132051 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:09.131959    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q" event={"ID":"95ae8776-1261-4f80-9751-30b7d00a4086","Type":"ContainerStarted","Data":"ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e"}
Jul 09 14:07:09.132051 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:09.132023    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q" event={"ID":"95ae8776-1261-4f80-9751-30b7d00a4086","Type":"ContainerStarted","Data":"1aa2fb34bccb00acfd23c2a7b739fc3e74e07bf1ff219e140e8ec82f5a3477d7"}
Jul 09 14:07:09.132492 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:09.132080    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:09.154646 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:09.154588    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q" podStartSLOduration=1.666319809 podStartE2EDuration="2.15457026s" totalImagesPullingTime="488.250451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:07:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:07:09.151770833 +0000 UTC m=+2275.363761248" watchObservedRunningTime="2026-07-09 14:07:09.15457026 +0000 UTC m=+2275.366560676"
Jul 09 14:07:12.050641 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:12.050605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:12.523595 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:12.523556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:12.849253 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:12.849215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:12.950369 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:12.950334    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:15.143439 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:15.143408    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:15.574094 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:15.574063    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:15.656832 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:15.656793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:15.722439 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:15.722401    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:16.068881 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:16.068848    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:16.188485 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:16.188451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:17.142523 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:17.142494    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:20.073275 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:20.073241    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:30.175023 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:30.174977    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:30.278041 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:30.278006    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:33.497720 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:33.497684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:33.844303 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:33.844260    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:33.876564 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:33.876522    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"]
Jul 09 14:07:33.878158 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:33.876770    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q" podUID="95ae8776-1261-4f80-9751-30b7d00a4086" containerName="maas-api" containerID="cri-o://ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e" gracePeriod=30
Jul 09 14:07:33.904679 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:33.904651    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:34.138235 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.138202    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:34.268415 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.268376    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95ae8776-1261-4f80-9751-30b7d00a4086-maas-api-tls\") pod \"95ae8776-1261-4f80-9751-30b7d00a4086\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") "
Jul 09 14:07:34.268589 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.268488    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ae8776-1261-4f80-9751-30b7d00a4086-openshift-service-ca\") pod \"95ae8776-1261-4f80-9751-30b7d00a4086\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") "
Jul 09 14:07:34.268589 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.268545    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5lmx\" (UniqueName: \"kubernetes.io/projected/95ae8776-1261-4f80-9751-30b7d00a4086-kube-api-access-v5lmx\") pod \"95ae8776-1261-4f80-9751-30b7d00a4086\" (UID: \"95ae8776-1261-4f80-9751-30b7d00a4086\") "
Jul 09 14:07:34.268866 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.268841    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95ae8776-1261-4f80-9751-30b7d00a4086-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95ae8776-1261-4f80-9751-30b7d00a4086" (UID: "95ae8776-1261-4f80-9751-30b7d00a4086"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:07:34.270655 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.270623    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95ae8776-1261-4f80-9751-30b7d00a4086-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95ae8776-1261-4f80-9751-30b7d00a4086" (UID: "95ae8776-1261-4f80-9751-30b7d00a4086"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:07:34.270756 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.270693    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ae8776-1261-4f80-9751-30b7d00a4086-kube-api-access-v5lmx" (OuterVolumeSpecName: "kube-api-access-v5lmx") pod "95ae8776-1261-4f80-9751-30b7d00a4086" (UID: "95ae8776-1261-4f80-9751-30b7d00a4086"). InnerVolumeSpecName "kube-api-access-v5lmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:07:34.276773 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.276742    2583 generic.go:356] "Generic (PLEG): container finished" podID="95ae8776-1261-4f80-9751-30b7d00a4086" containerID="ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e" exitCode=0
Jul 09 14:07:34.276871 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.276800    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"
Jul 09 14:07:34.276871 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.276829    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q" event={"ID":"95ae8776-1261-4f80-9751-30b7d00a4086","Type":"ContainerDied","Data":"ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e"}
Jul 09 14:07:34.276986 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.276889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q" event={"ID":"95ae8776-1261-4f80-9751-30b7d00a4086","Type":"ContainerDied","Data":"1aa2fb34bccb00acfd23c2a7b739fc3e74e07bf1ff219e140e8ec82f5a3477d7"}
Jul 09 14:07:34.276986 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.276919    2583 scope.go:117] "RemoveContainer" containerID="ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e"
Jul 09 14:07:34.286468 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.286449    2583 scope.go:117] "RemoveContainer" containerID="ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e"
Jul 09 14:07:34.286732 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:07:34.286713    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e\": container with ID starting with ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e not found: ID does not exist" containerID="ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e"
Jul 09 14:07:34.286774 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.286739    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e"} err="failed to get container status \"ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e\": rpc error: code = NotFound desc = could not find container \"ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e\": container with ID starting with ce1fd01a018d434eacbab52f8afa48d593b6604f537aed0a48e25981b67ce70e not found: ID does not exist"
Jul 09 14:07:34.300545 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.300519    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"]
Jul 09 14:07:34.304218 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.304197    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5c1b98-df4bd68c7-pw22q"]
Jul 09 14:07:34.317005 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.316974    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95ae8776-1261-4f80-9751-30b7d00a4086" path="/var/lib/kubelet/pods/95ae8776-1261-4f80-9751-30b7d00a4086/volumes"
Jul 09 14:07:34.369709 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.369627    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95ae8776-1261-4f80-9751-30b7d00a4086-maas-api-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:07:34.369709 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.369682    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ae8776-1261-4f80-9751-30b7d00a4086-openshift-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:07:34.369709 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:34.369697    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5lmx\" (UniqueName: \"kubernetes.io/projected/95ae8776-1261-4f80-9751-30b7d00a4086-kube-api-access-v5lmx\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:07:36.985665 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:36.985626    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:37.085454 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:37.085416    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:40.089436 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:40.089401    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:40.193614 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:40.193583    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:40.366940 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:40.366842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:40.578144 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:40.578109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:40.872170 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:40.872125    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:41.234924 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:41.234807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:41.337560 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:41.337525    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:47.833788 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:47.833755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:47.933226 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:47.933193    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:48.107237 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:48.107155    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:48.332471 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:48.332434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:48.664764 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:48.664734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:48.973549 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:48.973469    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:49.163915 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:49.163882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:51.825538 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:51.825478    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:51.937113 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:51.937078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:52.024161 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:52.024124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:52.569303 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:52.569259    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:52.670149 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:52.670112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:52.769251 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:52.769215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:56.345204 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:56.345141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:56.692740 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:56.692642    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:57.019598 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:57.019523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:57.199047 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:57.199011    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:59.841461 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.841427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:59.916980 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.916941    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:59.918187 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.918157    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"]
Jul 09 14:07:59.918742 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.918722    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95ae8776-1261-4f80-9751-30b7d00a4086" containerName="maas-api"
Jul 09 14:07:59.918742 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.918744    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="95ae8776-1261-4f80-9751-30b7d00a4086" containerName="maas-api"
Jul 09 14:07:59.918898 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.918829    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="95ae8776-1261-4f80-9751-30b7d00a4086" containerName="maas-api"
Jul 09 14:07:59.921826 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.921810    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:07:59.924736 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.924719    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-6ee5b0-serving-cert\""
Jul 09 14:07:59.935330 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.935310    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"]
Jul 09 14:07:59.986347 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.986314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:07:59.995525 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.995504    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c336b2b-6161-4ef5-bb48-351d33c8bb91-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:07:59.995602 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.995533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjqfm\" (UniqueName: \"kubernetes.io/projected/5c336b2b-6161-4ef5-bb48-351d33c8bb91-kube-api-access-gjqfm\") pod \"maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:07:59.995602 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:07:59.995559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c336b2b-6161-4ef5-bb48-351d33c8bb91-maas-api-tls\") pod \"maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:08:00.096219 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:00.096130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c336b2b-6161-4ef5-bb48-351d33c8bb91-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:08:00.096219 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:00.096172    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjqfm\" (UniqueName: \"kubernetes.io/projected/5c336b2b-6161-4ef5-bb48-351d33c8bb91-kube-api-access-gjqfm\") pod \"maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:08:00.096481 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:00.096222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c336b2b-6161-4ef5-bb48-351d33c8bb91-maas-api-tls\") pod \"maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:08:00.096481 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:08:00.096365    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-serving-cert: secret "maas-api-e2e-shared-b-6ee5b0-serving-cert" not found
Jul 09 14:08:00.096481 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:08:00.096432    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c336b2b-6161-4ef5-bb48-351d33c8bb91-maas-api-tls podName:5c336b2b-6161-4ef5-bb48-351d33c8bb91 nodeName:}" failed. No retries permitted until 2026-07-09 14:08:00.596415107 +0000 UTC m=+2326.808405520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5c336b2b-6161-4ef5-bb48-351d33c8bb91-maas-api-tls") pod "maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57" (UID: "5c336b2b-6161-4ef5-bb48-351d33c8bb91") : secret "maas-api-e2e-shared-b-6ee5b0-serving-cert" not found
Jul 09 14:08:00.096935 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:00.096909    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c336b2b-6161-4ef5-bb48-351d33c8bb91-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:08:00.114474 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:00.114436    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjqfm\" (UniqueName: \"kubernetes.io/projected/5c336b2b-6161-4ef5-bb48-351d33c8bb91-kube-api-access-gjqfm\") pod \"maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:08:00.236757 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:00.236721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:08:00.601407 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:00.601378    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c336b2b-6161-4ef5-bb48-351d33c8bb91-maas-api-tls\") pod \"maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:08:00.603866 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:00.603836    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c336b2b-6161-4ef5-bb48-351d33c8bb91-maas-api-tls\") pod \"maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:08:00.617358 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:00.617332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:08:00.711843 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:00.711804    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:08:00.834665 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:00.834633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:08:01.188964 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:01.188916    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"]
Jul 09 14:08:01.191439 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:08:01.191409    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c336b2b_6161_4ef5_bb48_351d33c8bb91.slice/crio-bd1e2caef4a6cb840724894365060fcc89fb03d0abdb313075aad56dedcf846c WatchSource:0}: Error finding container bd1e2caef4a6cb840724894365060fcc89fb03d0abdb313075aad56dedcf846c: Status 404 returned error can't find the container with id bd1e2caef4a6cb840724894365060fcc89fb03d0abdb313075aad56dedcf846c
Jul 09 14:08:01.435307 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:01.435254    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57" event={"ID":"5c336b2b-6161-4ef5-bb48-351d33c8bb91","Type":"ContainerStarted","Data":"bd1e2caef4a6cb840724894365060fcc89fb03d0abdb313075aad56dedcf846c"}
Jul 09 14:08:03.449241 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:03.449201    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57" event={"ID":"5c336b2b-6161-4ef5-bb48-351d33c8bb91","Type":"ContainerStarted","Data":"1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460"}
Jul 09 14:08:03.449723 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:03.449328    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:08:03.476279 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:03.476229    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57" podStartSLOduration=3.077558575 podStartE2EDuration="4.476213934s" totalImagesPullingTime="1.398655359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:07:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:08:03.475498409 +0000 UTC m=+2329.687488826" watchObservedRunningTime="2026-07-09 14:08:03.476213934 +0000 UTC m=+2329.688204349"
Jul 09 14:08:04.370553 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:04.370516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:08:09.460445 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:09.460362    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:08:13.283151 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.283114    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"]
Jul 09 14:08:13.287243 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.287226    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.291805 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.291784    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"auth-test-model-06548f-kserve-self-signed-certs\""
Jul 09 14:08:13.291933 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.291861    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"openshift-service-ca.crt\""
Jul 09 14:08:13.291933 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.291871    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"default-dockercfg-7dlfq\""
Jul 09 14:08:13.291933 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.291868    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"kube-root-ca.crt\""
Jul 09 14:08:13.296941 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.296922    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"]
Jul 09 14:08:13.302806 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.302781    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:08:13.420034 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.419994    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-model-cache\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.420259 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.420074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cccbb533-7015-47e5-b53f-53d4febf7353-tls-certs\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.420259 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.420104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-tmp-dir\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.420259 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.420162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-dshm\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.420443 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.420318    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-home\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.420443 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.420384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2qcq\" (UniqueName: \"kubernetes.io/projected/cccbb533-7015-47e5-b53f-53d4febf7353-kube-api-access-b2qcq\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.521583 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.521552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-home\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.521752 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.521600    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2qcq\" (UniqueName: \"kubernetes.io/projected/cccbb533-7015-47e5-b53f-53d4febf7353-kube-api-access-b2qcq\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.521752 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.521651    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-model-cache\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.521752 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.521679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cccbb533-7015-47e5-b53f-53d4febf7353-tls-certs\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.521752 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.521703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-tmp-dir\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.521976 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.521833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-dshm\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.522035 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.521988    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-home\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.522035 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.522002    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-model-cache\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.522128 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.522096    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-tmp-dir\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.524034 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.524011    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-dshm\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.524142 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.524125    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cccbb533-7015-47e5-b53f-53d4febf7353-tls-certs\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.532430 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.532404    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2qcq\" (UniqueName: \"kubernetes.io/projected/cccbb533-7015-47e5-b53f-53d4febf7353-kube-api-access-b2qcq\") pod \"auth-test-model-06548f-kserve-5c4b889655-dv7fh\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") " pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.597550 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.597513    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:13.716516 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.716484    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:08:13.750149 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.750125    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"]
Jul 09 14:08:13.751963 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:08:13.751934    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcccbb533_7015_47e5_b53f_53d4febf7353.slice/crio-0e3d8edbbaff8a8f1f1da7a11bd5935f6f44754bb4497b67fb4721954436caeb WatchSource:0}: Error finding container 0e3d8edbbaff8a8f1f1da7a11bd5935f6f44754bb4497b67fb4721954436caeb: Status 404 returned error can't find the container with id 0e3d8edbbaff8a8f1f1da7a11bd5935f6f44754bb4497b67fb4721954436caeb
Jul 09 14:08:13.817993 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:13.817957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:08:14.514459 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:14.514410    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh" event={"ID":"cccbb533-7015-47e5-b53f-53d4febf7353","Type":"ContainerStarted","Data":"ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586"}
Jul 09 14:08:14.514459 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:14.514464    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh" event={"ID":"cccbb533-7015-47e5-b53f-53d4febf7353","Type":"ContainerStarted","Data":"0e3d8edbbaff8a8f1f1da7a11bd5935f6f44754bb4497b67fb4721954436caeb"}
Jul 09 14:08:14.535213 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:14.535163    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh" podStartSLOduration=1.5351484100000001 podStartE2EDuration="1.53514841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:08:14.532750942 +0000 UTC m=+2340.744741381" watchObservedRunningTime="2026-07-09 14:08:14.53514841 +0000 UTC m=+2340.747138825"
Jul 09 14:08:21.574769 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:21.574727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:08:22.857694 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:22.857652    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:08:23.598046 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:23.598008    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:23.598231 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:23.598062    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:23.612481 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:23.612454    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:24.581701 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:24.581674    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:08:32.688270 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.688232    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"]
Jul 09 14:08:32.691797 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.691779    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.695380 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.695357    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"kube-root-ca.crt\""
Jul 09 14:08:32.695502 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.695357    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"default-dockercfg-gdnkn\""
Jul 09 14:08:32.695502 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.695381    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"auth-test-model-6ee5b0-kserve-self-signed-certs\""
Jul 09 14:08:32.695502 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.695413    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"openshift-service-ca.crt\""
Jul 09 14:08:32.702946 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.702921    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"]
Jul 09 14:08:32.726069 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.726031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:08:32.801961 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.801929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-home\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.802130 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.801979    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmrdw\" (UniqueName: \"kubernetes.io/projected/3852c803-90e6-412b-bdc9-4dc743ca461b-kube-api-access-gmrdw\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.802130 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.802005    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3852c803-90e6-412b-bdc9-4dc743ca461b-tls-certs\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.802130 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.802091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-dshm\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.802130 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.802126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-tmp-dir\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.802340 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.802171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-model-cache\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.903375 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.903337    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-home\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.903567 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.903399    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmrdw\" (UniqueName: \"kubernetes.io/projected/3852c803-90e6-412b-bdc9-4dc743ca461b-kube-api-access-gmrdw\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.903567 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.903434    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3852c803-90e6-412b-bdc9-4dc743ca461b-tls-certs\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.903567 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.903468    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-dshm\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.903567 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.903497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-tmp-dir\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.903567 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.903532    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-model-cache\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.903835 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.903796    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-home\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.903966 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.903943    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-tmp-dir\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.903966 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.903959    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-model-cache\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.905767 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.905742    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-dshm\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.905988 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.905968    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3852c803-90e6-412b-bdc9-4dc743ca461b-tls-certs\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:32.913314 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:32.913274    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmrdw\" (UniqueName: \"kubernetes.io/projected/3852c803-90e6-412b-bdc9-4dc743ca461b-kube-api-access-gmrdw\") pod \"auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") " pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:33.002498 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:33.002394    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:33.148839 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:33.148810    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"]
Jul 09 14:08:33.150416 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:08:33.150386    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3852c803_90e6_412b_bdc9_4dc743ca461b.slice/crio-81724ffb30a037788d6aacaf9ab4bd8605c4eaa41d3d8a55a257930aac2b3c59 WatchSource:0}: Error finding container 81724ffb30a037788d6aacaf9ab4bd8605c4eaa41d3d8a55a257930aac2b3c59: Status 404 returned error can't find the container with id 81724ffb30a037788d6aacaf9ab4bd8605c4eaa41d3d8a55a257930aac2b3c59
Jul 09 14:08:33.621213 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:33.621182    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq" event={"ID":"3852c803-90e6-412b-bdc9-4dc743ca461b","Type":"ContainerStarted","Data":"6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c"}
Jul 09 14:08:33.621398 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:33.621222    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq" event={"ID":"3852c803-90e6-412b-bdc9-4dc743ca461b","Type":"ContainerStarted","Data":"81724ffb30a037788d6aacaf9ab4bd8605c4eaa41d3d8a55a257930aac2b3c59"}
Jul 09 14:08:33.651334 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:33.651267    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq" podStartSLOduration=1.651251933 podStartE2EDuration="1.651251933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:08:33.649715833 +0000 UTC m=+2359.861706249" watchObservedRunningTime="2026-07-09 14:08:33.651251933 +0000 UTC m=+2359.863242348"
Jul 09 14:08:43.003149 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:43.003102    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:43.003149 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:43.003154    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:43.015879 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:43.015855    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:08:43.687309 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:08:43.687255    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:09:14.481385 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:09:14.481272    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 14:09:14.492257 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:09:14.492233    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 14:09:45.975973 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:09:45.975883    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:09:46.076768 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:09:46.076724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:10:08.861509 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:10:08.861474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:10:08.962042 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:10:08.962002    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:10:57.039561 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:10:57.039527    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"]
Jul 09 14:10:57.057800 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:10:57.057774    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:10:57.983084 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:10:57.983053    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"]
Jul 09 14:10:58.021275 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:10:58.021242    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:10:59.554507 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:10:59.554463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:11:12.059732 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.059665    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh" podUID="cccbb533-7015-47e5-b53f-53d4febf7353" containerName="main" containerID="cri-o://ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586" gracePeriod=45
Jul 09 14:11:12.318599 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.318573    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:11:12.425827 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.425796    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-home\") pod \"cccbb533-7015-47e5-b53f-53d4febf7353\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") "
Jul 09 14:11:12.425827 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.425832    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-dshm\") pod \"cccbb533-7015-47e5-b53f-53d4febf7353\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") "
Jul 09 14:11:12.426079 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.425853    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-tmp-dir\") pod \"cccbb533-7015-47e5-b53f-53d4febf7353\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") "
Jul 09 14:11:12.426079 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.425879    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2qcq\" (UniqueName: \"kubernetes.io/projected/cccbb533-7015-47e5-b53f-53d4febf7353-kube-api-access-b2qcq\") pod \"cccbb533-7015-47e5-b53f-53d4febf7353\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") "
Jul 09 14:11:12.426079 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.425922    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cccbb533-7015-47e5-b53f-53d4febf7353-tls-certs\") pod \"cccbb533-7015-47e5-b53f-53d4febf7353\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") "
Jul 09 14:11:12.426079 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.425976    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-model-cache\") pod \"cccbb533-7015-47e5-b53f-53d4febf7353\" (UID: \"cccbb533-7015-47e5-b53f-53d4febf7353\") "
Jul 09 14:11:12.426079 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.426060    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cccbb533-7015-47e5-b53f-53d4febf7353" (UID: "cccbb533-7015-47e5-b53f-53d4febf7353"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:11:12.426443 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.426078    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-home" (OuterVolumeSpecName: "home") pod "cccbb533-7015-47e5-b53f-53d4febf7353" (UID: "cccbb533-7015-47e5-b53f-53d4febf7353"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:11:12.426443 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.426389    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-home\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:12.426443 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.426411    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-tmp-dir\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:12.426572 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.426505    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-model-cache" (OuterVolumeSpecName: "model-cache") pod "cccbb533-7015-47e5-b53f-53d4febf7353" (UID: "cccbb533-7015-47e5-b53f-53d4febf7353"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:11:12.428378 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.428352    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cccbb533-7015-47e5-b53f-53d4febf7353-kube-api-access-b2qcq" (OuterVolumeSpecName: "kube-api-access-b2qcq") pod "cccbb533-7015-47e5-b53f-53d4febf7353" (UID: "cccbb533-7015-47e5-b53f-53d4febf7353"). InnerVolumeSpecName "kube-api-access-b2qcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:11:12.428532 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.428510    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cccbb533-7015-47e5-b53f-53d4febf7353-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cccbb533-7015-47e5-b53f-53d4febf7353" (UID: "cccbb533-7015-47e5-b53f-53d4febf7353"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:11:12.428586 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.428515    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-dshm" (OuterVolumeSpecName: "dshm") pod "cccbb533-7015-47e5-b53f-53d4febf7353" (UID: "cccbb533-7015-47e5-b53f-53d4febf7353"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:11:12.527469 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.527439    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-dshm\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:12.527469 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.527467    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2qcq\" (UniqueName: \"kubernetes.io/projected/cccbb533-7015-47e5-b53f-53d4febf7353-kube-api-access-b2qcq\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:12.527664 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.527477    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cccbb533-7015-47e5-b53f-53d4febf7353-tls-certs\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:12.527664 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.527487    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cccbb533-7015-47e5-b53f-53d4febf7353-model-cache\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:12.534346 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.534315    2583 generic.go:356] "Generic (PLEG): container finished" podID="cccbb533-7015-47e5-b53f-53d4febf7353" containerID="ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586" exitCode=0
Jul 09 14:11:12.534493 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.534359    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"
Jul 09 14:11:12.534493 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.534408    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh" event={"ID":"cccbb533-7015-47e5-b53f-53d4febf7353","Type":"ContainerDied","Data":"ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586"}
Jul 09 14:11:12.534493 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.534453    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh" event={"ID":"cccbb533-7015-47e5-b53f-53d4febf7353","Type":"ContainerDied","Data":"0e3d8edbbaff8a8f1f1da7a11bd5935f6f44754bb4497b67fb4721954436caeb"}
Jul 09 14:11:12.534493 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.534476    2583 scope.go:117] "RemoveContainer" containerID="ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586"
Jul 09 14:11:12.544798 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.544781    2583 scope.go:117] "RemoveContainer" containerID="ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586"
Jul 09 14:11:12.545073 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:11:12.545056    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586\": container with ID starting with ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586 not found: ID does not exist" containerID="ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586"
Jul 09 14:11:12.545153 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.545079    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586"} err="failed to get container status \"ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586\": rpc error: code = NotFound desc = could not find container \"ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586\": container with ID starting with ff7c515044b9a8c3e147c44d96ecb7bdc86e3b933e238051f773d511d000a586 not found: ID does not exist"
Jul 09 14:11:12.564590 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.564561    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"]
Jul 09 14:11:12.568913 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:12.568851    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/auth-test-model-06548f-kserve-5c4b889655-dv7fh"]
Jul 09 14:11:13.003469 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.003365    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq" podUID="3852c803-90e6-412b-bdc9-4dc743ca461b" containerName="main" containerID="cri-o://6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c" gracePeriod=45
Jul 09 14:11:13.273082 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.273054    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:11:13.434420 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.434387    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-model-cache\") pod \"3852c803-90e6-412b-bdc9-4dc743ca461b\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") "
Jul 09 14:11:13.434614 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.434458    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-home\") pod \"3852c803-90e6-412b-bdc9-4dc743ca461b\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") "
Jul 09 14:11:13.434614 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.434489    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3852c803-90e6-412b-bdc9-4dc743ca461b-tls-certs\") pod \"3852c803-90e6-412b-bdc9-4dc743ca461b\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") "
Jul 09 14:11:13.434614 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.434508    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-dshm\") pod \"3852c803-90e6-412b-bdc9-4dc743ca461b\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") "
Jul 09 14:11:13.434614 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.434577    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmrdw\" (UniqueName: \"kubernetes.io/projected/3852c803-90e6-412b-bdc9-4dc743ca461b-kube-api-access-gmrdw\") pod \"3852c803-90e6-412b-bdc9-4dc743ca461b\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") "
Jul 09 14:11:13.434826 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.434626    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-tmp-dir\") pod \"3852c803-90e6-412b-bdc9-4dc743ca461b\" (UID: \"3852c803-90e6-412b-bdc9-4dc743ca461b\") "
Jul 09 14:11:13.434826 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.434705    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-model-cache" (OuterVolumeSpecName: "model-cache") pod "3852c803-90e6-412b-bdc9-4dc743ca461b" (UID: "3852c803-90e6-412b-bdc9-4dc743ca461b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:11:13.434826 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.434728    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-home" (OuterVolumeSpecName: "home") pod "3852c803-90e6-412b-bdc9-4dc743ca461b" (UID: "3852c803-90e6-412b-bdc9-4dc743ca461b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:11:13.434980 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.434896    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3852c803-90e6-412b-bdc9-4dc743ca461b" (UID: "3852c803-90e6-412b-bdc9-4dc743ca461b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:11:13.435075 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.435053    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-tmp-dir\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:13.435143 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.435080    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-model-cache\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:13.435143 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.435093    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-home\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:13.436946 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.436914    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-dshm" (OuterVolumeSpecName: "dshm") pod "3852c803-90e6-412b-bdc9-4dc743ca461b" (UID: "3852c803-90e6-412b-bdc9-4dc743ca461b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:11:13.437126 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.437106    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3852c803-90e6-412b-bdc9-4dc743ca461b-kube-api-access-gmrdw" (OuterVolumeSpecName: "kube-api-access-gmrdw") pod "3852c803-90e6-412b-bdc9-4dc743ca461b" (UID: "3852c803-90e6-412b-bdc9-4dc743ca461b"). InnerVolumeSpecName "kube-api-access-gmrdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:11:13.437201 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.437110    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3852c803-90e6-412b-bdc9-4dc743ca461b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3852c803-90e6-412b-bdc9-4dc743ca461b" (UID: "3852c803-90e6-412b-bdc9-4dc743ca461b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:11:13.535814 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.535721    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3852c803-90e6-412b-bdc9-4dc743ca461b-tls-certs\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:13.535814 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.535752    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3852c803-90e6-412b-bdc9-4dc743ca461b-dshm\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:13.535814 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.535761    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmrdw\" (UniqueName: \"kubernetes.io/projected/3852c803-90e6-412b-bdc9-4dc743ca461b-kube-api-access-gmrdw\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:11:13.542819 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.542787    2583 generic.go:356] "Generic (PLEG): container finished" podID="3852c803-90e6-412b-bdc9-4dc743ca461b" containerID="6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c" exitCode=0
Jul 09 14:11:13.542981 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.542826    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"
Jul 09 14:11:13.542981 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.542847    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq" event={"ID":"3852c803-90e6-412b-bdc9-4dc743ca461b","Type":"ContainerDied","Data":"6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c"}
Jul 09 14:11:13.542981 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.542876    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq" event={"ID":"3852c803-90e6-412b-bdc9-4dc743ca461b","Type":"ContainerDied","Data":"81724ffb30a037788d6aacaf9ab4bd8605c4eaa41d3d8a55a257930aac2b3c59"}
Jul 09 14:11:13.542981 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.542892    2583 scope.go:117] "RemoveContainer" containerID="6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c"
Jul 09 14:11:13.552646 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.552622    2583 scope.go:117] "RemoveContainer" containerID="6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c"
Jul 09 14:11:13.552883 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:11:13.552865    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c\": container with ID starting with 6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c not found: ID does not exist" containerID="6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c"
Jul 09 14:11:13.552934 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.552891    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c"} err="failed to get container status \"6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c\": rpc error: code = NotFound desc = could not find container \"6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c\": container with ID starting with 6b9cb14a317d02fabce793aeddb598cf482ff6dd9fff974fa00ea3fcb55d887c not found: ID does not exist"
Jul 09 14:11:13.604535 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.604499    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"]
Jul 09 14:11:13.611313 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:13.609128    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/auth-test-model-6ee5b0-kserve-68d97dcf4c-kq8sq"]
Jul 09 14:11:14.317693 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:14.317655    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3852c803-90e6-412b-bdc9-4dc743ca461b" path="/var/lib/kubelet/pods/3852c803-90e6-412b-bdc9-4dc743ca461b/volumes"
Jul 09 14:11:14.318071 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:14.318055    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cccbb533-7015-47e5-b53f-53d4febf7353" path="/var/lib/kubelet/pods/cccbb533-7015-47e5-b53f-53d4febf7353/volumes"
Jul 09 14:11:18.661274 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:18.661235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:11:38.386841 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.386807    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"]
Jul 09 14:11:38.387574 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.387240    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cccbb533-7015-47e5-b53f-53d4febf7353" containerName="main"
Jul 09 14:11:38.387574 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.387252    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cccbb533-7015-47e5-b53f-53d4febf7353" containerName="main"
Jul 09 14:11:38.387574 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.387260    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3852c803-90e6-412b-bdc9-4dc743ca461b" containerName="main"
Jul 09 14:11:38.387574 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.387265    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3852c803-90e6-412b-bdc9-4dc743ca461b" containerName="main"
Jul 09 14:11:38.387574 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.387368    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3852c803-90e6-412b-bdc9-4dc743ca461b" containerName="main"
Jul 09 14:11:38.387574 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.387382    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cccbb533-7015-47e5-b53f-53d4febf7353" containerName="main"
Jul 09 14:11:38.390492 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.390473    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.395099 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.395065    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"openshift-service-ca.crt\""
Jul 09 14:11:38.395538 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.395515    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"default-dockercfg-7dlfq\""
Jul 09 14:11:38.395889 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.395251    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"kube-root-ca.crt\""
Jul 09 14:11:38.396378 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.396358    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-06548f\"/\"sub-test-model-06548f-kserve-self-signed-certs\""
Jul 09 14:11:38.405463 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.403347    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:11:38.405967 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.405943    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"]
Jul 09 14:11:38.460072 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.460033    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-home\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.460248 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.460092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-model-cache\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.460248 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.460163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5171caa3-c252-4269-baaf-ce2ee6a01be4-tls-certs\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.460248 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.460194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt5lx\" (UniqueName: \"kubernetes.io/projected/5171caa3-c252-4269-baaf-ce2ee6a01be4-kube-api-access-kt5lx\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.460248 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.460236    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-dshm\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.460486 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.460276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-tmp-dir\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.561386 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.561344    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-home\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.561595 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.561406    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-model-cache\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.561595 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.561437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5171caa3-c252-4269-baaf-ce2ee6a01be4-tls-certs\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.561595 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.561460    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt5lx\" (UniqueName: \"kubernetes.io/projected/5171caa3-c252-4269-baaf-ce2ee6a01be4-kube-api-access-kt5lx\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.561595 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.561507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-dshm\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.561595 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.561530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-tmp-dir\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.561838 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.561814    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-home\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.561878 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.561856    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-model-cache\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.561955 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.561936    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-tmp-dir\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.563788 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.563763    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-dshm\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.563963 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.563945    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5171caa3-c252-4269-baaf-ce2ee6a01be4-tls-certs\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.570116 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.570093    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt5lx\" (UniqueName: \"kubernetes.io/projected/5171caa3-c252-4269-baaf-ce2ee6a01be4-kube-api-access-kt5lx\") pod \"sub-test-model-06548f-kserve-7c88b4d477-qv5xr\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") " pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.704244 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.704167    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:38.848934 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:38.848906    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"]
Jul 09 14:11:38.850998 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:11:38.850955    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5171caa3_c252_4269_baaf_ce2ee6a01be4.slice/crio-1f12bd346efc4e2411d8fddac731b9cdd5b44fcf4a2a9c9551def5fed29eaddc WatchSource:0}: Error finding container 1f12bd346efc4e2411d8fddac731b9cdd5b44fcf4a2a9c9551def5fed29eaddc: Status 404 returned error can't find the container with id 1f12bd346efc4e2411d8fddac731b9cdd5b44fcf4a2a9c9551def5fed29eaddc
Jul 09 14:11:39.700043 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:39.700006    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr" event={"ID":"5171caa3-c252-4269-baaf-ce2ee6a01be4","Type":"ContainerStarted","Data":"8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b"}
Jul 09 14:11:39.700043 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:39.700054    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr" event={"ID":"5171caa3-c252-4269-baaf-ce2ee6a01be4","Type":"ContainerStarted","Data":"1f12bd346efc4e2411d8fddac731b9cdd5b44fcf4a2a9c9551def5fed29eaddc"}
Jul 09 14:11:39.720301 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:39.720228    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr" podStartSLOduration=1.720212031 podStartE2EDuration="1.720212031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:11:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:11:39.718979948 +0000 UTC m=+2545.930970376" watchObservedRunningTime="2026-07-09 14:11:39.720212031 +0000 UTC m=+2545.932202445"
Jul 09 14:11:41.549037 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:41.549001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:11:42.771071 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:42.771027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:11:42.871310 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:42.871250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:11:48.704363 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:48.704327    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:48.704759 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:48.704374    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:48.717306 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:48.717268    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:11:48.763460 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:11:48.763434    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:12:11.988552 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:11.988521    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"]
Jul 09 14:12:11.992149 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:11.992133    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:11.995369 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:11.995346    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"kube-root-ca.crt\""
Jul 09 14:12:11.995504 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:11.995386    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"openshift-service-ca.crt\""
Jul 09 14:12:11.996743 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:11.996728    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"default-dockercfg-gdnkn\""
Jul 09 14:12:11.996806 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:11.996776    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"sub-test-model-6ee5b0-kserve-self-signed-certs\""
Jul 09 14:12:12.002861 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.002840    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"]
Jul 09 14:12:12.011858 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.011835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:12:12.168952 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.168923    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-tmp-dir\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.169129 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.168959    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-model-cache\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.169129 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.168996    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3da75a6a-ee22-4ec3-b790-a6cb60045459-tls-certs\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.169129 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.169058    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-dshm\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.169129 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.169093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scjt8\" (UniqueName: \"kubernetes.io/projected/3da75a6a-ee22-4ec3-b790-a6cb60045459-kube-api-access-scjt8\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.169276 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.169139    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-home\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.270560 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.270477    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3da75a6a-ee22-4ec3-b790-a6cb60045459-tls-certs\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.270560 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.270528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-dshm\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.270760 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.270571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scjt8\" (UniqueName: \"kubernetes.io/projected/3da75a6a-ee22-4ec3-b790-a6cb60045459-kube-api-access-scjt8\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.270760 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.270592    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-home\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.270760 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.270636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-tmp-dir\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.270760 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.270668    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-model-cache\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.271091 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.271065    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-home\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.271091 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.271085    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-model-cache\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.271209 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.271124    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-tmp-dir\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.272794 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.272773    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-dshm\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.273190 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.273169    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3da75a6a-ee22-4ec3-b790-a6cb60045459-tls-certs\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.280500 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.280477    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scjt8\" (UniqueName: \"kubernetes.io/projected/3da75a6a-ee22-4ec3-b790-a6cb60045459-kube-api-access-scjt8\") pod \"sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") " pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.302451 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.302428    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:12.442124 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.442096    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"]
Jul 09 14:12:12.443469 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:12:12.443434    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3da75a6a_ee22_4ec3_b790_a6cb60045459.slice/crio-9c8c01e9436ae88cdfeb66ef9ea17a60e228d68dc0ef042fd87167572cab8946 WatchSource:0}: Error finding container 9c8c01e9436ae88cdfeb66ef9ea17a60e228d68dc0ef042fd87167572cab8946: Status 404 returned error can't find the container with id 9c8c01e9436ae88cdfeb66ef9ea17a60e228d68dc0ef042fd87167572cab8946
Jul 09 14:12:12.891179 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.891140    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg" event={"ID":"3da75a6a-ee22-4ec3-b790-a6cb60045459","Type":"ContainerStarted","Data":"73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80"}
Jul 09 14:12:12.891379 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.891197    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg" event={"ID":"3da75a6a-ee22-4ec3-b790-a6cb60045459","Type":"ContainerStarted","Data":"9c8c01e9436ae88cdfeb66ef9ea17a60e228d68dc0ef042fd87167572cab8946"}
Jul 09 14:12:12.912766 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:12.912705    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg" podStartSLOduration=1.912669597 podStartE2EDuration="1.912669597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:12:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:12:12.911174665 +0000 UTC m=+2579.123165083" watchObservedRunningTime="2026-07-09 14:12:12.912669597 +0000 UTC m=+2579.124660014"
Jul 09 14:12:22.303192 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:22.303157    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:22.303654 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:22.303493    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:22.319853 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:22.319827    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:12:22.962478 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:12:22.962453    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:13:14.621861 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:14.621820    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:13:14.722168 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:14.722128    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:13:17.467688 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:17.467658    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"]
Jul 09 14:13:17.483007 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:17.482977    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:13:18.291985 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:18.291950    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"]
Jul 09 14:13:18.312070 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:18.312030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:13:22.425927 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:22.425893    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:13:22.526091 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:22.526062    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:13:27.513857 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:27.513811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:13:32.487414 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.487368    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr" podUID="5171caa3-c252-4269-baaf-ce2ee6a01be4" containerName="main" containerID="cri-o://8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b" gracePeriod=45
Jul 09 14:13:32.751548 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.751485    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:13:32.765193 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765168    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-tmp-dir\") pod \"5171caa3-c252-4269-baaf-ce2ee6a01be4\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") "
Jul 09 14:13:32.765333 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765201    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-model-cache\") pod \"5171caa3-c252-4269-baaf-ce2ee6a01be4\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") "
Jul 09 14:13:32.765333 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765219    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5171caa3-c252-4269-baaf-ce2ee6a01be4-tls-certs\") pod \"5171caa3-c252-4269-baaf-ce2ee6a01be4\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") "
Jul 09 14:13:32.765333 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765262    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-home\") pod \"5171caa3-c252-4269-baaf-ce2ee6a01be4\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") "
Jul 09 14:13:32.765333 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765327    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-dshm\") pod \"5171caa3-c252-4269-baaf-ce2ee6a01be4\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") "
Jul 09 14:13:32.765571 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765373    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kt5lx\" (UniqueName: \"kubernetes.io/projected/5171caa3-c252-4269-baaf-ce2ee6a01be4-kube-api-access-kt5lx\") pod \"5171caa3-c252-4269-baaf-ce2ee6a01be4\" (UID: \"5171caa3-c252-4269-baaf-ce2ee6a01be4\") "
Jul 09 14:13:32.765571 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765411    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5171caa3-c252-4269-baaf-ce2ee6a01be4" (UID: "5171caa3-c252-4269-baaf-ce2ee6a01be4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:13:32.765571 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765458    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-model-cache" (OuterVolumeSpecName: "model-cache") pod "5171caa3-c252-4269-baaf-ce2ee6a01be4" (UID: "5171caa3-c252-4269-baaf-ce2ee6a01be4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:13:32.765703 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765568    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-home" (OuterVolumeSpecName: "home") pod "5171caa3-c252-4269-baaf-ce2ee6a01be4" (UID: "5171caa3-c252-4269-baaf-ce2ee6a01be4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:13:32.765777 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765706    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-home\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:32.765777 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765722    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-tmp-dir\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:32.765777 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.765732    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-model-cache\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:32.767566 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.767534    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5171caa3-c252-4269-baaf-ce2ee6a01be4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5171caa3-c252-4269-baaf-ce2ee6a01be4" (UID: "5171caa3-c252-4269-baaf-ce2ee6a01be4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:13:32.767566 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.767535    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-dshm" (OuterVolumeSpecName: "dshm") pod "5171caa3-c252-4269-baaf-ce2ee6a01be4" (UID: "5171caa3-c252-4269-baaf-ce2ee6a01be4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:13:32.767747 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.767589    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5171caa3-c252-4269-baaf-ce2ee6a01be4-kube-api-access-kt5lx" (OuterVolumeSpecName: "kube-api-access-kt5lx") pod "5171caa3-c252-4269-baaf-ce2ee6a01be4" (UID: "5171caa3-c252-4269-baaf-ce2ee6a01be4"). InnerVolumeSpecName "kube-api-access-kt5lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:13:32.866341 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.866311    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5171caa3-c252-4269-baaf-ce2ee6a01be4-dshm\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:32.866341 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.866337    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt5lx\" (UniqueName: \"kubernetes.io/projected/5171caa3-c252-4269-baaf-ce2ee6a01be4-kube-api-access-kt5lx\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:32.866341 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:32.866348    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5171caa3-c252-4269-baaf-ce2ee6a01be4-tls-certs\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:33.313098 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.313060    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg" podUID="3da75a6a-ee22-4ec3-b790-a6cb60045459" containerName="main" containerID="cri-o://73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80" gracePeriod=45
Jul 09 14:13:33.358527 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.358497    2583 generic.go:356] "Generic (PLEG): container finished" podID="5171caa3-c252-4269-baaf-ce2ee6a01be4" containerID="8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b" exitCode=0
Jul 09 14:13:33.358646 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.358543    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"
Jul 09 14:13:33.358646 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.358588    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr" event={"ID":"5171caa3-c252-4269-baaf-ce2ee6a01be4","Type":"ContainerDied","Data":"8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b"}
Jul 09 14:13:33.358646 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.358640    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr" event={"ID":"5171caa3-c252-4269-baaf-ce2ee6a01be4","Type":"ContainerDied","Data":"1f12bd346efc4e2411d8fddac731b9cdd5b44fcf4a2a9c9551def5fed29eaddc"}
Jul 09 14:13:33.358816 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.358662    2583 scope.go:117] "RemoveContainer" containerID="8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b"
Jul 09 14:13:33.403421 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.403398    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"]
Jul 09 14:13:33.407521 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.407499    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-06548f/sub-test-model-06548f-kserve-7c88b4d477-qv5xr"]
Jul 09 14:13:33.424847 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.424820    2583 scope.go:117] "RemoveContainer" containerID="8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b"
Jul 09 14:13:33.425177 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:13:33.425151    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b\": container with ID starting with 8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b not found: ID does not exist" containerID="8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b"
Jul 09 14:13:33.425274 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.425188    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b"} err="failed to get container status \"8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b\": rpc error: code = NotFound desc = could not find container \"8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b\": container with ID starting with 8e516107a798e5fa3a46745a28bd33f8231cf414b55258d2e3d32e4d688d5b9b not found: ID does not exist"
Jul 09 14:13:33.573109 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.573086    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:13:33.672775 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.672746    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-home\") pod \"3da75a6a-ee22-4ec3-b790-a6cb60045459\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") "
Jul 09 14:13:33.672976 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.672793    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scjt8\" (UniqueName: \"kubernetes.io/projected/3da75a6a-ee22-4ec3-b790-a6cb60045459-kube-api-access-scjt8\") pod \"3da75a6a-ee22-4ec3-b790-a6cb60045459\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") "
Jul 09 14:13:33.672976 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.672818    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-model-cache\") pod \"3da75a6a-ee22-4ec3-b790-a6cb60045459\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") "
Jul 09 14:13:33.672976 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.672835    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3da75a6a-ee22-4ec3-b790-a6cb60045459-tls-certs\") pod \"3da75a6a-ee22-4ec3-b790-a6cb60045459\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") "
Jul 09 14:13:33.672976 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.672927    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-tmp-dir\") pod \"3da75a6a-ee22-4ec3-b790-a6cb60045459\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") "
Jul 09 14:13:33.672976 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.672954    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-dshm\") pod \"3da75a6a-ee22-4ec3-b790-a6cb60045459\" (UID: \"3da75a6a-ee22-4ec3-b790-a6cb60045459\") "
Jul 09 14:13:33.673224 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.673081    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-model-cache" (OuterVolumeSpecName: "model-cache") pod "3da75a6a-ee22-4ec3-b790-a6cb60045459" (UID: "3da75a6a-ee22-4ec3-b790-a6cb60045459"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:13:33.673224 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.673093    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-home" (OuterVolumeSpecName: "home") pod "3da75a6a-ee22-4ec3-b790-a6cb60045459" (UID: "3da75a6a-ee22-4ec3-b790-a6cb60045459"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:13:33.673224 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.673173    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-model-cache\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:33.673224 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.673190    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-home\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:33.673224 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.673190    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3da75a6a-ee22-4ec3-b790-a6cb60045459" (UID: "3da75a6a-ee22-4ec3-b790-a6cb60045459"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:13:33.674933 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.674906    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-dshm" (OuterVolumeSpecName: "dshm") pod "3da75a6a-ee22-4ec3-b790-a6cb60045459" (UID: "3da75a6a-ee22-4ec3-b790-a6cb60045459"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:13:33.675043 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.674948    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da75a6a-ee22-4ec3-b790-a6cb60045459-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3da75a6a-ee22-4ec3-b790-a6cb60045459" (UID: "3da75a6a-ee22-4ec3-b790-a6cb60045459"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:13:33.675043 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.674973    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da75a6a-ee22-4ec3-b790-a6cb60045459-kube-api-access-scjt8" (OuterVolumeSpecName: "kube-api-access-scjt8") pod "3da75a6a-ee22-4ec3-b790-a6cb60045459" (UID: "3da75a6a-ee22-4ec3-b790-a6cb60045459"). InnerVolumeSpecName "kube-api-access-scjt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:13:33.774107 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.774076    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-tmp-dir\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:33.774107 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.774102    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3da75a6a-ee22-4ec3-b790-a6cb60045459-dshm\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:33.774107 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.774112    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scjt8\" (UniqueName: \"kubernetes.io/projected/3da75a6a-ee22-4ec3-b790-a6cb60045459-kube-api-access-scjt8\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:33.774350 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:33.774121    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3da75a6a-ee22-4ec3-b790-a6cb60045459-tls-certs\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:13:34.318800 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:34.318766    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5171caa3-c252-4269-baaf-ce2ee6a01be4" path="/var/lib/kubelet/pods/5171caa3-c252-4269-baaf-ce2ee6a01be4/volumes"
Jul 09 14:13:34.365466 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:34.365429    2583 generic.go:356] "Generic (PLEG): container finished" podID="3da75a6a-ee22-4ec3-b790-a6cb60045459" containerID="73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80" exitCode=0
Jul 09 14:13:34.365653 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:34.365471    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"
Jul 09 14:13:34.365653 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:34.365514    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg" event={"ID":"3da75a6a-ee22-4ec3-b790-a6cb60045459","Type":"ContainerDied","Data":"73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80"}
Jul 09 14:13:34.365653 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:34.365570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg" event={"ID":"3da75a6a-ee22-4ec3-b790-a6cb60045459","Type":"ContainerDied","Data":"9c8c01e9436ae88cdfeb66ef9ea17a60e228d68dc0ef042fd87167572cab8946"}
Jul 09 14:13:34.365653 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:34.365593    2583 scope.go:117] "RemoveContainer" containerID="73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80"
Jul 09 14:13:34.374657 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:34.374636    2583 scope.go:117] "RemoveContainer" containerID="73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80"
Jul 09 14:13:34.374948 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:13:34.374924    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80\": container with ID starting with 73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80 not found: ID does not exist" containerID="73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80"
Jul 09 14:13:34.375036 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:34.374960    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80"} err="failed to get container status \"73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80\": rpc error: code = NotFound desc = could not find container \"73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80\": container with ID starting with 73380ace6826dea06f8cd6f36eecf0400092b722ba5ab87989f0ccde8c250e80 not found: ID does not exist"
Jul 09 14:13:34.386930 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:34.386906    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"]
Jul 09 14:13:34.391477 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:34.391454    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/sub-test-model-6ee5b0-kserve-66cc9bb957-j4dbg"]
Jul 09 14:13:36.318633 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:13:36.318600    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da75a6a-ee22-4ec3-b790-a6cb60045459" path="/var/lib/kubelet/pods/3da75a6a-ee22-4ec3-b790-a6cb60045459/volumes"
Jul 09 14:14:05.570752 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:05.570716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:14:14.517993 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:14.517883    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 14:14:14.530030 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:14.530009    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 14:14:17.988310 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.988267    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"]
Jul 09 14:14:17.988716 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.988683    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da75a6a-ee22-4ec3-b790-a6cb60045459" containerName="main"
Jul 09 14:14:17.988716 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.988695    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da75a6a-ee22-4ec3-b790-a6cb60045459" containerName="main"
Jul 09 14:14:17.988716 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.988709    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5171caa3-c252-4269-baaf-ce2ee6a01be4" containerName="main"
Jul 09 14:14:17.988716 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.988714    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5171caa3-c252-4269-baaf-ce2ee6a01be4" containerName="main"
Jul 09 14:14:17.988870 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.988771    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5171caa3-c252-4269-baaf-ce2ee6a01be4" containerName="main"
Jul 09 14:14:17.988870 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.988780    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da75a6a-ee22-4ec3-b790-a6cb60045459" containerName="main"
Jul 09 14:14:17.993208 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.993192    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:17.997237 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.997204    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"default-dockercfg-gdnkn\""
Jul 09 14:14:17.997237 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.997208    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"rate-test-model-6ee5b0-kserve-self-signed-certs\""
Jul 09 14:14:17.997237 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.997208    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"openshift-service-ca.crt\""
Jul 09 14:14:17.997470 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:17.997271    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6ee5b0\"/\"kube-root-ca.crt\""
Jul 09 14:14:18.003251 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.003229    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"]
Jul 09 14:14:18.069536 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.069505    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-model-cache\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.069695 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.069549    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-dshm\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.069695 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.069595    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-tmp-dir\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.069695 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.069618    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de1d037a-edb7-45ba-809e-9cc70250ebd2-tls-certs\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.069695 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.069667    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-home\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.069695 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.069686    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh6xs\" (UniqueName: \"kubernetes.io/projected/de1d037a-edb7-45ba-809e-9cc70250ebd2-kube-api-access-jh6xs\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.077689 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.077662    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:14:18.170839 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.170805    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-model-cache\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.170998 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.170856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-dshm\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.170998 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.170885    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-tmp-dir\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.170998 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.170922    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de1d037a-edb7-45ba-809e-9cc70250ebd2-tls-certs\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.170998 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.170956    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-home\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.170998 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.170978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh6xs\" (UniqueName: \"kubernetes.io/projected/de1d037a-edb7-45ba-809e-9cc70250ebd2-kube-api-access-jh6xs\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.171266 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.171244    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-model-cache\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.171366 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.171329    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-home\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.171366 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.171355    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-tmp-dir\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.173190 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.173173    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-dshm\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.173388 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.173374    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de1d037a-edb7-45ba-809e-9cc70250ebd2-tls-certs\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.182620 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.182598    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh6xs\" (UniqueName: \"kubernetes.io/projected/de1d037a-edb7-45ba-809e-9cc70250ebd2-kube-api-access-jh6xs\") pod \"rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") " pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.302747 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.302659    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:18.444242 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.444216    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"]
Jul 09 14:14:18.445807 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:14:18.445785    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde1d037a_edb7_45ba_809e_9cc70250ebd2.slice/crio-f8474665b764fd128707ce64f17797b82d5a7fe687d09ad263daedd829dc94d0 WatchSource:0}: Error finding container f8474665b764fd128707ce64f17797b82d5a7fe687d09ad263daedd829dc94d0: Status 404 returned error can't find the container with id f8474665b764fd128707ce64f17797b82d5a7fe687d09ad263daedd829dc94d0
Jul 09 14:14:18.632315 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.632249    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5" event={"ID":"de1d037a-edb7-45ba-809e-9cc70250ebd2","Type":"ContainerStarted","Data":"87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79"}
Jul 09 14:14:18.632315 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:18.632315    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5" event={"ID":"de1d037a-edb7-45ba-809e-9cc70250ebd2","Type":"ContainerStarted","Data":"f8474665b764fd128707ce64f17797b82d5a7fe687d09ad263daedd829dc94d0"}
Jul 09 14:14:28.303320 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:28.303271    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:28.303682 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:28.303335    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:28.318085 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:28.318060    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:14:28.352476 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:28.352413    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5" podStartSLOduration=11.352400605 podStartE2EDuration="11.352400605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:14:18.667982104 +0000 UTC m=+2704.879972520" watchObservedRunningTime="2026-07-09 14:14:28.352400605 +0000 UTC m=+2714.564391021"
Jul 09 14:14:28.701667 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:14:28.701634    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:15:00.146143 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.146102    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"]
Jul 09 14:15:00.149759 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.149731    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"
Jul 09 14:15:00.149904 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.149881    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"]
Jul 09 14:15:00.153150 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.153125    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"]
Jul 09 14:15:00.153404 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.153228    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"
Jul 09 14:15:00.156401 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.156381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"
Jul 09 14:15:00.168788 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.168759    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"]
Jul 09 14:15:00.172871 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.172847    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"]
Jul 09 14:15:00.176340 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.176310    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"]
Jul 09 14:15:00.236452 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.236416    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shw6x\" (UniqueName: \"kubernetes.io/projected/0f2dce42-7e5d-4a49-8405-176a5553761e-kube-api-access-shw6x\") pod \"maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768\" (UID: \"0f2dce42-7e5d-4a49-8405-176a5553761e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"
Jul 09 14:15:00.236634 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.236467    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvngf\" (UniqueName: \"kubernetes.io/projected/1236691a-ba78-4ff8-a62c-14dfc20daebb-kube-api-access-mvngf\") pod \"maas-api-key-cleanup-29726775-2f2q8\" (UID: \"1236691a-ba78-4ff8-a62c-14dfc20daebb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"
Jul 09 14:15:00.236634 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.236535    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8tb7\" (UniqueName: \"kubernetes.io/projected/6ff6bf1b-0fae-4468-a696-45026a705207-kube-api-access-d8tb7\") pod \"maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq\" (UID: \"6ff6bf1b-0fae-4468-a696-45026a705207\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"
Jul 09 14:15:00.337202 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.337164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8tb7\" (UniqueName: \"kubernetes.io/projected/6ff6bf1b-0fae-4468-a696-45026a705207-kube-api-access-d8tb7\") pod \"maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq\" (UID: \"6ff6bf1b-0fae-4468-a696-45026a705207\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"
Jul 09 14:15:00.337428 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.337243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shw6x\" (UniqueName: \"kubernetes.io/projected/0f2dce42-7e5d-4a49-8405-176a5553761e-kube-api-access-shw6x\") pod \"maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768\" (UID: \"0f2dce42-7e5d-4a49-8405-176a5553761e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"
Jul 09 14:15:00.337428 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.337314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvngf\" (UniqueName: \"kubernetes.io/projected/1236691a-ba78-4ff8-a62c-14dfc20daebb-kube-api-access-mvngf\") pod \"maas-api-key-cleanup-29726775-2f2q8\" (UID: \"1236691a-ba78-4ff8-a62c-14dfc20daebb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"
Jul 09 14:15:00.347523 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.347492    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvngf\" (UniqueName: \"kubernetes.io/projected/1236691a-ba78-4ff8-a62c-14dfc20daebb-kube-api-access-mvngf\") pod \"maas-api-key-cleanup-29726775-2f2q8\" (UID: \"1236691a-ba78-4ff8-a62c-14dfc20daebb\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"
Jul 09 14:15:00.347654 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.347589    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shw6x\" (UniqueName: \"kubernetes.io/projected/0f2dce42-7e5d-4a49-8405-176a5553761e-kube-api-access-shw6x\") pod \"maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768\" (UID: \"0f2dce42-7e5d-4a49-8405-176a5553761e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"
Jul 09 14:15:00.347654 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.347589    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8tb7\" (UniqueName: \"kubernetes.io/projected/6ff6bf1b-0fae-4468-a696-45026a705207-kube-api-access-d8tb7\") pod \"maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq\" (UID: \"6ff6bf1b-0fae-4468-a696-45026a705207\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"
Jul 09 14:15:00.462276 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.462189    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"
Jul 09 14:15:00.473772 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.473736    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"
Jul 09 14:15:00.479575 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.479551    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"
Jul 09 14:15:00.648027 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.647959    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"]
Jul 09 14:15:00.651956 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:15:00.651909    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff6bf1b_0fae_4468_a696_45026a705207.slice/crio-8664cfd1e3b5434ed1486a098908513b2f9d534e204b8011957d3863c45f854f WatchSource:0}: Error finding container 8664cfd1e3b5434ed1486a098908513b2f9d534e204b8011957d3863c45f854f: Status 404 returned error can't find the container with id 8664cfd1e3b5434ed1486a098908513b2f9d534e204b8011957d3863c45f854f
Jul 09 14:15:00.654248 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.654220    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 14:15:00.876767 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.876739    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"]
Jul 09 14:15:00.878675 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:15:00.878651    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1236691a_ba78_4ff8_a62c_14dfc20daebb.slice/crio-8fb755476ffe9c2ab8f5952fc52bad28279d798c62fb50ce69c3ccdd330f2e85 WatchSource:0}: Error finding container 8fb755476ffe9c2ab8f5952fc52bad28279d798c62fb50ce69c3ccdd330f2e85: Status 404 returned error can't find the container with id 8fb755476ffe9c2ab8f5952fc52bad28279d798c62fb50ce69c3ccdd330f2e85
Jul 09 14:15:00.879245 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.879221    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"]
Jul 09 14:15:00.879724 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:15:00.879702    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2dce42_7e5d_4a49_8405_176a5553761e.slice/crio-cade62b4be0b41262e01b5561aa7fedf31d8da17de20a6a356d0c41ae9989aee WatchSource:0}: Error finding container cade62b4be0b41262e01b5561aa7fedf31d8da17de20a6a356d0c41ae9989aee: Status 404 returned error can't find the container with id cade62b4be0b41262e01b5561aa7fedf31d8da17de20a6a356d0c41ae9989aee
Jul 09 14:15:00.885489 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:00.885465    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq" event={"ID":"6ff6bf1b-0fae-4468-a696-45026a705207","Type":"ContainerStarted","Data":"8664cfd1e3b5434ed1486a098908513b2f9d534e204b8011957d3863c45f854f"}
Jul 09 14:15:01.895023 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:01.894936    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768" event={"ID":"0f2dce42-7e5d-4a49-8405-176a5553761e","Type":"ContainerStarted","Data":"cade62b4be0b41262e01b5561aa7fedf31d8da17de20a6a356d0c41ae9989aee"}
Jul 09 14:15:01.896468 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:01.896437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8" event={"ID":"1236691a-ba78-4ff8-a62c-14dfc20daebb","Type":"ContainerStarted","Data":"8fb755476ffe9c2ab8f5952fc52bad28279d798c62fb50ce69c3ccdd330f2e85"}
Jul 09 14:15:03.911989 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:03.911949    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8" event={"ID":"1236691a-ba78-4ff8-a62c-14dfc20daebb","Type":"ContainerStarted","Data":"2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881"}
Jul 09 14:15:03.913684 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:03.913652    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq" event={"ID":"6ff6bf1b-0fae-4468-a696-45026a705207","Type":"ContainerStarted","Data":"dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018"}
Jul 09 14:15:03.915327 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:03.915302    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768" event={"ID":"0f2dce42-7e5d-4a49-8405-176a5553761e","Type":"ContainerStarted","Data":"2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532"}
Jul 09 14:15:03.932760 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:03.932714    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8" podStartSLOduration=1.736468519 podStartE2EDuration="3.932697809s" totalImagesPullingTime="2.19622929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:15:03.929666093 +0000 UTC m=+2750.141656520" watchObservedRunningTime="2026-07-09 14:15:03.932697809 +0000 UTC m=+2750.144688225"
Jul 09 14:15:03.949102 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:03.949060    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq" podStartSLOduration=1.5509875069999999 podStartE2EDuration="3.949045385s" totalImagesPullingTime="2.398057878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:15:03.947846208 +0000 UTC m=+2750.159836623" watchObservedRunningTime="2026-07-09 14:15:03.949045385 +0000 UTC m=+2750.161035853"
Jul 09 14:15:03.968123 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:03.968072    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768" podStartSLOduration=1.7671097630000001 podStartE2EDuration="3.968057164s" totalImagesPullingTime="2.200947401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:15:03.965383512 +0000 UTC m=+2750.177373957" watchObservedRunningTime="2026-07-09 14:15:03.968057164 +0000 UTC m=+2750.180047579"
Jul 09 14:15:18.447838 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:18.447798    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:15:19.292000 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:19.291964    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"]
Jul 09 14:15:19.730761 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:19.730725    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:15:34.312872 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.312832    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5" podUID="de1d037a-edb7-45ba-809e-9cc70250ebd2" containerName="main" containerID="cri-o://87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79" gracePeriod=45
Jul 09 14:15:34.571577 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.571551    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:15:34.657188 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.657155    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-dshm\") pod \"de1d037a-edb7-45ba-809e-9cc70250ebd2\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") "
Jul 09 14:15:34.657188 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.657191    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-tmp-dir\") pod \"de1d037a-edb7-45ba-809e-9cc70250ebd2\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") "
Jul 09 14:15:34.657452 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.657236    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-home\") pod \"de1d037a-edb7-45ba-809e-9cc70250ebd2\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") "
Jul 09 14:15:34.657452 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.657256    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de1d037a-edb7-45ba-809e-9cc70250ebd2-tls-certs\") pod \"de1d037a-edb7-45ba-809e-9cc70250ebd2\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") "
Jul 09 14:15:34.657452 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.657301    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh6xs\" (UniqueName: \"kubernetes.io/projected/de1d037a-edb7-45ba-809e-9cc70250ebd2-kube-api-access-jh6xs\") pod \"de1d037a-edb7-45ba-809e-9cc70250ebd2\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") "
Jul 09 14:15:34.657452 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.657365    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-model-cache\") pod \"de1d037a-edb7-45ba-809e-9cc70250ebd2\" (UID: \"de1d037a-edb7-45ba-809e-9cc70250ebd2\") "
Jul 09 14:15:34.657675 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.657516    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-home" (OuterVolumeSpecName: "home") pod "de1d037a-edb7-45ba-809e-9cc70250ebd2" (UID: "de1d037a-edb7-45ba-809e-9cc70250ebd2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:15:34.657675 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.657606    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "de1d037a-edb7-45ba-809e-9cc70250ebd2" (UID: "de1d037a-edb7-45ba-809e-9cc70250ebd2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:15:34.657807 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.657728    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-model-cache" (OuterVolumeSpecName: "model-cache") pod "de1d037a-edb7-45ba-809e-9cc70250ebd2" (UID: "de1d037a-edb7-45ba-809e-9cc70250ebd2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:15:34.658517 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.657719    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-tmp-dir\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:15:34.658517 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.658281    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-home\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:15:34.659742 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.659707    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de1d037a-edb7-45ba-809e-9cc70250ebd2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "de1d037a-edb7-45ba-809e-9cc70250ebd2" (UID: "de1d037a-edb7-45ba-809e-9cc70250ebd2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:15:34.669010 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.668981    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-dshm" (OuterVolumeSpecName: "dshm") pod "de1d037a-edb7-45ba-809e-9cc70250ebd2" (UID: "de1d037a-edb7-45ba-809e-9cc70250ebd2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:15:34.669010 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.668985    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de1d037a-edb7-45ba-809e-9cc70250ebd2-kube-api-access-jh6xs" (OuterVolumeSpecName: "kube-api-access-jh6xs") pod "de1d037a-edb7-45ba-809e-9cc70250ebd2" (UID: "de1d037a-edb7-45ba-809e-9cc70250ebd2"). InnerVolumeSpecName "kube-api-access-jh6xs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:15:34.758975 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.758940    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-dshm\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:15:34.758975 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.758968    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de1d037a-edb7-45ba-809e-9cc70250ebd2-tls-certs\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:15:34.758975 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.758980    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh6xs\" (UniqueName: \"kubernetes.io/projected/de1d037a-edb7-45ba-809e-9cc70250ebd2-kube-api-access-jh6xs\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:15:34.759214 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:34.758989    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de1d037a-edb7-45ba-809e-9cc70250ebd2-model-cache\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:15:35.093226 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:35.093190    2583 generic.go:356] "Generic (PLEG): container finished" podID="de1d037a-edb7-45ba-809e-9cc70250ebd2" containerID="87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79" exitCode=0
Jul 09 14:15:35.093431 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:35.093253    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"
Jul 09 14:15:35.093431 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:35.093259    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5" event={"ID":"de1d037a-edb7-45ba-809e-9cc70250ebd2","Type":"ContainerDied","Data":"87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79"}
Jul 09 14:15:35.093431 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:35.093328    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5" event={"ID":"de1d037a-edb7-45ba-809e-9cc70250ebd2","Type":"ContainerDied","Data":"f8474665b764fd128707ce64f17797b82d5a7fe687d09ad263daedd829dc94d0"}
Jul 09 14:15:35.093431 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:35.093349    2583 scope.go:117] "RemoveContainer" containerID="87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79"
Jul 09 14:15:35.102640 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:35.102623    2583 scope.go:117] "RemoveContainer" containerID="87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79"
Jul 09 14:15:35.102865 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:15:35.102848    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79\": container with ID starting with 87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79 not found: ID does not exist" containerID="87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79"
Jul 09 14:15:35.102927 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:35.102873    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79"} err="failed to get container status \"87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79\": rpc error: code = NotFound desc = could not find container \"87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79\": container with ID starting with 87a33087a84fc0c0053266ba9ad9a8344f03d99c6d6d43737acca70479f04a79 not found: ID does not exist"
Jul 09 14:15:35.117375 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:35.117344    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"]
Jul 09 14:15:35.120536 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:35.120503    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6ee5b0/rate-test-model-6ee5b0-kserve-678b9b76ff-5pvx5"]
Jul 09 14:15:36.317385 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:36.317273    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de1d037a-edb7-45ba-809e-9cc70250ebd2" path="/var/lib/kubelet/pods/de1d037a-edb7-45ba-809e-9cc70250ebd2/volumes"
Jul 09 14:15:42.087839 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.087789    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7485-140592534218160"]
Jul 09 14:15:42.088273 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.088260    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de1d037a-edb7-45ba-809e-9cc70250ebd2" containerName="main"
Jul 09 14:15:42.088273 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.088274    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="de1d037a-edb7-45ba-809e-9cc70250ebd2" containerName="main"
Jul 09 14:15:42.088396 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.088385    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="de1d037a-edb7-45ba-809e-9cc70250ebd2" containerName="main"
Jul 09 14:15:42.093300 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.093267    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592534218160"
Jul 09 14:15:42.096453 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.096430    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-n8dl4\""
Jul 09 14:15:42.100106 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.100074    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592534218160"]
Jul 09 14:15:42.224303 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.224261    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w6kl\" (UniqueName: \"kubernetes.io/projected/3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a-kube-api-access-4w6kl\") pod \"test-curl-7485-140592534218160\" (UID: \"3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a\") " pod="openshift-ingress/test-curl-7485-140592534218160"
Jul 09 14:15:42.325353 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.325323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w6kl\" (UniqueName: \"kubernetes.io/projected/3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a-kube-api-access-4w6kl\") pod \"test-curl-7485-140592534218160\" (UID: \"3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a\") " pod="openshift-ingress/test-curl-7485-140592534218160"
Jul 09 14:15:42.336215 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.336180    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w6kl\" (UniqueName: \"kubernetes.io/projected/3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a-kube-api-access-4w6kl\") pod \"test-curl-7485-140592534218160\" (UID: \"3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a\") " pod="openshift-ingress/test-curl-7485-140592534218160"
Jul 09 14:15:42.403791 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.403708    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592534218160"
Jul 09 14:15:42.573277 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:42.573254    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592534218160"]
Jul 09 14:15:42.574994 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:15:42.574954    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d5ab3d8_37b3_4533_85f4_4e9c85c7f78a.slice/crio-727d36e1d7d691456684fc7924af6229719a8e3acdbb003548d9fac36c8305cc WatchSource:0}: Error finding container 727d36e1d7d691456684fc7924af6229719a8e3acdbb003548d9fac36c8305cc: Status 404 returned error can't find the container with id 727d36e1d7d691456684fc7924af6229719a8e3acdbb003548d9fac36c8305cc
Jul 09 14:15:43.143947 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:43.143913    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592534218160" event={"ID":"3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a","Type":"ContainerStarted","Data":"727d36e1d7d691456684fc7924af6229719a8e3acdbb003548d9fac36c8305cc"}
Jul 09 14:15:44.152369 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:44.152328    2583 generic.go:356] "Generic (PLEG): container finished" podID="3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a" containerID="79ce7bfa0d018c1b1a20fa26675061c59a720d94fe49a321f35941ee5a05e9d3" exitCode=0
Jul 09 14:15:44.152761 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:44.152413    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592534218160" event={"ID":"3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a","Type":"ContainerDied","Data":"79ce7bfa0d018c1b1a20fa26675061c59a720d94fe49a321f35941ee5a05e9d3"}
Jul 09 14:15:45.307515 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.307488    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592534218160"
Jul 09 14:15:45.334874 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.334844    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7485-140592534218160_3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a/test-curl-7485-140592534218160/0.log"
Jul 09 14:15:45.362600 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.362570    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7485-140592534218160"]
Jul 09 14:15:45.366311 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.366267    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7485-140592534218160"]
Jul 09 14:15:45.454237 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.454141    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w6kl\" (UniqueName: \"kubernetes.io/projected/3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a-kube-api-access-4w6kl\") pod \"3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a\" (UID: \"3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a\") "
Jul 09 14:15:45.456299 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.456257    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a-kube-api-access-4w6kl" (OuterVolumeSpecName: "kube-api-access-4w6kl") pod "3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a" (UID: "3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a"). InnerVolumeSpecName "kube-api-access-4w6kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:15:45.496517 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.496482    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7485-140592534218288"]
Jul 09 14:15:45.496929 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.496916    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a" containerName="test-curl-7485-140592534218160"
Jul 09 14:15:45.496974 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.496931    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a" containerName="test-curl-7485-140592534218160"
Jul 09 14:15:45.497010 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.497000    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a" containerName="test-curl-7485-140592534218160"
Jul 09 14:15:45.499147 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.499131    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592534218288"
Jul 09 14:15:45.513572 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.513536    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592534218288"]
Jul 09 14:15:45.555515 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.555482    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w6kl\" (UniqueName: \"kubernetes.io/projected/3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a-kube-api-access-4w6kl\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:15:45.656541 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.656498    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmmg7\" (UniqueName: \"kubernetes.io/projected/c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8-kube-api-access-nmmg7\") pod \"test-curl-7485-140592534218288\" (UID: \"c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8\") " pod="openshift-ingress/test-curl-7485-140592534218288"
Jul 09 14:15:45.757626 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.757537    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmmg7\" (UniqueName: \"kubernetes.io/projected/c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8-kube-api-access-nmmg7\") pod \"test-curl-7485-140592534218288\" (UID: \"c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8\") " pod="openshift-ingress/test-curl-7485-140592534218288"
Jul 09 14:15:45.766603 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.766576    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmmg7\" (UniqueName: \"kubernetes.io/projected/c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8-kube-api-access-nmmg7\") pod \"test-curl-7485-140592534218288\" (UID: \"c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8\") " pod="openshift-ingress/test-curl-7485-140592534218288"
Jul 09 14:15:45.809242 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:45.809202    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592534218288"
Jul 09 14:15:46.155989 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:46.155951    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592534218288"]
Jul 09 14:15:46.158456 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:15:46.158419    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8ccd1d1_f2ee_4832_b7d1_4c77149d3bb8.slice/crio-1a50f525fe2a39088ea13b891d3ceff73800de9fbafb66d2f59aab9650b0e29b WatchSource:0}: Error finding container 1a50f525fe2a39088ea13b891d3ceff73800de9fbafb66d2f59aab9650b0e29b: Status 404 returned error can't find the container with id 1a50f525fe2a39088ea13b891d3ceff73800de9fbafb66d2f59aab9650b0e29b
Jul 09 14:15:46.165511 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:46.165484    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="727d36e1d7d691456684fc7924af6229719a8e3acdbb003548d9fac36c8305cc"
Jul 09 14:15:46.165511 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:46.165505    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592534218160"
Jul 09 14:15:46.177922 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:15:46.177893    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7485-140592534218160\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a" pod="openshift-ingress/test-curl-7485-140592534218160"
Jul 09 14:15:46.317223 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:46.317188    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a" path="/var/lib/kubelet/pods/3d5ab3d8-37b3-4533-85f4-4e9c85c7f78a/volumes"
Jul 09 14:15:47.172890 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:47.172854    2583 generic.go:356] "Generic (PLEG): container finished" podID="c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8" containerID="fe5fc434f70dc411b8b4d850c4bb244671b7725e7dc19fb3018d99964f65f204" exitCode=0
Jul 09 14:15:47.173088 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:47.172937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592534218288" event={"ID":"c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8","Type":"ContainerDied","Data":"fe5fc434f70dc411b8b4d850c4bb244671b7725e7dc19fb3018d99964f65f204"}
Jul 09 14:15:47.173088 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:47.172980    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592534218288" event={"ID":"c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8","Type":"ContainerStarted","Data":"1a50f525fe2a39088ea13b891d3ceff73800de9fbafb66d2f59aab9650b0e29b"}
Jul 09 14:15:48.332367 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.332336    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592534218288"
Jul 09 14:15:48.354463 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.354436    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7485-140592534218288_c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8/test-curl-7485-140592534218288/0.log"
Jul 09 14:15:48.379782 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.379751    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7485-140592534218288"]
Jul 09 14:15:48.384191 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.384168    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7485-140592534218288"]
Jul 09 14:15:48.480954 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.480867    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmmg7\" (UniqueName: \"kubernetes.io/projected/c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8-kube-api-access-nmmg7\") pod \"c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8\" (UID: \"c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8\") "
Jul 09 14:15:48.482893 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.482866    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8-kube-api-access-nmmg7" (OuterVolumeSpecName: "kube-api-access-nmmg7") pod "c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8" (UID: "c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8"). InnerVolumeSpecName "kube-api-access-nmmg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:15:48.578757 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.578725    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7485-140592530295952"]
Jul 09 14:15:48.579235 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.579222    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8" containerName="test-curl-7485-140592534218288"
Jul 09 14:15:48.579319 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.579239    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8" containerName="test-curl-7485-140592534218288"
Jul 09 14:15:48.579363 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.579329    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8" containerName="test-curl-7485-140592534218288"
Jul 09 14:15:48.581794 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.581779    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:48.582080 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.582060    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmmg7\" (UniqueName: \"kubernetes.io/projected/c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8-kube-api-access-nmmg7\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:15:48.589006 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.588984    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592530295952"]
Jul 09 14:15:48.683159 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.683129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr585\" (UniqueName: \"kubernetes.io/projected/84941353-560b-4248-be99-1694f8b96960-kube-api-access-sr585\") pod \"test-curl-7485-140592530295952\" (UID: \"84941353-560b-4248-be99-1694f8b96960\") " pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:48.783827 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.783732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr585\" (UniqueName: \"kubernetes.io/projected/84941353-560b-4248-be99-1694f8b96960-kube-api-access-sr585\") pod \"test-curl-7485-140592530295952\" (UID: \"84941353-560b-4248-be99-1694f8b96960\") " pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:48.794639 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.794610    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr585\" (UniqueName: \"kubernetes.io/projected/84941353-560b-4248-be99-1694f8b96960-kube-api-access-sr585\") pod \"test-curl-7485-140592530295952\" (UID: \"84941353-560b-4248-be99-1694f8b96960\") " pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:48.891914 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:48.891885    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:49.027390 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:49.027363    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592530295952"]
Jul 09 14:15:49.028914 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:15:49.028887    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84941353_560b_4248_be99_1694f8b96960.slice/crio-70685b0634724ff17c32d61620752aef3941452effb765a2f24f8525425c27e7 WatchSource:0}: Error finding container 70685b0634724ff17c32d61620752aef3941452effb765a2f24f8525425c27e7: Status 404 returned error can't find the container with id 70685b0634724ff17c32d61620752aef3941452effb765a2f24f8525425c27e7
Jul 09 14:15:49.185961 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:49.185924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592530295952" event={"ID":"84941353-560b-4248-be99-1694f8b96960","Type":"ContainerStarted","Data":"70685b0634724ff17c32d61620752aef3941452effb765a2f24f8525425c27e7"}
Jul 09 14:15:49.187248 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:49.187226    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592534218288"
Jul 09 14:15:49.187396 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:49.187269    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a50f525fe2a39088ea13b891d3ceff73800de9fbafb66d2f59aab9650b0e29b"
Jul 09 14:15:49.198250 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:15:49.198210    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7485-140592534218288\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8" pod="openshift-ingress/test-curl-7485-140592534218288"
Jul 09 14:15:50.194826 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:50.194791    2583 generic.go:356] "Generic (PLEG): container finished" podID="84941353-560b-4248-be99-1694f8b96960" containerID="381236821d6a832fefacb05746706703b5106441fb59148be8123cfc978b9978" exitCode=0
Jul 09 14:15:50.195209 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:50.194880    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592530295952" event={"ID":"84941353-560b-4248-be99-1694f8b96960","Type":"ContainerDied","Data":"381236821d6a832fefacb05746706703b5106441fb59148be8123cfc978b9978"}
Jul 09 14:15:50.214668 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:15:50.214630    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7485-140592534218288\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8" pod="openshift-ingress/test-curl-7485-140592534218288"
Jul 09 14:15:50.317811 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:50.317776    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8" path="/var/lib/kubelet/pods/c8ccd1d1-f2ee-4832-b7d1-4c77149d3bb8/volumes"
Jul 09 14:15:51.357749 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.357722    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:51.380279 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.380252    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7485-140592530295952_84941353-560b-4248-be99-1694f8b96960/test-curl-7485-140592530295952/0.log"
Jul 09 14:15:51.406742 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.406697    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7485-140592530295952"]
Jul 09 14:15:51.409906 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.409881    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7485-140592530295952"]
Jul 09 14:15:51.511779 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.511674    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr585\" (UniqueName: \"kubernetes.io/projected/84941353-560b-4248-be99-1694f8b96960-kube-api-access-sr585\") pod \"84941353-560b-4248-be99-1694f8b96960\" (UID: \"84941353-560b-4248-be99-1694f8b96960\") "
Jul 09 14:15:51.513931 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.513893    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84941353-560b-4248-be99-1694f8b96960-kube-api-access-sr585" (OuterVolumeSpecName: "kube-api-access-sr585") pod "84941353-560b-4248-be99-1694f8b96960" (UID: "84941353-560b-4248-be99-1694f8b96960"). InnerVolumeSpecName "kube-api-access-sr585". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:15:51.545897 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.545862    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7485-140592530295952"]
Jul 09 14:15:51.546355 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.546340    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84941353-560b-4248-be99-1694f8b96960" containerName="test-curl-7485-140592530295952"
Jul 09 14:15:51.546417 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.546356    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="84941353-560b-4248-be99-1694f8b96960" containerName="test-curl-7485-140592530295952"
Jul 09 14:15:51.546504 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.546431    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="84941353-560b-4248-be99-1694f8b96960" containerName="test-curl-7485-140592530295952"
Jul 09 14:15:51.548582 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.548564    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:51.557140 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.557113    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592530295952"]
Jul 09 14:15:51.612729 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.612687    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr585\" (UniqueName: \"kubernetes.io/projected/84941353-560b-4248-be99-1694f8b96960-kube-api-access-sr585\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:15:51.713541 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.713503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5grsx\" (UniqueName: \"kubernetes.io/projected/cfaf7f2d-ac8d-4167-b351-daa84bcb6b83-kube-api-access-5grsx\") pod \"test-curl-7485-140592530295952\" (UID: \"cfaf7f2d-ac8d-4167-b351-daa84bcb6b83\") " pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:51.814660 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.814565    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5grsx\" (UniqueName: \"kubernetes.io/projected/cfaf7f2d-ac8d-4167-b351-daa84bcb6b83-kube-api-access-5grsx\") pod \"test-curl-7485-140592530295952\" (UID: \"cfaf7f2d-ac8d-4167-b351-daa84bcb6b83\") " pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:51.824671 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.824639    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5grsx\" (UniqueName: \"kubernetes.io/projected/cfaf7f2d-ac8d-4167-b351-daa84bcb6b83-kube-api-access-5grsx\") pod \"test-curl-7485-140592530295952\" (UID: \"cfaf7f2d-ac8d-4167-b351-daa84bcb6b83\") " pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:51.858784 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.858747    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:51.998517 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:51.998488    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592530295952"]
Jul 09 14:15:51.999796 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:15:51.999763    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfaf7f2d_ac8d_4167_b351_daa84bcb6b83.slice/crio-725d771cbabbe859cc95f18313789250cca67b0d52c6d2b8bd3350ee9d499697 WatchSource:0}: Error finding container 725d771cbabbe859cc95f18313789250cca67b0d52c6d2b8bd3350ee9d499697: Status 404 returned error can't find the container with id 725d771cbabbe859cc95f18313789250cca67b0d52c6d2b8bd3350ee9d499697
Jul 09 14:15:52.210733 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:52.210702    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:52.210913 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:52.210736    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70685b0634724ff17c32d61620752aef3941452effb765a2f24f8525425c27e7"
Jul 09 14:15:52.212111 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:52.212084    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592530295952" event={"ID":"cfaf7f2d-ac8d-4167-b351-daa84bcb6b83","Type":"ContainerStarted","Data":"725d771cbabbe859cc95f18313789250cca67b0d52c6d2b8bd3350ee9d499697"}
Jul 09 14:15:52.225199 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:52.225168    2583 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7485-140592530295952" oldPodUID="84941353-560b-4248-be99-1694f8b96960" podUID="cfaf7f2d-ac8d-4167-b351-daa84bcb6b83"
Jul 09 14:15:52.321077 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:52.321046    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84941353-560b-4248-be99-1694f8b96960" path="/var/lib/kubelet/pods/84941353-560b-4248-be99-1694f8b96960/volumes"
Jul 09 14:15:53.220839 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:53.220807    2583 generic.go:356] "Generic (PLEG): container finished" podID="cfaf7f2d-ac8d-4167-b351-daa84bcb6b83" containerID="15bb9fe19260c66c7a4d2e68287ec679b256be0dfd8fafa56094ea74b893d590" exitCode=0
Jul 09 14:15:53.221222 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:53.220898    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592530295952" event={"ID":"cfaf7f2d-ac8d-4167-b351-daa84bcb6b83","Type":"ContainerDied","Data":"15bb9fe19260c66c7a4d2e68287ec679b256be0dfd8fafa56094ea74b893d590"}
Jul 09 14:15:54.374325 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.374301    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:54.400692 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.400666    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7485-140592530295952_cfaf7f2d-ac8d-4167-b351-daa84bcb6b83/test-curl-7485-140592530295952/0.log"
Jul 09 14:15:54.439534 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.439503    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7485-140592530295952"]
Jul 09 14:15:54.441821 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.441800    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7485-140592530295952"]
Jul 09 14:15:54.539225 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.539148    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5grsx\" (UniqueName: \"kubernetes.io/projected/cfaf7f2d-ac8d-4167-b351-daa84bcb6b83-kube-api-access-5grsx\") pod \"cfaf7f2d-ac8d-4167-b351-daa84bcb6b83\" (UID: \"cfaf7f2d-ac8d-4167-b351-daa84bcb6b83\") "
Jul 09 14:15:54.541121 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.541100    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfaf7f2d-ac8d-4167-b351-daa84bcb6b83-kube-api-access-5grsx" (OuterVolumeSpecName: "kube-api-access-5grsx") pod "cfaf7f2d-ac8d-4167-b351-daa84bcb6b83" (UID: "cfaf7f2d-ac8d-4167-b351-daa84bcb6b83"). InnerVolumeSpecName "kube-api-access-5grsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:15:54.639855 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.639823    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5grsx\" (UniqueName: \"kubernetes.io/projected/cfaf7f2d-ac8d-4167-b351-daa84bcb6b83-kube-api-access-5grsx\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:15:54.713413 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.713383    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7485-140592530296528"]
Jul 09 14:15:54.713906 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.713886    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfaf7f2d-ac8d-4167-b351-daa84bcb6b83" containerName="test-curl-7485-140592530295952"
Jul 09 14:15:54.714023 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.713910    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfaf7f2d-ac8d-4167-b351-daa84bcb6b83" containerName="test-curl-7485-140592530295952"
Jul 09 14:15:54.714076 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.714035    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfaf7f2d-ac8d-4167-b351-daa84bcb6b83" containerName="test-curl-7485-140592530295952"
Jul 09 14:15:54.716241 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.716218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:54.725641 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.725614    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592530296528"]
Jul 09 14:15:54.841659 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.841627    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg6vq\" (UniqueName: \"kubernetes.io/projected/b2ad11b3-46bd-4d4c-b3c9-90882b278dd9-kube-api-access-xg6vq\") pod \"test-curl-7485-140592530296528\" (UID: \"b2ad11b3-46bd-4d4c-b3c9-90882b278dd9\") " pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:54.942860 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.942829    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg6vq\" (UniqueName: \"kubernetes.io/projected/b2ad11b3-46bd-4d4c-b3c9-90882b278dd9-kube-api-access-xg6vq\") pod \"test-curl-7485-140592530296528\" (UID: \"b2ad11b3-46bd-4d4c-b3c9-90882b278dd9\") " pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:54.953258 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:54.953225    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg6vq\" (UniqueName: \"kubernetes.io/projected/b2ad11b3-46bd-4d4c-b3c9-90882b278dd9-kube-api-access-xg6vq\") pod \"test-curl-7485-140592530296528\" (UID: \"b2ad11b3-46bd-4d4c-b3c9-90882b278dd9\") " pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:55.026139 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:55.026108    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:55.171228 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:55.171204    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592530296528"]
Jul 09 14:15:55.173400 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:15:55.173366    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2ad11b3_46bd_4d4c_b3c9_90882b278dd9.slice/crio-a87c2af8c646b0dbfa132ba5a4f3b1818c62b0678284a633897a3d2618c27b0a WatchSource:0}: Error finding container a87c2af8c646b0dbfa132ba5a4f3b1818c62b0678284a633897a3d2618c27b0a: Status 404 returned error can't find the container with id a87c2af8c646b0dbfa132ba5a4f3b1818c62b0678284a633897a3d2618c27b0a
Jul 09 14:15:55.234389 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:55.234356    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:55.234389 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:55.234381    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="725d771cbabbe859cc95f18313789250cca67b0d52c6d2b8bd3350ee9d499697"
Jul 09 14:15:55.235603 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:55.235579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592530296528" event={"ID":"b2ad11b3-46bd-4d4c-b3c9-90882b278dd9","Type":"ContainerStarted","Data":"a87c2af8c646b0dbfa132ba5a4f3b1818c62b0678284a633897a3d2618c27b0a"}
Jul 09 14:15:55.245700 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:15:55.245674    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7485-140592530295952\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="cfaf7f2d-ac8d-4167-b351-daa84bcb6b83" pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:56.242904 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:56.242870    2583 generic.go:356] "Generic (PLEG): container finished" podID="b2ad11b3-46bd-4d4c-b3c9-90882b278dd9" containerID="20238d54ec15620ff90989bbc6ed87f4759f507e477429716bb16cc5e48ec7a3" exitCode=0
Jul 09 14:15:56.243376 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:56.242959    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592530296528" event={"ID":"b2ad11b3-46bd-4d4c-b3c9-90882b278dd9","Type":"ContainerDied","Data":"20238d54ec15620ff90989bbc6ed87f4759f507e477429716bb16cc5e48ec7a3"}
Jul 09 14:15:56.245594 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:15:56.245561    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7485-140592530295952\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="cfaf7f2d-ac8d-4167-b351-daa84bcb6b83" pod="openshift-ingress/test-curl-7485-140592530295952"
Jul 09 14:15:56.317312 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:56.317264    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfaf7f2d-ac8d-4167-b351-daa84bcb6b83" path="/var/lib/kubelet/pods/cfaf7f2d-ac8d-4167-b351-daa84bcb6b83/volumes"
Jul 09 14:15:57.398907 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.398878    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:57.423045 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.423017    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7485-140592530296528_b2ad11b3-46bd-4d4c-b3c9-90882b278dd9/test-curl-7485-140592530296528/0.log"
Jul 09 14:15:57.450964 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.450928    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7485-140592530296528"]
Jul 09 14:15:57.455511 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.455482    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7485-140592530296528"]
Jul 09 14:15:57.466967 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.466937    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg6vq\" (UniqueName: \"kubernetes.io/projected/b2ad11b3-46bd-4d4c-b3c9-90882b278dd9-kube-api-access-xg6vq\") pod \"b2ad11b3-46bd-4d4c-b3c9-90882b278dd9\" (UID: \"b2ad11b3-46bd-4d4c-b3c9-90882b278dd9\") "
Jul 09 14:15:57.469052 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.469016    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ad11b3-46bd-4d4c-b3c9-90882b278dd9-kube-api-access-xg6vq" (OuterVolumeSpecName: "kube-api-access-xg6vq") pod "b2ad11b3-46bd-4d4c-b3c9-90882b278dd9" (UID: "b2ad11b3-46bd-4d4c-b3c9-90882b278dd9"). InnerVolumeSpecName "kube-api-access-xg6vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:15:57.567767 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.567732    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg6vq\" (UniqueName: \"kubernetes.io/projected/b2ad11b3-46bd-4d4c-b3c9-90882b278dd9-kube-api-access-xg6vq\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:15:57.583711 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.583678    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7485-140592530296528"]
Jul 09 14:15:57.584149 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.584134    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ad11b3-46bd-4d4c-b3c9-90882b278dd9" containerName="test-curl-7485-140592530296528"
Jul 09 14:15:57.584195 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.584151    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ad11b3-46bd-4d4c-b3c9-90882b278dd9" containerName="test-curl-7485-140592530296528"
Jul 09 14:15:57.584235 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.584216    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2ad11b3-46bd-4d4c-b3c9-90882b278dd9" containerName="test-curl-7485-140592530296528"
Jul 09 14:15:57.586267 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.586249    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:57.594814 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.594789    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592530296528"]
Jul 09 14:15:57.668353 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.668276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f47r\" (UniqueName: \"kubernetes.io/projected/d35f7184-e70f-4c56-965c-2c82f8318777-kube-api-access-2f47r\") pod \"test-curl-7485-140592530296528\" (UID: \"d35f7184-e70f-4c56-965c-2c82f8318777\") " pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:57.769132 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.769087    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f47r\" (UniqueName: \"kubernetes.io/projected/d35f7184-e70f-4c56-965c-2c82f8318777-kube-api-access-2f47r\") pod \"test-curl-7485-140592530296528\" (UID: \"d35f7184-e70f-4c56-965c-2c82f8318777\") " pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:57.779484 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.779454    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f47r\" (UniqueName: \"kubernetes.io/projected/d35f7184-e70f-4c56-965c-2c82f8318777-kube-api-access-2f47r\") pod \"test-curl-7485-140592530296528\" (UID: \"d35f7184-e70f-4c56-965c-2c82f8318777\") " pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:57.896518 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:57.896417    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:58.037927 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:58.037892    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7485-140592530296528"]
Jul 09 14:15:58.039670 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:15:58.039637    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd35f7184_e70f_4c56_965c_2c82f8318777.slice/crio-49f561d62159b4f228bdfc69ca4adfb9eea332006f148376f0c9baaa73957fc6 WatchSource:0}: Error finding container 49f561d62159b4f228bdfc69ca4adfb9eea332006f148376f0c9baaa73957fc6: Status 404 returned error can't find the container with id 49f561d62159b4f228bdfc69ca4adfb9eea332006f148376f0c9baaa73957fc6
Jul 09 14:15:58.256937 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:58.256858    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:15:58.256937 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:58.256892    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a87c2af8c646b0dbfa132ba5a4f3b1818c62b0678284a633897a3d2618c27b0a"
Jul 09 14:15:58.258353 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:58.258321    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592530296528" event={"ID":"d35f7184-e70f-4c56-965c-2c82f8318777","Type":"ContainerStarted","Data":"49f561d62159b4f228bdfc69ca4adfb9eea332006f148376f0c9baaa73957fc6"}
Jul 09 14:15:58.269920 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:58.269891    2583 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7485-140592530296528" oldPodUID="b2ad11b3-46bd-4d4c-b3c9-90882b278dd9" podUID="d35f7184-e70f-4c56-965c-2c82f8318777"
Jul 09 14:15:58.317130 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:58.317098    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ad11b3-46bd-4d4c-b3c9-90882b278dd9" path="/var/lib/kubelet/pods/b2ad11b3-46bd-4d4c-b3c9-90882b278dd9/volumes"
Jul 09 14:15:58.441177 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:58.441146    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:15:58.541679 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:58.541574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:15:59.265595 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:59.265563    2583 generic.go:356] "Generic (PLEG): container finished" podID="d35f7184-e70f-4c56-965c-2c82f8318777" containerID="fd67ca775eaed3414e1a6dd73d44be078d801e13f6fc7349cacb771720437efe" exitCode=0
Jul 09 14:15:59.265781 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:15:59.265655    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7485-140592530296528" event={"ID":"d35f7184-e70f-4c56-965c-2c82f8318777","Type":"ContainerDied","Data":"fd67ca775eaed3414e1a6dd73d44be078d801e13f6fc7349cacb771720437efe"}
Jul 09 14:16:00.013768 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.013727    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"]
Jul 09 14:16:00.014227 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.013971    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768" podUID="0f2dce42-7e5d-4a49-8405-176a5553761e" containerName="cleanup" containerID="cri-o://2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532" gracePeriod=30
Jul 09 14:16:00.018446 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.018410    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"]
Jul 09 14:16:00.018634 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.018613    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq" podUID="6ff6bf1b-0fae-4468-a696-45026a705207" containerName="cleanup" containerID="cri-o://dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018" gracePeriod=30
Jul 09 14:16:00.021216 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.021191    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"]
Jul 09 14:16:00.021409 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.021389    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8" podUID="1236691a-ba78-4ff8-a62c-14dfc20daebb" containerName="cleanup" containerID="cri-o://2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881" gracePeriod=30
Jul 09 14:16:00.428358 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.428329    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:16:00.453916 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.453888    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7485-140592530296528_d35f7184-e70f-4c56-965c-2c82f8318777/test-curl-7485-140592530296528/0.log"
Jul 09 14:16:00.481215 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.481177    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7485-140592530296528"]
Jul 09 14:16:00.485335 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.485306    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7485-140592530296528"]
Jul 09 14:16:00.492882 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.492854    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f47r\" (UniqueName: \"kubernetes.io/projected/d35f7184-e70f-4c56-965c-2c82f8318777-kube-api-access-2f47r\") pod \"d35f7184-e70f-4c56-965c-2c82f8318777\" (UID: \"d35f7184-e70f-4c56-965c-2c82f8318777\") "
Jul 09 14:16:00.494863 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.494838    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d35f7184-e70f-4c56-965c-2c82f8318777-kube-api-access-2f47r" (OuterVolumeSpecName: "kube-api-access-2f47r") pod "d35f7184-e70f-4c56-965c-2c82f8318777" (UID: "d35f7184-e70f-4c56-965c-2c82f8318777"). InnerVolumeSpecName "kube-api-access-2f47r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:16:00.593501 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.593468    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f47r\" (UniqueName: \"kubernetes.io/projected/d35f7184-e70f-4c56-965c-2c82f8318777-kube-api-access-2f47r\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:16:00.748719 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:00.748678    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:01.173318 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:01.173254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:01.278263 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:01.278220    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49f561d62159b4f228bdfc69ca4adfb9eea332006f148376f0c9baaa73957fc6"
Jul 09 14:16:01.278263 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:01.278221    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:16:01.279396 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:01.279358    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:01.288561 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:16:01.288526    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7485-140592530296528\" is forbidden: User \"system:node:ip-10-0-134-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-240.ec2.internal' and this object" podUID="d35f7184-e70f-4c56-965c-2c82f8318777" pod="openshift-ingress/test-curl-7485-140592530296528"
Jul 09 14:16:01.371857 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:01.371827    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:01.943142 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:01.943075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:02.317651 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:02.317616    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d35f7184-e70f-4c56-965c-2c82f8318777" path="/var/lib/kubelet/pods/d35f7184-e70f-4c56-965c-2c82f8318777/volumes"
Jul 09 14:16:07.778366 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:07.778325    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:09.255782 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:09.255744    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:09.329165 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:09.329131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:09.408231 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:09.408201    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:09.581268 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:09.581236    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:09.685280 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:09.685245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:09.848173 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:09.848091    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"]
Jul 09 14:16:09.848369 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:09.848345    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57" podUID="5c336b2b-6161-4ef5-bb48-351d33c8bb91" containerName="maas-api" containerID="cri-o://1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460" gracePeriod=30
Jul 09 14:16:09.878919 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:09.878893    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:10.104085 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.104031    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:16:10.168249 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.168199    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c336b2b-6161-4ef5-bb48-351d33c8bb91-openshift-service-ca\") pod \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") "
Jul 09 14:16:10.168473 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.168275    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjqfm\" (UniqueName: \"kubernetes.io/projected/5c336b2b-6161-4ef5-bb48-351d33c8bb91-kube-api-access-gjqfm\") pod \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") "
Jul 09 14:16:10.168473 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.168377    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c336b2b-6161-4ef5-bb48-351d33c8bb91-maas-api-tls\") pod \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\" (UID: \"5c336b2b-6161-4ef5-bb48-351d33c8bb91\") "
Jul 09 14:16:10.168593 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.168570    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c336b2b-6161-4ef5-bb48-351d33c8bb91-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5c336b2b-6161-4ef5-bb48-351d33c8bb91" (UID: "5c336b2b-6161-4ef5-bb48-351d33c8bb91"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:16:10.168668 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.168654    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c336b2b-6161-4ef5-bb48-351d33c8bb91-openshift-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:16:10.170475 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.170446    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c336b2b-6161-4ef5-bb48-351d33c8bb91-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5c336b2b-6161-4ef5-bb48-351d33c8bb91" (UID: "5c336b2b-6161-4ef5-bb48-351d33c8bb91"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:16:10.170475 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.170453    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c336b2b-6161-4ef5-bb48-351d33c8bb91-kube-api-access-gjqfm" (OuterVolumeSpecName: "kube-api-access-gjqfm") pod "5c336b2b-6161-4ef5-bb48-351d33c8bb91" (UID: "5c336b2b-6161-4ef5-bb48-351d33c8bb91"). InnerVolumeSpecName "kube-api-access-gjqfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:16:10.276039 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.270482    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjqfm\" (UniqueName: \"kubernetes.io/projected/5c336b2b-6161-4ef5-bb48-351d33c8bb91-kube-api-access-gjqfm\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:16:10.276039 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.270523    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c336b2b-6161-4ef5-bb48-351d33c8bb91-maas-api-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:16:10.336384 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.336355    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c336b2b-6161-4ef5-bb48-351d33c8bb91" containerID="1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460" exitCode=0
Jul 09 14:16:10.336541 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.336421    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"
Jul 09 14:16:10.336541 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.336448    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57" event={"ID":"5c336b2b-6161-4ef5-bb48-351d33c8bb91","Type":"ContainerDied","Data":"1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460"}
Jul 09 14:16:10.336541 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.336503    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57" event={"ID":"5c336b2b-6161-4ef5-bb48-351d33c8bb91","Type":"ContainerDied","Data":"bd1e2caef4a6cb840724894365060fcc89fb03d0abdb313075aad56dedcf846c"}
Jul 09 14:16:10.336541 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.336525    2583 scope.go:117] "RemoveContainer" containerID="1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460"
Jul 09 14:16:10.349138 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.349119    2583 scope.go:117] "RemoveContainer" containerID="1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460"
Jul 09 14:16:10.349417 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:16:10.349397    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460\": container with ID starting with 1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460 not found: ID does not exist" containerID="1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460"
Jul 09 14:16:10.349495 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.349426    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460"} err="failed to get container status \"1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460\": rpc error: code = NotFound desc = could not find container \"1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460\": container with ID starting with 1b430467434da3727d99595c8e205e3d169a114033b2d5b880ef38f3ca3a5460 not found: ID does not exist"
Jul 09 14:16:10.360024 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.359969    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"]
Jul 09 14:16:10.366593 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:10.366574    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-6ee5b0-959598c56-jwn57"]
Jul 09 14:16:12.318617 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:12.318577    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c336b2b-6161-4ef5-bb48-351d33c8bb91" path="/var/lib/kubelet/pods/5c336b2b-6161-4ef5-bb48-351d33c8bb91/volumes"
Jul 09 14:16:16.034556 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:16.034512    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:16.621369 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:16.621337    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:16.724093 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:16.724059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:22.278605 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:22.278573    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8gxwv_6dcf11a0-f201-4672-b7d4-1c0847231cb9/manager/0.log"
Jul 09 14:16:22.392896 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:22.392864    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bmlj4_08e89e60-e816-458d-8517-66871f3bfc4a/manager/0.log"
Jul 09 14:16:22.519299 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:22.519266    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7dcf598fd9-bnlbc_0658267e-0c0e-43d9-ae2a-b4369d84ae26/manager/0.log"
Jul 09 14:16:22.642727 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:22.642701    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ph8qg_79b5baa7-61dd-4739-b8cd-be09a44f2d10/server/0.log"
Jul 09 14:16:23.163835 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:23.163803    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm_3f7e01ed-38a7-4bb2-a4df-faad63d17b65/copy-manifests/0.log"
Jul 09 14:16:23.171975 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:23.171952    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm_3f7e01ed-38a7-4bb2-a4df-faad63d17b65/manager/0.log"
Jul 09 14:16:23.530945 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:23.530864    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5f8bfdccf8-kkm96_36ef458a-2021-4097-a8dc-1fd8a31235ed/maas-api/0.log"
Jul 09 14:16:23.650471 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:23.650438    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29726775-2f2q8_1236691a-ba78-4ff8-a62c-14dfc20daebb/cleanup/0.log"
Jul 09 14:16:23.769654 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:23.769625    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768_0f2dce42-7e5d-4a49-8405-176a5553761e/cleanup/0.log"
Jul 09 14:16:23.883694 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:23.883665    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq_6ff6bf1b-0fae-4468-a696-45026a705207/cleanup/0.log"
Jul 09 14:16:24.005191 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:24.005145    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dxvrc_75920b48-6248-4f33-94c3-1b67a9062e08/postgres/0.log"
Jul 09 14:16:24.817348 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:24.817319    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb_b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc/util/0.log"
Jul 09 14:16:24.833239 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:24.833214    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb_b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc/pull/0.log"
Jul 09 14:16:24.849352 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:24.849313    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb_b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc/extract/0.log"
Jul 09 14:16:24.967900 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:24.967860    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz_8f27d364-6479-4411-a22b-1129e2031e91/util/0.log"
Jul 09 14:16:24.982309 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:24.982238    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz_8f27d364-6479-4411-a22b-1129e2031e91/pull/0.log"
Jul 09 14:16:24.991860 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:24.991823    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz_8f27d364-6479-4411-a22b-1129e2031e91/extract/0.log"
Jul 09 14:16:25.108968 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:25.108883    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq_e8e40cc8-dcec-4388-a499-8b82085c36c4/util/0.log"
Jul 09 14:16:25.121324 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:25.121275    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq_e8e40cc8-dcec-4388-a499-8b82085c36c4/pull/0.log"
Jul 09 14:16:25.131953 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:25.131934    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq_e8e40cc8-dcec-4388-a499-8b82085c36c4/extract/0.log"
Jul 09 14:16:25.249964 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:25.249936    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg_b7c67634-104a-46ba-aef4-32c56dd64b43/pull/0.log"
Jul 09 14:16:25.258914 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:25.258892    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg_b7c67634-104a-46ba-aef4-32c56dd64b43/extract/0.log"
Jul 09 14:16:25.267360 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:25.267333    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg_b7c67634-104a-46ba-aef4-32c56dd64b43/util/0.log"
Jul 09 14:16:25.524082 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:25.523996    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v9t7g_0ddea29b-72b0-4669-a363-62b7e786b4b3/manager/0.log"
Jul 09 14:16:25.646564 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:25.646535    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f4wtm_b82707ff-8fdc-4ee2-afb4-f0635798c389/manager/0.log"
Jul 09 14:16:25.882211 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:25.882181    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fvxcb_c2b56922-1032-4c58-b2d8-48f2e0c6d661/registry-server/0.log"
Jul 09 14:16:26.012855 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:26.012826    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zfbzx_721f1f3f-8136-4b3d-896d-e9247bb9fb4d/manager/0.log"
Jul 09 14:16:26.266262 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:26.266161    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g46sm_acd837cc-ca7e-4d03-aa2d-cef42f9d6db9/manager/0.log"
Jul 09 14:16:26.994074 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:26.994042    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b96d9fb58-s67nh_092483ae-8d38-4d82-98da-3d558bd93d69/kube-auth-proxy/0.log"
Jul 09 14:16:27.241974 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:27.241944    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7rpv6_033da714-f9f7-4faf-8747-2070d82cdce8/payload-pre-processing/0.log"
Jul 09 14:16:27.481844 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:27.481818    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4d4669b9-5pg7f_e5262aa7-786a-42c6-9e5b-274756d292b0/router/0.log"
Jul 09 14:16:27.847192 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:27.847162    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-bbtg8_f78311b8-933f-43a9-81b7-01f7b2f6e73d/main/0.log"
Jul 09 14:16:28.081091 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:28.081058    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-krf6g_6e143118-fe97-472b-838e-1621bbebd144/main/0.log"
Jul 09 14:16:28.337258 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:28.337229    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xmz6n_4a72915d-4606-4cd0-ae46-aaea655fd6b9/main/0.log"
Jul 09 14:16:29.367296 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:29.367260    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:30.228376 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.228342    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"
Jul 09 14:16:30.254636 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.254609    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"
Jul 09 14:16:30.279487 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.279462    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"
Jul 09 14:16:30.344990 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.344959    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shw6x\" (UniqueName: \"kubernetes.io/projected/0f2dce42-7e5d-4a49-8405-176a5553761e-kube-api-access-shw6x\") pod \"0f2dce42-7e5d-4a49-8405-176a5553761e\" (UID: \"0f2dce42-7e5d-4a49-8405-176a5553761e\") "
Jul 09 14:16:30.345169 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.345018    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvngf\" (UniqueName: \"kubernetes.io/projected/1236691a-ba78-4ff8-a62c-14dfc20daebb-kube-api-access-mvngf\") pod \"1236691a-ba78-4ff8-a62c-14dfc20daebb\" (UID: \"1236691a-ba78-4ff8-a62c-14dfc20daebb\") "
Jul 09 14:16:30.345169 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.345051    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8tb7\" (UniqueName: \"kubernetes.io/projected/6ff6bf1b-0fae-4468-a696-45026a705207-kube-api-access-d8tb7\") pod \"6ff6bf1b-0fae-4468-a696-45026a705207\" (UID: \"6ff6bf1b-0fae-4468-a696-45026a705207\") "
Jul 09 14:16:30.347097 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.347066    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f2dce42-7e5d-4a49-8405-176a5553761e-kube-api-access-shw6x" (OuterVolumeSpecName: "kube-api-access-shw6x") pod "0f2dce42-7e5d-4a49-8405-176a5553761e" (UID: "0f2dce42-7e5d-4a49-8405-176a5553761e"). InnerVolumeSpecName "kube-api-access-shw6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:16:30.347097 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.347082    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff6bf1b-0fae-4468-a696-45026a705207-kube-api-access-d8tb7" (OuterVolumeSpecName: "kube-api-access-d8tb7") pod "6ff6bf1b-0fae-4468-a696-45026a705207" (UID: "6ff6bf1b-0fae-4468-a696-45026a705207"). InnerVolumeSpecName "kube-api-access-d8tb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:16:30.347258 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.347088    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1236691a-ba78-4ff8-a62c-14dfc20daebb-kube-api-access-mvngf" (OuterVolumeSpecName: "kube-api-access-mvngf") pod "1236691a-ba78-4ff8-a62c-14dfc20daebb" (UID: "1236691a-ba78-4ff8-a62c-14dfc20daebb"). InnerVolumeSpecName "kube-api-access-mvngf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:16:30.446745 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.446711    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shw6x\" (UniqueName: \"kubernetes.io/projected/0f2dce42-7e5d-4a49-8405-176a5553761e-kube-api-access-shw6x\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:16:30.446745 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.446745    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvngf\" (UniqueName: \"kubernetes.io/projected/1236691a-ba78-4ff8-a62c-14dfc20daebb-kube-api-access-mvngf\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:16:30.446745 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.446759    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8tb7\" (UniqueName: \"kubernetes.io/projected/6ff6bf1b-0fae-4468-a696-45026a705207-kube-api-access-d8tb7\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\""
Jul 09 14:16:30.451185 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.451157    2583 generic.go:356] "Generic (PLEG): container finished" podID="1236691a-ba78-4ff8-a62c-14dfc20daebb" containerID="2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881" exitCode=137
Jul 09 14:16:30.451349 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.451206    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"
Jul 09 14:16:30.451349 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.451235    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8" event={"ID":"1236691a-ba78-4ff8-a62c-14dfc20daebb","Type":"ContainerDied","Data":"2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881"}
Jul 09 14:16:30.451349 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.451302    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8" event={"ID":"1236691a-ba78-4ff8-a62c-14dfc20daebb","Type":"ContainerDied","Data":"8fb755476ffe9c2ab8f5952fc52bad28279d798c62fb50ce69c3ccdd330f2e85"}
Jul 09 14:16:30.451349 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.451334    2583 scope.go:117] "RemoveContainer" containerID="2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881"
Jul 09 14:16:30.455496 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.455313    2583 generic.go:356] "Generic (PLEG): container finished" podID="6ff6bf1b-0fae-4468-a696-45026a705207" containerID="dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018" exitCode=137
Jul 09 14:16:30.455571 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.455503    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq" event={"ID":"6ff6bf1b-0fae-4468-a696-45026a705207","Type":"ContainerDied","Data":"dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018"}
Jul 09 14:16:30.455571 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.455549    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"
Jul 09 14:16:30.455681 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.455594    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq" event={"ID":"6ff6bf1b-0fae-4468-a696-45026a705207","Type":"ContainerDied","Data":"8664cfd1e3b5434ed1486a098908513b2f9d534e204b8011957d3863c45f854f"}
Jul 09 14:16:30.462925 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.462899    2583 generic.go:356] "Generic (PLEG): container finished" podID="0f2dce42-7e5d-4a49-8405-176a5553761e" containerID="2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532" exitCode=137
Jul 09 14:16:30.463148 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.462950    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"
Jul 09 14:16:30.463234 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.462968    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768" event={"ID":"0f2dce42-7e5d-4a49-8405-176a5553761e","Type":"ContainerDied","Data":"2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532"}
Jul 09 14:16:30.463331 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.463268    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768" event={"ID":"0f2dce42-7e5d-4a49-8405-176a5553761e","Type":"ContainerDied","Data":"cade62b4be0b41262e01b5561aa7fedf31d8da17de20a6a356d0c41ae9989aee"}
Jul 09 14:16:30.467765 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.467740    2583 scope.go:117] "RemoveContainer" containerID="2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881"
Jul 09 14:16:30.468064 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:16:30.468038    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881\": container with ID starting with 2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881 not found: ID does not exist" containerID="2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881"
Jul 09 14:16:30.468144 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.468076    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881"} err="failed to get container status \"2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881\": rpc error: code = NotFound desc = could not find container \"2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881\": container with ID starting with 2ea46119134482dfbebcc819ccbad1b6b46cf8236355f1d32e671ae8bbf75881 not found: ID does not exist"
Jul 09 14:16:30.468144 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.468099    2583 scope.go:117] "RemoveContainer" containerID="dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018"
Jul 09 14:16:30.477534 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.477519    2583 scope.go:117] "RemoveContainer" containerID="dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018"
Jul 09 14:16:30.477762 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:16:30.477741    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018\": container with ID starting with dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018 not found: ID does not exist" containerID="dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018"
Jul 09 14:16:30.477823 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.477766    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018"} err="failed to get container status \"dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018\": rpc error: code = NotFound desc = could not find container \"dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018\": container with ID starting with dd96d6343028763c53d0b24bc1925fb7d4c1d4e0953a716271399696fd40d018 not found: ID does not exist"
Jul 09 14:16:30.477823 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.477780    2583 scope.go:117] "RemoveContainer" containerID="2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532"
Jul 09 14:16:30.483090 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.483070    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"]
Jul 09 14:16:30.486610 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.486588    2583 scope.go:117] "RemoveContainer" containerID="2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532"
Jul 09 14:16:30.486879 ip-10-0-134-240 kubenswrapper[2583]: E0709 14:16:30.486862    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532\": container with ID starting with 2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532 not found: ID does not exist" containerID="2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532"
Jul 09 14:16:30.486949 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.486884    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532"} err="failed to get container status \"2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532\": rpc error: code = NotFound desc = could not find container \"2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532\": container with ID starting with 2e2530a01e6d8551cd0ad85ef6ef049c34fc2f199888882f1e913c8bff0fe532 not found: ID does not exist"
Jul 09 14:16:30.487156 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.487140    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-2f2q8"]
Jul 09 14:16:30.498511 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.498489    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"]
Jul 09 14:16:30.502988 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.502969    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6ee5b0-29726775-kmllq"]
Jul 09 14:16:30.515497 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.515475    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"]
Jul 09 14:16:30.517598 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:30.517580    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-06548f-29726775-7n768"]
Jul 09 14:16:32.316444 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.316413    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f2dce42-7e5d-4a49-8405-176a5553761e" path="/var/lib/kubelet/pods/0f2dce42-7e5d-4a49-8405-176a5553761e/volumes"
Jul 09 14:16:32.316853 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.316764    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1236691a-ba78-4ff8-a62c-14dfc20daebb" path="/var/lib/kubelet/pods/1236691a-ba78-4ff8-a62c-14dfc20daebb/volumes"
Jul 09 14:16:32.317043 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.317031    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff6bf1b-0fae-4468-a696-45026a705207" path="/var/lib/kubelet/pods/6ff6bf1b-0fae-4468-a696-45026a705207/volumes"
Jul 09 14:16:32.681033 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.680953    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-snslw/must-gather-dvclg"]
Jul 09 14:16:32.681430 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681413    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f2dce42-7e5d-4a49-8405-176a5553761e" containerName="cleanup"
Jul 09 14:16:32.681490 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681434    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f2dce42-7e5d-4a49-8405-176a5553761e" containerName="cleanup"
Jul 09 14:16:32.681490 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681452    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d35f7184-e70f-4c56-965c-2c82f8318777" containerName="test-curl-7485-140592530296528"
Jul 09 14:16:32.681490 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681460    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d35f7184-e70f-4c56-965c-2c82f8318777" containerName="test-curl-7485-140592530296528"
Jul 09 14:16:32.681490 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681468    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1236691a-ba78-4ff8-a62c-14dfc20daebb" containerName="cleanup"
Jul 09 14:16:32.681490 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681473    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1236691a-ba78-4ff8-a62c-14dfc20daebb" containerName="cleanup"
Jul 09 14:16:32.681490 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681481    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff6bf1b-0fae-4468-a696-45026a705207" containerName="cleanup"
Jul 09 14:16:32.681490 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681488    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff6bf1b-0fae-4468-a696-45026a705207" containerName="cleanup"
Jul 09 14:16:32.681718 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681499    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c336b2b-6161-4ef5-bb48-351d33c8bb91" containerName="maas-api"
Jul 09 14:16:32.681718 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681507    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c336b2b-6161-4ef5-bb48-351d33c8bb91" containerName="maas-api"
Jul 09 14:16:32.681718 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681576    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff6bf1b-0fae-4468-a696-45026a705207" containerName="cleanup"
Jul 09 14:16:32.681718 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681591    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c336b2b-6161-4ef5-bb48-351d33c8bb91" containerName="maas-api"
Jul 09 14:16:32.681718 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681599    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1236691a-ba78-4ff8-a62c-14dfc20daebb" containerName="cleanup"
Jul 09 14:16:32.681718 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681606    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d35f7184-e70f-4c56-965c-2c82f8318777" containerName="test-curl-7485-140592530296528"
Jul 09 14:16:32.681718 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.681613    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f2dce42-7e5d-4a49-8405-176a5553761e" containerName="cleanup"
Jul 09 14:16:32.684656 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.684630    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:32.684944 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.684926    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-snslw/must-gather-dvclg"
Jul 09 14:16:32.687658 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.687637    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-snslw\"/\"kube-root-ca.crt\""
Jul 09 14:16:32.687658 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.687652    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-snslw\"/\"openshift-service-ca.crt\""
Jul 09 14:16:32.687792 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.687681    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-snslw\"/\"default-dockercfg-x9wk4\""
Jul 09 14:16:32.694527 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.694508    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-snslw/must-gather-dvclg"]
Jul 09 14:16:32.764379 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.764347    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0c1358de-5a09-4715-bc6d-71a7e2419870-must-gather-output\") pod \"must-gather-dvclg\" (UID: \"0c1358de-5a09-4715-bc6d-71a7e2419870\") " pod="openshift-must-gather-snslw/must-gather-dvclg"
Jul 09 14:16:32.764534 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.764388    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v9bl\" (UniqueName: \"kubernetes.io/projected/0c1358de-5a09-4715-bc6d-71a7e2419870-kube-api-access-2v9bl\") pod \"must-gather-dvclg\" (UID: \"0c1358de-5a09-4715-bc6d-71a7e2419870\") " pod="openshift-must-gather-snslw/must-gather-dvclg"
Jul 09 14:16:32.864896 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.864850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0c1358de-5a09-4715-bc6d-71a7e2419870-must-gather-output\") pod \"must-gather-dvclg\" (UID: \"0c1358de-5a09-4715-bc6d-71a7e2419870\") " pod="openshift-must-gather-snslw/must-gather-dvclg"
Jul 09 14:16:32.864896 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.864899    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v9bl\" (UniqueName: \"kubernetes.io/projected/0c1358de-5a09-4715-bc6d-71a7e2419870-kube-api-access-2v9bl\") pod \"must-gather-dvclg\" (UID: \"0c1358de-5a09-4715-bc6d-71a7e2419870\") " pod="openshift-must-gather-snslw/must-gather-dvclg"
Jul 09 14:16:32.865204 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.865186    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0c1358de-5a09-4715-bc6d-71a7e2419870-must-gather-output\") pod \"must-gather-dvclg\" (UID: \"0c1358de-5a09-4715-bc6d-71a7e2419870\") " pod="openshift-must-gather-snslw/must-gather-dvclg"
Jul 09 14:16:32.873946 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.873915    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v9bl\" (UniqueName: \"kubernetes.io/projected/0c1358de-5a09-4715-bc6d-71a7e2419870-kube-api-access-2v9bl\") pod \"must-gather-dvclg\" (UID: \"0c1358de-5a09-4715-bc6d-71a7e2419870\") " pod="openshift-must-gather-snslw/must-gather-dvclg"
Jul 09 14:16:32.994799 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:32.994697    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-snslw/must-gather-dvclg"
Jul 09 14:16:33.130209 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:33.130180    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-snslw/must-gather-dvclg"]
Jul 09 14:16:33.131991 ip-10-0-134-240 kubenswrapper[2583]: W0709 14:16:33.131965    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c1358de_5a09_4715_bc6d_71a7e2419870.slice/crio-7a58a340c030fd2702f93802bba246cedf7b47b164d24fccc7890e115150911e WatchSource:0}: Error finding container 7a58a340c030fd2702f93802bba246cedf7b47b164d24fccc7890e115150911e: Status 404 returned error can't find the container with id 7a58a340c030fd2702f93802bba246cedf7b47b164d24fccc7890e115150911e
Jul 09 14:16:33.357111 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:33.357076    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:33.484786 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:33.484752    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-snslw/must-gather-dvclg" event={"ID":"0c1358de-5a09-4715-bc6d-71a7e2419870","Type":"ContainerStarted","Data":"7a58a340c030fd2702f93802bba246cedf7b47b164d24fccc7890e115150911e"}
Jul 09 14:16:37.509791 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:37.509748    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-snslw/must-gather-dvclg" event={"ID":"0c1358de-5a09-4715-bc6d-71a7e2419870","Type":"ContainerStarted","Data":"1f25375ca3349811446a8a608676d993c830fba187ae31071162691350886539"}
Jul 09 14:16:37.510166 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:37.509806    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-snslw/must-gather-dvclg" event={"ID":"0c1358de-5a09-4715-bc6d-71a7e2419870","Type":"ContainerStarted","Data":"ee2abaacc429ae8d387c8bec6f10ab8566648e0999cad221950fb0ce0f56076b"}
Jul 09 14:16:37.529785 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:37.529722    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-snslw/must-gather-dvclg" podStartSLOduration=1.686405398 podStartE2EDuration="5.529701294s" totalImagesPullingTime="3.843295896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:16:37.526399692 +0000 UTC m=+2843.738390133" watchObservedRunningTime="2026-07-09 14:16:37.529701294 +0000 UTC m=+2843.741691719"
Jul 09 14:16:38.757067 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:38.757030    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p74l4_fa325c9d-9516-4389-9b8c-b2727a6724b7/global-pull-secret-syncer/0.log"
Jul 09 14:16:38.820629 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:38.820596    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log"
Jul 09 14:16:38.960072 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:38.960042    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-240.ec2.internal_c553ed147be170fceaedd3bc0f04636c/haproxy/0.log"
Jul 09 14:16:43.164997 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.164913    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb_b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc/extract/0.log"
Jul 09 14:16:43.196651 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.196625    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb_b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc/util/0.log"
Jul 09 14:16:43.224831 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.224801    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596zrrb_b02a7d2b-e228-4ab0-a993-1ff9f65b5ffc/pull/0.log"
Jul 09 14:16:43.258777 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.258688    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz_8f27d364-6479-4411-a22b-1129e2031e91/extract/0.log"
Jul 09 14:16:43.284780 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.284752    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz_8f27d364-6479-4411-a22b-1129e2031e91/util/0.log"
Jul 09 14:16:43.314138 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.314104    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mzxmz_8f27d364-6479-4411-a22b-1129e2031e91/pull/0.log"
Jul 09 14:16:43.351520 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.351484    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq_e8e40cc8-dcec-4388-a499-8b82085c36c4/extract/0.log"
Jul 09 14:16:43.379031 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.379007    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq_e8e40cc8-dcec-4388-a499-8b82085c36c4/util/0.log"
Jul 09 14:16:43.413583 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.413543    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfsrq_e8e40cc8-dcec-4388-a499-8b82085c36c4/pull/0.log"
Jul 09 14:16:43.448121 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.447953    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg_b7c67634-104a-46ba-aef4-32c56dd64b43/extract/0.log"
Jul 09 14:16:43.475727 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.475699    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg_b7c67634-104a-46ba-aef4-32c56dd64b43/util/0.log"
Jul 09 14:16:43.502876 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.502825    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tm2cg_b7c67634-104a-46ba-aef4-32c56dd64b43/pull/0.log"
Jul 09 14:16:43.873023 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.872987    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-v9t7g_0ddea29b-72b0-4669-a363-62b7e786b4b3/manager/0.log"
Jul 09 14:16:43.898799 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.898744    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:43.935527 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.935480    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-f4wtm_b82707ff-8fdc-4ee2-afb4-f0635798c389/manager/0.log"
Jul 09 14:16:43.993335 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:43.993258    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:44.039701 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:44.039669    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fvxcb_c2b56922-1032-4c58-b2d8-48f2e0c6d661/registry-server/0.log"
Jul 09 14:16:44.236115 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:44.235855    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zfbzx_721f1f3f-8136-4b3d-896d-e9247bb9fb4d/manager/0.log"
Jul 09 14:16:44.358562 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:44.358527    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g46sm_acd837cc-ca7e-4d03-aa2d-cef42f9d6db9/manager/0.log"
Jul 09 14:16:45.528477 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:45.528437    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fgk2q_c1df3745-9cba-4b05-a2dc-2d5a2d2c3c01/konnectivity-agent/0.log" limit=1024
Jul 09 14:16:46.454002 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:46.453920    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-wnkbv_b85f6197-0a67-4802-925c-fde765d61fd9/cluster-monitoring-operator/0.log"
Jul 09 14:16:46.705397 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:46.705324    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-62xtx_20522500-0260-43bd-b3a0-b5a199fa0aa3/node-exporter/0.log"
Jul 09 14:16:46.736458 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:46.736424    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-62xtx_20522500-0260-43bd-b3a0-b5a199fa0aa3/kube-rbac-proxy/0.log"
Jul 09 14:16:46.765654 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:46.765624    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-62xtx_20522500-0260-43bd-b3a0-b5a199fa0aa3/init-textfile/0.log"
Jul 09 14:16:48.919966 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:48.919930    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"]
Jul 09 14:16:48.925505 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:48.925477    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:48.930453 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:48.930431    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"]
Jul 09 14:16:48.950946 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:48.950897    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-lib-modules\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:48.951134 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:48.951020    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-proc\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:48.951134 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:48.951054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn72w\" (UniqueName: \"kubernetes.io/projected/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-kube-api-access-hn72w\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:48.951134 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:48.951084    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-podres\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:48.951335 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:48.951134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-sys\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.051810 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.051769    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-proc\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.051810 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.051810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn72w\" (UniqueName: \"kubernetes.io/projected/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-kube-api-access-hn72w\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.052068 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.051831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-podres\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.052068 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.051878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-sys\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.052068 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.051910    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-proc\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.052068 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.051961    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-sys\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.052068 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.051965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-lib-modules\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.052068 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.052031    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-podres\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.052421 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.052183    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-lib-modules\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.061961 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.061928    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn72w\" (UniqueName: \"kubernetes.io/projected/0c192c7f-dd66-4dd7-93f1-2d8c52444b02-kube-api-access-hn72w\") pod \"perf-node-gather-daemonset-lxsbj\" (UID: \"0c192c7f-dd66-4dd7-93f1-2d8c52444b02\") " pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.241207 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.241121    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.434454 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.434194    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"]
Jul 09 14:16:49.640366 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.640322    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj" event={"ID":"0c192c7f-dd66-4dd7-93f1-2d8c52444b02","Type":"ContainerStarted","Data":"8b8965c577d5c6cf9c9d8f5cfc56a0a7a5ba6c695ec7762090d41c7653b9c773"}
Jul 09 14:16:49.640672 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.640388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj" event={"ID":"0c192c7f-dd66-4dd7-93f1-2d8c52444b02","Type":"ContainerStarted","Data":"4971a2c2a3f469fe8e2c84c511e4bfb578d17a394a69fc95a7bfeaeb69c3f493"}
Jul 09 14:16:49.640672 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.640555    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:49.659583 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:49.659526    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj" podStartSLOduration=1.6595099960000002 podStartE2EDuration="1.659509996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:16:49.658849236 +0000 UTC m=+2855.870839652" watchObservedRunningTime="2026-07-09 14:16:49.659509996 +0000 UTC m=+2855.871500410"
Jul 09 14:16:50.005766 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:50.005733    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/1.log"
Jul 09 14:16:50.010853 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:50.010826    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-shv5j_d3c0fd25-296e-46fd-9f20-852f09ce4dbd/console-operator/2.log"
Jul 09 14:16:50.558158 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:50.558127    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-hqd9l_bb674bed-3cc6-416c-89c6-ca9f81a2ead1/download-server/0.log"
Jul 09 14:16:51.179053 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:51.179022    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-5nv4r_f0492814-8e2d-489e-8da3-c41296ac13da/volume-data-source-validator/0.log"
Jul 09 14:16:52.294447 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:52.294419    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4p62b_77178ab2-e7c2-4143-aaf3-d12ac523d265/dns/0.log"
Jul 09 14:16:52.327632 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:52.327600    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4p62b_77178ab2-e7c2-4143-aaf3-d12ac523d265/kube-rbac-proxy/0.log"
Jul 09 14:16:52.529841 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:52.529812    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q57s8_3b444150-17be-4f6b-99a1-7dd33396c270/dns-node-resolver/0.log"
Jul 09 14:16:53.137520 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:53.137476    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9ww7d_c64940d7-a293-4b8a-97fe-ddc2be44d36b/node-ca/0.log"
Jul 09 14:16:54.501506 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:54.501477    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b96d9fb58-s67nh_092483ae-8d38-4d82-98da-3d558bd93d69/kube-auth-proxy/0.log"
Jul 09 14:16:54.646232 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:54.646189    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7rpv6_033da714-f9f7-4faf-8747-2070d82cdce8/payload-pre-processing/0.log"
Jul 09 14:16:54.730886 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:54.730853    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4d4669b9-5pg7f_e5262aa7-786a-42c6-9e5b-274756d292b0/router/0.log"
Jul 09 14:16:55.523784 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:55.523749    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w5mx4_214d0c91-8dca-4c29-ad16-0157626106a7/serve-healthcheck-canary/0.log"
Jul 09 14:16:55.662025 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:55.661122    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-snslw/perf-node-gather-daemonset-lxsbj"
Jul 09 14:16:56.056444 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:56.056410    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-wxsmw_16845078-45af-44da-848e-dc714f64b62f/insights-operator/1.log"
Jul 09 14:16:56.056896 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:56.056880    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-wxsmw_16845078-45af-44da-848e-dc714f64b62f/insights-operator/0.log"
Jul 09 14:16:56.165035 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:56.165010    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwk76_fa7ff488-de80-4303-99e5-9d40b905816e/kube-rbac-proxy/0.log"
Jul 09 14:16:56.191917 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:56.191890    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwk76_fa7ff488-de80-4303-99e5-9d40b905816e/exporter/0.log"
Jul 09 14:16:56.217502 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:56.217477    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lwk76_fa7ff488-de80-4303-99e5-9d40b905816e/extractor/0.log"
Jul 09 14:16:58.713707 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:58.713652    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8gxwv_6dcf11a0-f201-4672-b7d4-1c0847231cb9/manager/0.log"
Jul 09 14:16:58.903413 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:58.903383    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bmlj4_08e89e60-e816-458d-8517-66871f3bfc4a/manager/0.log"
Jul 09 14:16:59.037357 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:59.037328    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7dcf598fd9-bnlbc_0658267e-0c0e-43d9-ae2a-b4369d84ae26/manager/0.log"
Jul 09 14:16:59.080322 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:59.080280    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ph8qg_79b5baa7-61dd-4739-b8cd-be09a44f2d10/server/0.log"
Jul 09 14:16:59.323556 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:59.323522    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b96d9fb58-s67nh_092483ae-8d38-4d82-98da-3d558bd93d69/kube-auth-proxy/0.log"
Jul 09 14:16:59.379244 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:59.379156    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm_3f7e01ed-38a7-4bb2-a4df-faad63d17b65/manager/0.log"
Jul 09 14:16:59.410597 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:59.410574    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69bb5d6bf5-jhpbm_3f7e01ed-38a7-4bb2-a4df-faad63d17b65/copy-manifests/0.log"
Jul 09 14:16:59.441152 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:59.441127    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7rpv6_033da714-f9f7-4faf-8747-2070d82cdce8/payload-pre-processing/0.log"
Jul 09 14:16:59.498312 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:16:59.498258    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4d4669b9-5pg7f_e5262aa7-786a-42c6-9e5b-274756d292b0/router/0.log"
Jul 09 14:17:01.177446 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:17:01.177281    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b96d9fb58-s67nh_092483ae-8d38-4d82-98da-3d558bd93d69/kube-auth-proxy/0.log"
Jul 09 14:17:01.299600 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:17:01.299519    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-7rpv6_033da714-f9f7-4faf-8747-2070d82cdce8/payload-pre-processing/0.log"
Jul 09 14:17:01.355775 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:17:01.355746    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4d4669b9-5pg7f_e5262aa7-786a-42c6-9e5b-274756d292b0/router/0.log"
Jul 09 14:17:06.373757 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:17:06.373707    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-kjwvz_f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd/kube-storage-version-migrator-operator/1.log"
Jul 09 14:17:06.374628 ip-10-0-134-240 kubenswrapper[2583]: I0709 14:17:06.374571    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-kjwvz_f70c7e3f-a303-40b9-b0ac-f5cc3cbe61fd/kube-storage-version-migrator-operator/0.log"