Jul 17 15:09:08.222104 ip-10-0-138-239 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.610312    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613638    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613648    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613651    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613655    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613658    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613661    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613663    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 15:09:08.707126 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613666    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 15:09:08.682872 ip-10-0-138-239 systemd[1]: Started Kubernetes Kubelet.
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613668    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613671    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613674    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613677    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613679    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613682    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613685    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613687    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613690    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613692    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613694    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613697    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613700    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613702    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613705    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613710    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613714    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613718    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613720    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 15:09:08.708324 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613723    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613728    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613731    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613733    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613736    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613738    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613741    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613743    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613746    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613748    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613751    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613754    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613756    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613759    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613761    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613764    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613766    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613768    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613771    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 15:09:08.711397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613773    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613775    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613778    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613780    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613782    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613785    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613787    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613790    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613793    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613795    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613798    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613801    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613804    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613806    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613809    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613811    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613813    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613816    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613818    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 15:09:08.712441 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613820    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613823    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613825    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613828    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613830    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613832    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613836    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613838    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613840    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613856    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613859    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613861    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613864    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613866    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613868    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613871    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613873    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613876    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613878    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613881    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613884    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 15:09:08.714815 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613886    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613890    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613892    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613895    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613898    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613900    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613903    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613905    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613909    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613912    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613916    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613919    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.613922    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614575    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614581    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614584    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614587    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614589    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614592    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614595    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 15:09:08.715804 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614598    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614600    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614603    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614606    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614608    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614611    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614613    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614616    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614618    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614621    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614623    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614626    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614628    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614631    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614633    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614636    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614638    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614641    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614643    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614646    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 15:09:08.716917 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614652    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614654    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614657    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614660    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614662    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614665    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614667    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614670    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614672    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614675    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614677    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614680    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614682    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614685    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614687    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614690    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614693    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614695    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614698    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 15:09:08.718175 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614700    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614703    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614705    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614708    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614710    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614712    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614715    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614717    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614720    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614722    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614727    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614731    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614733    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614738    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614740    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614743    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614745    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614747    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614750    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 15:09:08.720284 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614753    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614755    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614758    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614760    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614762    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614765    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614769    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614772    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614775    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614780    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614783    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614786    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614790    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614793    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614795    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614798    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614801    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614803    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614806    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 15:09:08.721142 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614809    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614811    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614813    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614816    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614818    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614821    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614823    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614827    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614829    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614832    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614834    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614837    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614839    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614856    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.614859    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615198    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615203    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615206    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615209    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 15:09:08.724180 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615212    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615214    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615217    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615219    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615221    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615224    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615227    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615229    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615232    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615234    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615237    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615239    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615243    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615246    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615249    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615254    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615258    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615261    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615263    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 15:09:08.725007 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615266    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615271    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615273    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615276    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615279    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615283    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615286    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615289    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615292    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615294    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615297    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615299    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615302    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615304    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615307    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615310    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615312    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615315    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615317    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615319    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 15:09:08.727070 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615322    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615324    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615327    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615329    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615331    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615334    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615336    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615339    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615342    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615345    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615347    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615350    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615352    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615356    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615359    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615361    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615364    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615367    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615370    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615372    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 15:09:08.727635 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615375    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615377    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615380    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615382    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615384    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615387    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615389    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615392    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615394    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615396    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615399    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615401    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615403    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615406    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615408    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615410    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615413    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615415    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615418    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 15:09:08.728202 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615420    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615424    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615426    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615429    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615431    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615433    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615437    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615439    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615442    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615444    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615447    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615449    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615452    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615454    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615456    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615459    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.615461    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615528    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615534    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615544    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615547    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 15:09:08.940352 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615552    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615555    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615559    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615562    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615566    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615568    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615571    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615574    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615577    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615580    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615583    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615586    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615589    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615592    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615596    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615599    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615602    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615606    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615609    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615613    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615616    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615619    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615622    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615625    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 15:09:08.955755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615627    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615630    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615633    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615636    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615639    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615642    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615645    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615648    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615651    2582 flags.go:64] FLAG: --enable-server="true"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615654    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615658    2582 flags.go:64] FLAG: --event-burst="100"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615660    2582 flags.go:64] FLAG: --event-qps="50"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615663    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615666    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615669    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615672    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615675    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615677    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615680    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615683    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615687    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615690    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615692    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615695    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615698    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 15:09:08.957044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615701    2582 flags.go:64] FLAG: --feature-gates=""
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615705    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615708    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615711    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615714    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615717    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615719    2582 flags.go:64] FLAG: --help="false"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615722    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-138-239.ec2.internal"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615725    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615728    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615731    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615734    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615737    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615740    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615742    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615745    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615747    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615750    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615753    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615756    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615759    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615762    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615764    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615767    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 15:09:08.959524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615770    2582 flags.go:64] FLAG: --lock-file=""
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615773    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615775    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615779    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615784    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615787    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615790    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615793    2582 flags.go:64] FLAG: --logging-format="text"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615797    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615800    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615803    2582 flags.go:64] FLAG: --manifest-url=""
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615806    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615810    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615813    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615817    2582 flags.go:64] FLAG: --max-pods="110"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615819    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615822    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615825    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615827    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615830    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615833    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615836    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615859    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615863    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615865    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 15:09:08.960806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615868    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615871    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615877    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615880    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615882    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615885    2582 flags.go:64] FLAG: --port="10250"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615888    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615891    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-007a494e81a110481"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615894    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615897    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615901    2582 flags.go:64] FLAG: --register-node="true"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615903    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615907    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615909    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615912    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615915    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615919    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615922    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615925    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615928    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615930    2582 flags.go:64] FLAG: --runonce="false"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615933    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615936    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615939    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615942    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 15:09:08.963761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615944    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615947    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615950    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615953    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615955    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615958    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615961    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615964    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615967    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615971    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615973    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615978    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615981    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615984    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615988    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615991    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615993    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.615997    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.616000    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.616003    2582 flags.go:64] FLAG: --v="2"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.616007    2582 flags.go:64] FLAG: --version="false"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.616010    2582 flags.go:64] FLAG: --vmodule=""
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.616014    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.616018    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616122    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 15:09:08.964967 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616125    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616128    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616131    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616135    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616139    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616143    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616146    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616149    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616152    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616155    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616158    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616161    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616165    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616168    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616171    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616173    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616176    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616179    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 15:09:08.967680 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616182    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616184    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616186    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616189    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616191    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616194    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616197    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616200    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616202    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616205    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616207    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616210    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616214    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616216    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616219    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616221    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616224    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616226    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616228    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616231    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 15:09:08.968609 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616233    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616237    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616239    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616242    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616244    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616247    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616249    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616252    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616254    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616256    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616259    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616261    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616264    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616267    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616269    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616271    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616274    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616276    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616280    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616283    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 15:09:09.176388 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616285    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616287    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616290    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616292    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616296    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616298    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616301    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616304    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616306    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616309    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616311    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616314    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616316    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616318    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616321    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616324    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616326    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616328    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616331    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616333    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 15:09:09.177333 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616336    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616339    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616341    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616343    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616346    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616349    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616351    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616354    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616356    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616358    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616362    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616364    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616367    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616370    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616372    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616374    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616379    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616381    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616384    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 15:09:09.178018 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.616387    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.617012    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.627425    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.627442    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.627460    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.627466    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627528    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627533    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627536    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627539    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627542    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627544    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627547    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627549    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627552    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 15:09:09.178705 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627554    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627559    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627562    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627566    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627568    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627571    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627574    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627577    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627580    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627583    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627586    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627589    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627592    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627595    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627597    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627600    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627602    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627605    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627607    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 15:09:09.179185 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627609    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627618    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627621    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627623    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627626    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627628    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627631    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627633    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627636    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627638    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627641    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627644    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627646    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627649    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627651    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627654    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627656    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627659    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627661    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627664    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 15:09:09.179802 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627667    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627670    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627672    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627674    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627677    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627679    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627682    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627684    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627687    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627689    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627692    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627694    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627697    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627699    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627707    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627711    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627715    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627718    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627721    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627723    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 15:09:09.180444 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627726    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627729    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627731    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627734    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627736    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627739    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627741    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627744    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627746    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627749    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627751    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627754    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627760    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627763    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627766    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627769    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627771    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627775    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627778    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627780    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 15:09:09.181066 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627783    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627785    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627788    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627790    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627793    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627795    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627798    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627806    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627809    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627811    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627814    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.627819    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627979    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627985    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627988    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 15:09:09.181787 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627991    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627994    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.627997    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628000    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628003    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628005    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628008    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628010    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628014    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628017    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628021    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628023    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628026    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628028    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628034    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628037    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628039    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628042    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628044    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 15:09:09.182231 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628047    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628049    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628052    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628054    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628057    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628059    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628067    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628070    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628072    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628075    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628077    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628080    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628082    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628084    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628087    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628090    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628092    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628095    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628097    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 15:09:09.182737 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628099    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628103    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628106    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628109    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628113    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628116    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628118    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628121    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628124    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628127    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628129    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628132    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628134    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628137    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628139    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628141    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628144    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628146    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628148    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628151    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 15:09:09.183238 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628159    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628162    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628165    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628167    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628169    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628172    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628174    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628177    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628179    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628181    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628184    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628186    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628189    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628191    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628193    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628196    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628200    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628202    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628205    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628207    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 15:09:09.183796 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628211    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628213    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628216    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628218    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628221    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628225    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628229    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628232    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628234    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628237    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628239    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628242    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628244    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628252    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628255    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628258    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628260    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 15:09:09.184335 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:08.628263    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.628267    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.628383    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.631133    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.632348    2582 server.go:1019] "Starting client certificate rotation"
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.632441    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.632910    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.637350    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.640152    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.653980    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.655944    2582 log.go:25] "Validated CRI v1 image API"
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.656650    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 15:09:09.184782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.659341    2582 fs.go:135] Filesystem UUIDs: map[251eb8ed-c92d-45fb-a5d5-2e8e271d82f0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9653e38e-bd4c-42b7-8dac-cc59d125d1b8:/dev/nvme0n1p4]
Jul 17 15:09:09.185143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.659355    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 15:09:09.185143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.660708    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.663672    2582 manager.go:216] Machine: {Timestamp:2026-07-17 15:09:08.663218295 +0000 UTC m=+0.327668390 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3190754 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27d380a7c3d08282b95609738f9ded SystemUUID:ec27d380-a7c3-d082-82b9-5609738f9ded BootID:110abc56-c604-4237-a939-387c307b51ce Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:00:20:35:d6:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:00:20:35:d6:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:07:ae:bb:2e:c5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.663760    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.663827    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.667135    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.667156    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-239.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.667781    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.667790    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.667802    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.667817    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.669016    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.671693    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.671817    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.671841    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.671867    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.671880    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.671890    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.671897    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 15:09:09.185209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.672145    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.672158    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.675586    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677148    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677175    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677679    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677692    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677697    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677702    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677710    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677715    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677828    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677834    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677841    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677862    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677870    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.677877    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.679265    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.679272    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.682105    2582 server.go:1268] "Started kubelet"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.682173    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.682239    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.682178    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.683218    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.683738    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.685755    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.685775    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-239.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.685902    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.689619    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.691614    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hsq6"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.690816    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-239.ec2.internal.18c31c425a968553  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-239.ec2.internal,UID:ip-10-0-138-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-239.ec2.internal,},FirstTimestamp:2026-07-17 15:09:08.682081619 +0000 UTC m=+0.346531714,LastTimestamp:2026-07-17 15:09:08.682081619 +0000 UTC m=+0.346531714,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-239.ec2.internal,}"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.691869    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.691875    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.691933    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692412    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692414    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692585    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692653    2582 factory.go:55] Registering systemd factory
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692668    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692672    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692683    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 15:09:09.185713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692874    2582 factory.go:153] Registering CRI-O factory
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692887    2582 factory.go:223] Registration of the crio container factory successfully
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692935    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692968    2582 factory.go:103] Registering Raw factory
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.692984    2582 manager.go:1196] Started watching for new ooms in manager
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.693386    2582 manager.go:349] Starting recovery of all containers
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.697888    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.698013    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.698818    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9hsq6"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.717059    2582 manager.go:354] Recovery completed
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.729464    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.731231    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.731256    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.731265    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientPID"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.731739    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.731749    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.731755    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.731767    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.732339    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.732356    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.732365    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientPID"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.732917    2582 policy_none.go:49] "None policy: Start"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.732928    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.732937    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.733829    2582 policy_none.go:47] "Start"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.737440    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-239.ec2.internal.18c31c425d84a99b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-239.ec2.internal,UID:ip-10-0-138-239.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-239.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-239.ec2.internal,},FirstTimestamp:2026-07-17 15:09:08.731242907 +0000 UTC m=+0.395693001,LastTimestamp:2026-07-17 15:09:08.731242907 +0000 UTC m=+0.395693001,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-239.ec2.internal,}"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.771329    2582 manager.go:337] "Starting Device Plugin manager"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.771435    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.771445    2582 server.go:87] "Starting device plugin registration server"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.771608    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.771616    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.771699    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.771768    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.771776    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.772169    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.772204    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.871951    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.872642    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 15:09:09.186788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.872667    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.872679    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientPID"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.872707    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.881653    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.881670    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-239.ec2.internal\": node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.896679    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.897798    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.897844    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.897870    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.897907    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.901604    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:08.903826    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.997992    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-239.ec2.internal"]
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:08.998069    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.001877    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.001904    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.001914    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientPID"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.003084    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.003198    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.003223    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.003707    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.003727    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.003735    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.003744    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.003748    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientPID"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.003754    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientPID"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.003930    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.005046    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.005078    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.005712    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.005733    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.005742    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeHasSufficientPID"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.031536    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-239.ec2.internal\" not found" node="ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.036099    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-239.ec2.internal\" not found" node="ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.097894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99e8cbbe054290ef3790809ab0d9cb94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal\" (UID: \"99e8cbbe054290ef3790809ab0d9cb94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.187817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.097914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e8cbbe054290ef3790809ab0d9cb94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal\" (UID: \"99e8cbbe054290ef3790809ab0d9cb94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.188751 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.097941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f114662f8c568f2e1d8877c1f328796-config\") pod \"kube-apiserver-proxy-ip-10-0-138-239.ec2.internal\" (UID: \"2f114662f8c568f2e1d8877c1f328796\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.188751 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.105040    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.199103 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.199085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e8cbbe054290ef3790809ab0d9cb94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal\" (UID: \"99e8cbbe054290ef3790809ab0d9cb94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.199155 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.199110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f114662f8c568f2e1d8877c1f328796-config\") pod \"kube-apiserver-proxy-ip-10-0-138-239.ec2.internal\" (UID: \"2f114662f8c568f2e1d8877c1f328796\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.199155 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.199125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99e8cbbe054290ef3790809ab0d9cb94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal\" (UID: \"99e8cbbe054290ef3790809ab0d9cb94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.199225 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.199161    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99e8cbbe054290ef3790809ab0d9cb94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal\" (UID: \"99e8cbbe054290ef3790809ab0d9cb94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.199225 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.199178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e8cbbe054290ef3790809ab0d9cb94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal\" (UID: \"99e8cbbe054290ef3790809ab0d9cb94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.199225 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.199187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f114662f8c568f2e1d8877c1f328796-config\") pod \"kube-apiserver-proxy-ip-10-0-138-239.ec2.internal\" (UID: \"2f114662f8c568f2e1d8877c1f328796\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.205636 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.205606    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.306430 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.306388    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.334674 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.334647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.339585 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.339572    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:09.407422 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.407401    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.508451 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.508431    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.609052 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.608996    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.632421 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.632402    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 15:09:09.632547 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.632530    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 15:09:09.709282 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.709259    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.715660 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.715636    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 15:04:09 +0000 UTC" deadline="2028-01-06 09:36:15.707433638 +0000 UTC"
Jul 17 15:09:09.715660 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.715657    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12906h27m5.991779079s"
Jul 17 15:09:09.810392 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.810368    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.864606 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:09.864539    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f114662f8c568f2e1d8877c1f328796.slice/crio-e686be41262110a54b80a593d5eb391c94497edf82e9e6982df1f7535f0b902f WatchSource:0}: Error finding container e686be41262110a54b80a593d5eb391c94497edf82e9e6982df1f7535f0b902f: Status 404 returned error can't find the container with id e686be41262110a54b80a593d5eb391c94497edf82e9e6982df1f7535f0b902f
Jul 17 15:09:09.869746 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.869728    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 15:09:09.900806 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.900765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-239.ec2.internal" event={"ID":"2f114662f8c568f2e1d8877c1f328796","Type":"ContainerStarted","Data":"e686be41262110a54b80a593d5eb391c94497edf82e9e6982df1f7535f0b902f"}
Jul 17 15:09:09.910857 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:09.910821    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-239.ec2.internal\" not found"
Jul 17 15:09:09.912740 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.912722    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 15:09:09.969775 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.969756    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 15:09:09.993010 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:09.992989    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:10.008015 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.007996    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 15:09:10.009090 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.009079    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:10.020814 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.020799    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 15:09:10.054509 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.054494    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 15:09:10.675211 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.675179    2582 apiserver.go:52] "Watching apiserver"
Jul 17 15:09:10.685968 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.685938    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 15:09:10.687241 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.687208    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-dbmhn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8","openshift-dns/node-resolver-jqm97","openshift-image-registry/node-ca-ml224","openshift-multus/multus-64fwm","openshift-multus/multus-additional-cni-plugins-r6grj","kube-system/kube-apiserver-proxy-ip-10-0-138-239.ec2.internal","openshift-cluster-node-tuning-operator/tuned-vvx7b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal","openshift-multus/network-metrics-daemon-8xxqp","openshift-network-diagnostics/network-check-target-8kx7g","openshift-network-operator/iptables-alerter-kkxts","openshift-ovn-kubernetes/ovnkube-node-pvtq5","kube-system/global-pull-secret-syncer-pqp8d"]
Jul 17 15:09:10.688600 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.688579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:10.688698 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:10.688655    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:10.690778 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.690757    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.691991 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.691972    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jqm97"
Jul 17 15:09:10.692107 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.692080    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 15:09:10.693239 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.693215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ml224"
Jul 17 15:09:10.693501 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.693476    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 15:09:10.693832 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.693812    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 15:09:10.693911 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.693863    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 15:09:10.693911 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.693890    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 15:09:10.694036 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.693812    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-64lkz\""
Jul 17 15:09:10.695046 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.695025    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 15:09:10.695276 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.695255    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ftzbw\""
Jul 17 15:09:10.695349 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.695300    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 15:09:10.696311 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.695864    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.696311 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.696084    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 15:09:10.696311 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.696208    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 15:09:10.696485 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.696443    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 15:09:10.697392 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.697172    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 15:09:10.698112 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.696371    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.698112 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.697685    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 15:09:10.698302 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.698284    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hnqwq\""
Jul 17 15:09:10.699079 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.698757    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 15:09:10.699174 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.699090    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:10.699227 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:10.699177    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:10.700473 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.700453    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 15:09:10.701130 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.700748    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 15:09:10.701130 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.700758    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qf7qq\""
Jul 17 15:09:10.701130 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.701054    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 15:09:10.701130 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.701065    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 15:09:10.701890 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.701872    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 15:09:10.701890 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.701884    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rsxrx\""
Jul 17 15:09:10.702085 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.702062    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.703686 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.703668    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.704940 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.704912    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:10.705463 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.705444    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 15:09:10.705551 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.705479    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 15:09:10.705612 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.705573    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 15:09:10.705677 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.705625    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b7j7g\""
Jul 17 15:09:10.706352 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.706335    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:10.706439 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:10.706391    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:10.706496 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.706455    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 15:09:10.706770 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.706742    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 15:09:10.706883 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.706782    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 15:09:10.706971 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.706933    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xbs46\""
Jul 17 15:09:10.707682 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.707649    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 15:09:10.707911 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.707890    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kkxts"
Jul 17 15:09:10.708143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.708123    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6shsk\""
Jul 17 15:09:10.708256 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.708235    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 15:09:10.709860 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.709821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-systemd-units\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.709859    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7d86cbc-8f78-4545-ae1c-cea35f949693-ovnkube-config\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.709914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpk4r\" (UniqueName: \"kubernetes.io/projected/6f5da215-d35b-40d3-a7e8-04073e6510e7-kube-api-access-lpk4r\") pod \"node-ca-ml224\" (UID: \"6f5da215-d35b-40d3-a7e8-04073e6510e7\") " pod="openshift-image-registry/node-ca-ml224"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.709999    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710037    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz7fs\" (UniqueName: \"kubernetes.io/projected/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-kube-api-access-lz7fs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-var-lib-openvswitch\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710089    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-etc-openvswitch\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-run-ovn\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-log-socket\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710165    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-cni-bin\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7d86cbc-8f78-4545-ae1c-cea35f949693-env-overrides\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710211    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7d86cbc-8f78-4545-ae1c-cea35f949693-ovn-node-metrics-cert\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f5da215-d35b-40d3-a7e8-04073e6510e7-serviceca\") pod \"node-ca-ml224\" (UID: \"6f5da215-d35b-40d3-a7e8-04073e6510e7\") " pod="openshift-image-registry/node-ca-ml224"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-kubelet\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/21493365-4d8d-4699-967a-59fefc50cc48-hosts-file\") pod \"node-resolver-jqm97\" (UID: \"21493365-4d8d-4699-967a-59fefc50cc48\") " pod="openshift-dns/node-resolver-jqm97"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-run-openvswitch\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.710398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710373    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mrfj\" (UniqueName: \"kubernetes.io/projected/d7d86cbc-8f78-4545-ae1c-cea35f949693-kube-api-access-6mrfj\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n275r\" (UniqueName: \"kubernetes.io/projected/21493365-4d8d-4699-967a-59fefc50cc48-kube-api-access-n275r\") pod \"node-resolver-jqm97\" (UID: \"21493365-4d8d-4699-967a-59fefc50cc48\") " pod="openshift-dns/node-resolver-jqm97"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-run-netns\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710485    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-node-log\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710508    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-cni-netd\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-run-systemd\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21493365-4d8d-4699-967a-59fefc50cc48-tmp-dir\") pod \"node-resolver-jqm97\" (UID: \"21493365-4d8d-4699-967a-59fefc50cc48\") " pod="openshift-dns/node-resolver-jqm97"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710563    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-slash\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710636    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-run-ovn-kubernetes\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710678    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7d86cbc-8f78-4545-ae1c-cea35f949693-ovnkube-script-lib\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710713    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f5da215-d35b-40d3-a7e8-04073e6510e7-host\") pod \"node-ca-ml224\" (UID: \"6f5da215-d35b-40d3-a7e8-04073e6510e7\") " pod="openshift-image-registry/node-ca-ml224"
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.710985    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 15:09:10.711137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.711106    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 15:09:10.711636 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.711199    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-smslg\""
Jul 17 15:09:10.740499 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.740478    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mm5cc"
Jul 17 15:09:10.751673 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.751656    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mm5cc"
Jul 17 15:09:10.793344 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.793321    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 15:09:10.810922 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.810892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-etc-kubernetes\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.811041 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.810935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.811041 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.810961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-hostroot\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.811041 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.810988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:10.811041 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz7fs\" (UniqueName: \"kubernetes.io/projected/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-kube-api-access-lz7fs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:10.811249 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-etc-openvswitch\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.811249 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-cnibin\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.811249 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811153    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-etc-openvswitch\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.811249 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-run-netns\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.811249 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:10.811193    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:10.811249 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7d86cbc-8f78-4545-ae1c-cea35f949693-ovn-node-metrics-cert\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.811546 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:10.811269    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs podName:6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:11.311245569 +0000 UTC m=+2.975695679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs") pod "network-metrics-daemon-8xxqp" (UID: "6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:10.811546 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f5da215-d35b-40d3-a7e8-04073e6510e7-serviceca\") pod \"node-ca-ml224\" (UID: \"6f5da215-d35b-40d3-a7e8-04073e6510e7\") " pod="openshift-image-registry/node-ca-ml224"
Jul 17 15:09:10.811546 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acf2031e-cd00-45d5-8356-40222284359c-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.811546 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-var-lib-kubelet\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.811546 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4wh8\" (UniqueName: \"kubernetes.io/projected/786e60ba-f181-460e-a035-2193c89f3350-kube-api-access-v4wh8\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.811546 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-system-cni-dir\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.811546 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mvr9\" (UniqueName: \"kubernetes.io/projected/8fc89220-a098-4a76-8a2c-af11347ca2b0-kube-api-access-7mvr9\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.811546 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-systemd\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-sys\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811570    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811624    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-tuned\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-run-openvswitch\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mrfj\" (UniqueName: \"kubernetes.io/projected/d7d86cbc-8f78-4545-ae1c-cea35f949693-kube-api-access-6mrfj\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-kubernetes\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-run-netns\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-node-log\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811745    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fc89220-a098-4a76-8a2c-af11347ca2b0-cni-binary-copy\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811744    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-run-openvswitch\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811766    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-system-cni-dir\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j57jd\" (UniqueName: \"kubernetes.io/projected/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-kube-api-access-j57jd\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811805    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-run-netns\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-registration-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811827    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-var-lib-cni-multus\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-lib-modules\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.811964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811868    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-run-multus-certs\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-kubelet-config\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0758be33-496e-4076-a0ea-0aa599cd3acc-agent-certs\") pod \"konnectivity-agent-dbmhn\" (UID: \"0758be33-496e-4076-a0ea-0aa599cd3acc\") " pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.811965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7d86cbc-8f78-4545-ae1c-cea35f949693-ovnkube-config\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-conf-dir\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812027    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-node-log\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2qdb\" (UniqueName: \"kubernetes.io/projected/acf2031e-cd00-45d5-8356-40222284359c-kube-api-access-d2qdb\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-sysconfig\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-var-lib-openvswitch\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-run-ovn\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-log-socket\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-device-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812333    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-socket-dir-parent\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812358    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-log-socket\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812355    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-run-ovn\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812372    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5gqp\" (UniqueName: \"kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp\") pod \"network-check-target-8kx7g\" (UID: \"1a6337dd-e0d3-430e-9575-4ba6f2278cd2\") " pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-os-release\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.812779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-run-k8s-cni-cncf-io\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-var-lib-kubelet\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812494    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f5da215-d35b-40d3-a7e8-04073e6510e7-serviceca\") pod \"node-ca-ml224\" (UID: \"6f5da215-d35b-40d3-a7e8-04073e6510e7\") " pod="openshift-image-registry/node-ca-ml224"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-cni-bin\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7d86cbc-8f78-4545-ae1c-cea35f949693-env-overrides\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812564    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-cni-bin\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd8c0375-ef66-439c-afef-5e3663eec682-host-slash\") pod \"iptables-alerter-kkxts\" (UID: \"fd8c0375-ef66-439c-afef-5e3663eec682\") " pod="openshift-network-operator/iptables-alerter-kkxts"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7d86cbc-8f78-4545-ae1c-cea35f949693-ovnkube-config\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-os-release\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812645    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-dbus\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-kubelet\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/21493365-4d8d-4699-967a-59fefc50cc48-hosts-file\") pod \"node-resolver-jqm97\" (UID: \"21493365-4d8d-4699-967a-59fefc50cc48\") " pod="openshift-dns/node-resolver-jqm97"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812734    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812713    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-kubelet\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-socket-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/21493365-4d8d-4699-967a-59fefc50cc48-hosts-file\") pod \"node-resolver-jqm97\" (UID: \"21493365-4d8d-4699-967a-59fefc50cc48\") " pod="openshift-dns/node-resolver-jqm97"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkc2t\" (UniqueName: \"kubernetes.io/projected/fd8c0375-ef66-439c-afef-5e3663eec682-kube-api-access-wkc2t\") pod \"iptables-alerter-kkxts\" (UID: \"fd8c0375-ef66-439c-afef-5e3663eec682\") " pod="openshift-network-operator/iptables-alerter-kkxts"
Jul 17 15:09:10.813628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812831    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-var-lib-openvswitch\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-cni-dir\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-cnibin\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812951    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-sysctl-conf\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812968    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7d86cbc-8f78-4545-ae1c-cea35f949693-env-overrides\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.812978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-var-lib-cni-bin\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813023    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813069    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/acf2031e-cd00-45d5-8356-40222284359c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n275r\" (UniqueName: \"kubernetes.io/projected/21493365-4d8d-4699-967a-59fefc50cc48-kube-api-access-n275r\") pod \"node-resolver-jqm97\" (UID: \"21493365-4d8d-4699-967a-59fefc50cc48\") " pod="openshift-dns/node-resolver-jqm97"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-cni-netd\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813252    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-cni-netd\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fd8c0375-ef66-439c-afef-5e3663eec682-iptables-alerter-script\") pod \"iptables-alerter-kkxts\" (UID: \"fd8c0375-ef66-439c-afef-5e3663eec682\") " pod="openshift-network-operator/iptables-alerter-kkxts"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-run\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-run-systemd\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813378    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21493365-4d8d-4699-967a-59fefc50cc48-tmp-dir\") pod \"node-resolver-jqm97\" (UID: \"21493365-4d8d-4699-967a-59fefc50cc48\") " pod="openshift-dns/node-resolver-jqm97"
Jul 17 15:09:10.814464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813402    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-etc-selinux\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813408    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-run-systemd\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0758be33-496e-4076-a0ea-0aa599cd3acc-konnectivity-ca\") pod \"konnectivity-agent-dbmhn\" (UID: \"0758be33-496e-4076-a0ea-0aa599cd3acc\") " pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/acf2031e-cd00-45d5-8356-40222284359c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813507    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-sysctl-d\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-host\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813554    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-tmp\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-slash\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-run-ovn-kubernetes\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7d86cbc-8f78-4545-ae1c-cea35f949693-ovnkube-script-lib\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f5da215-d35b-40d3-a7e8-04073e6510e7-host\") pod \"node-ca-ml224\" (UID: \"6f5da215-d35b-40d3-a7e8-04073e6510e7\") " pod="openshift-image-registry/node-ca-ml224"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813663    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-slash\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813672    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21493365-4d8d-4699-967a-59fefc50cc48-tmp-dir\") pod \"node-resolver-jqm97\" (UID: \"21493365-4d8d-4699-967a-59fefc50cc48\") " pod="openshift-dns/node-resolver-jqm97"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813679    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-sys-fs\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-host-run-ovn-kubernetes\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813718    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f5da215-d35b-40d3-a7e8-04073e6510e7-host\") pod \"node-ca-ml224\" (UID: \"6f5da215-d35b-40d3-a7e8-04073e6510e7\") " pod="openshift-image-registry/node-ca-ml224"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-daemon-config\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.815114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-modprobe-d\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.815883 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813878    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-systemd-units\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.815883 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpk4r\" (UniqueName: \"kubernetes.io/projected/6f5da215-d35b-40d3-a7e8-04073e6510e7-kube-api-access-lpk4r\") pod \"node-ca-ml224\" (UID: \"6f5da215-d35b-40d3-a7e8-04073e6510e7\") " pod="openshift-image-registry/node-ca-ml224"
Jul 17 15:09:10.815883 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.813927    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7d86cbc-8f78-4545-ae1c-cea35f949693-systemd-units\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.815883 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.814208    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7d86cbc-8f78-4545-ae1c-cea35f949693-ovnkube-script-lib\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.815883 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.815553    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7d86cbc-8f78-4545-ae1c-cea35f949693-ovn-node-metrics-cert\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.822007 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.821978    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz7fs\" (UniqueName: \"kubernetes.io/projected/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-kube-api-access-lz7fs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:10.822581 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.822555    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mrfj\" (UniqueName: \"kubernetes.io/projected/d7d86cbc-8f78-4545-ae1c-cea35f949693-kube-api-access-6mrfj\") pod \"ovnkube-node-pvtq5\" (UID: \"d7d86cbc-8f78-4545-ae1c-cea35f949693\") " pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:10.822815 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.822790    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n275r\" (UniqueName: \"kubernetes.io/projected/21493365-4d8d-4699-967a-59fefc50cc48-kube-api-access-n275r\") pod \"node-resolver-jqm97\" (UID: \"21493365-4d8d-4699-967a-59fefc50cc48\") " pod="openshift-dns/node-resolver-jqm97"
Jul 17 15:09:10.826641 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.826618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpk4r\" (UniqueName: \"kubernetes.io/projected/6f5da215-d35b-40d3-a7e8-04073e6510e7-kube-api-access-lpk4r\") pod \"node-ca-ml224\" (UID: \"6f5da215-d35b-40d3-a7e8-04073e6510e7\") " pod="openshift-image-registry/node-ca-ml224"
Jul 17 15:09:10.903593 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.903561    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 15:09:10.915170 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-cnibin\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.915314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-run-netns\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.915314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acf2031e-cd00-45d5-8356-40222284359c-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.915314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-var-lib-kubelet\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.915314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4wh8\" (UniqueName: \"kubernetes.io/projected/786e60ba-f181-460e-a035-2193c89f3350-kube-api-access-v4wh8\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.915314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-cnibin\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.915314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-system-cni-dir\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.915314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mvr9\" (UniqueName: \"kubernetes.io/projected/8fc89220-a098-4a76-8a2c-af11347ca2b0-kube-api-access-7mvr9\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.915583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-systemd\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.915583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915355    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-var-lib-kubelet\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.915583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-sys\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.915583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915388    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-tuned\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.915583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-kubernetes\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.915583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fc89220-a098-4a76-8a2c-af11347ca2b0-cni-binary-copy\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.915583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-system-cni-dir\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.915583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j57jd\" (UniqueName: \"kubernetes.io/projected/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-kube-api-access-j57jd\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.915583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-registration-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.915583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-var-lib-cni-multus\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.915583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-lib-modules\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915602    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-run-netns\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915659    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-systemd\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915663    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-system-cni-dir\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915695    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-system-cni-dir\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-run-multus-certs\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-lib-modules\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915729    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-run-multus-certs\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915720    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-sys\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-kubelet-config\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915767    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-kubernetes\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0758be33-496e-4076-a0ea-0aa599cd3acc-agent-certs\") pod \"konnectivity-agent-dbmhn\" (UID: \"0758be33-496e-4076-a0ea-0aa599cd3acc\") " pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-conf-dir\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915909    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-kubelet-config\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-var-lib-cni-multus\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.915968    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acf2031e-cd00-45d5-8356-40222284359c-cni-binary-copy\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916017    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-registration-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2qdb\" (UniqueName: \"kubernetes.io/projected/acf2031e-cd00-45d5-8356-40222284359c-kube-api-access-d2qdb\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.916136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916056    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-conf-dir\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-sysconfig\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-device-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-socket-dir-parent\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916155    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5gqp\" (UniqueName: \"kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp\") pod \"network-check-target-8kx7g\" (UID: \"1a6337dd-e0d3-430e-9575-4ba6f2278cd2\") " pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-os-release\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916207    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-run-k8s-cni-cncf-io\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916215    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-device-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-var-lib-kubelet\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd8c0375-ef66-439c-afef-5e3663eec682-host-slash\") pod \"iptables-alerter-kkxts\" (UID: \"fd8c0375-ef66-439c-afef-5e3663eec682\") " pod="openshift-network-operator/iptables-alerter-kkxts"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-os-release\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-var-lib-kubelet\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-dbus\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-sysconfig\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916325    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fc89220-a098-4a76-8a2c-af11347ca2b0-cni-binary-copy\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916303    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-os-release\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916338    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd8c0375-ef66-439c-afef-5e3663eec682-host-slash\") pod \"iptables-alerter-kkxts\" (UID: \"fd8c0375-ef66-439c-afef-5e3663eec682\") " pod="openshift-network-operator/iptables-alerter-kkxts"
Jul 17 15:09:10.917003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-run-k8s-cni-cncf-io\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916361    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-os-release\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916400    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-socket-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkc2t\" (UniqueName: \"kubernetes.io/projected/fd8c0375-ef66-439c-afef-5e3663eec682-kube-api-access-wkc2t\") pod \"iptables-alerter-kkxts\" (UID: \"fd8c0375-ef66-439c-afef-5e3663eec682\") " pod="openshift-network-operator/iptables-alerter-kkxts"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916437    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-socket-dir-parent\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-cni-dir\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916509    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-cnibin\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-cni-dir\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-socket-dir\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916540    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-sysctl-conf\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916478    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-dbus\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916575    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-cnibin\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-var-lib-cni-bin\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-host-var-lib-cni-bin\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916623    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/acf2031e-cd00-45d5-8356-40222284359c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.917876 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fd8c0375-ef66-439c-afef-5e3663eec682-iptables-alerter-script\") pod \"iptables-alerter-kkxts\" (UID: \"fd8c0375-ef66-439c-afef-5e3663eec682\") " pod="openshift-network-operator/iptables-alerter-kkxts"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916676    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-sysctl-conf\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-run\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-etc-selinux\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0758be33-496e-4076-a0ea-0aa599cd3acc-konnectivity-ca\") pod \"konnectivity-agent-dbmhn\" (UID: \"0758be33-496e-4076-a0ea-0aa599cd3acc\") " pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/acf2031e-cd00-45d5-8356-40222284359c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-sysctl-d\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:10.916806    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-host\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-tmp\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-sys-fs\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-daemon-config\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-modprobe-d\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.916993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-etc-kubernetes\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-hostroot\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917065    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-host\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.918693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/acf2031e-cd00-45d5-8356-40222284359c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917191    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-etc-kubernetes\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917218    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-sysctl-d\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917263    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fd8c0375-ef66-439c-afef-5e3663eec682-iptables-alerter-script\") pod \"iptables-alerter-kkxts\" (UID: \"fd8c0375-ef66-439c-afef-5e3663eec682\") " pod="openshift-network-operator/iptables-alerter-kkxts"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-sys-fs\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:10.917307    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret podName:cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:11.41728633 +0000 UTC m=+3.081736422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret") pod "global-pull-secret-syncer-pqp8d" (UID: "cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917414    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-modprobe-d\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917454    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-run\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917563    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/786e60ba-f181-460e-a035-2193c89f3350-etc-selinux\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917603    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fc89220-a098-4a76-8a2c-af11347ca2b0-hostroot\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917635    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/acf2031e-cd00-45d5-8356-40222284359c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917654    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acf2031e-cd00-45d5-8356-40222284359c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.917714    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fc89220-a098-4a76-8a2c-af11347ca2b0-multus-daemon-config\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.918145    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0758be33-496e-4076-a0ea-0aa599cd3acc-konnectivity-ca\") pod \"konnectivity-agent-dbmhn\" (UID: \"0758be33-496e-4076-a0ea-0aa599cd3acc\") " pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.918847    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-etc-tuned\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.919314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.918997    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0758be33-496e-4076-a0ea-0aa599cd3acc-agent-certs\") pod \"konnectivity-agent-dbmhn\" (UID: \"0758be33-496e-4076-a0ea-0aa599cd3acc\") " pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:10.919975 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.919957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-tmp\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:10.933113 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.933054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4wh8\" (UniqueName: \"kubernetes.io/projected/786e60ba-f181-460e-a035-2193c89f3350-kube-api-access-v4wh8\") pod \"aws-ebs-csi-driver-node-hnvc8\" (UID: \"786e60ba-f181-460e-a035-2193c89f3350\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:10.934651 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.934630    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mvr9\" (UniqueName: \"kubernetes.io/projected/8fc89220-a098-4a76-8a2c-af11347ca2b0-kube-api-access-7mvr9\") pod \"multus-64fwm\" (UID: \"8fc89220-a098-4a76-8a2c-af11347ca2b0\") " pod="openshift-multus/multus-64fwm"
Jul 17 15:09:10.935225 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:10.935205    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 15:09:10.935225 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:10.935225    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 15:09:10.935362 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:10.935236    2582 projected.go:196] Error preparing data for projected volume kube-api-access-z5gqp for pod openshift-network-diagnostics/network-check-target-8kx7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:10.935362 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:10.935301    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp podName:1a6337dd-e0d3-430e-9575-4ba6f2278cd2 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:11.435283103 +0000 UTC m=+3.099733194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z5gqp" (UniqueName: "kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp") pod "network-check-target-8kx7g" (UID: "1a6337dd-e0d3-430e-9575-4ba6f2278cd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:10.947810 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.947784    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkc2t\" (UniqueName: \"kubernetes.io/projected/fd8c0375-ef66-439c-afef-5e3663eec682-kube-api-access-wkc2t\") pod \"iptables-alerter-kkxts\" (UID: \"fd8c0375-ef66-439c-afef-5e3663eec682\") " pod="openshift-network-operator/iptables-alerter-kkxts"
Jul 17 15:09:10.947941 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.947893    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2qdb\" (UniqueName: \"kubernetes.io/projected/acf2031e-cd00-45d5-8356-40222284359c-kube-api-access-d2qdb\") pod \"multus-additional-cni-plugins-r6grj\" (UID: \"acf2031e-cd00-45d5-8356-40222284359c\") " pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:10.951237 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:10.951209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j57jd\" (UniqueName: \"kubernetes.io/projected/edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4-kube-api-access-j57jd\") pod \"tuned-vvx7b\" (UID: \"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:11.005039 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.005008    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:11.011966 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.011945    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jqm97"
Jul 17 15:09:11.021837 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.021814    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ml224"
Jul 17 15:09:11.026438 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.026418    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-64fwm"
Jul 17 15:09:11.033609 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.033585    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r6grj"
Jul 17 15:09:11.041485 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.041464    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvx7b"
Jul 17 15:09:11.053252 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.053234    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8"
Jul 17 15:09:11.061100 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.061083    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:11.066821 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.066802    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kkxts"
Jul 17 15:09:11.320434 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.320356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:11.320584 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:11.320502    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:11.320584 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:11.320568    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs podName:6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:12.320553887 +0000 UTC m=+3.985003970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs") pod "network-metrics-daemon-8xxqp" (UID: "6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:11.421594 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.421554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:11.421782 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:11.421718    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:11.421824 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:11.421785    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret podName:cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:12.421767753 +0000 UTC m=+4.086217845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret") pod "global-pull-secret-syncer-pqp8d" (UID: "cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:11.522049 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:11.521999    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5da215_d35b_40d3_a7e8_04073e6510e7.slice/crio-fd084ee3bd68b4679d0eecdf1cad84cf6c75a1f39e465968a0f2a23294468501 WatchSource:0}: Error finding container fd084ee3bd68b4679d0eecdf1cad84cf6c75a1f39e465968a0f2a23294468501: Status 404 returned error can't find the container with id fd084ee3bd68b4679d0eecdf1cad84cf6c75a1f39e465968a0f2a23294468501
Jul 17 15:09:11.522227 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.522064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5gqp\" (UniqueName: \"kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp\") pod \"network-check-target-8kx7g\" (UID: \"1a6337dd-e0d3-430e-9575-4ba6f2278cd2\") " pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:11.522287 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:11.522270    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 15:09:11.522398 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:11.522295    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 15:09:11.522398 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:11.522309    2582 projected.go:196] Error preparing data for projected volume kube-api-access-z5gqp for pod openshift-network-diagnostics/network-check-target-8kx7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:11.522398 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:11.522376    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp podName:1a6337dd-e0d3-430e-9575-4ba6f2278cd2 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:12.522356955 +0000 UTC m=+4.186807039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5gqp" (UniqueName: "kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp") pod "network-check-target-8kx7g" (UID: "1a6337dd-e0d3-430e-9575-4ba6f2278cd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:11.522826 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:11.522805    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedfdf2b3_e75a_48e4_ad3c_9a80c60f81d4.slice/crio-f9020f051cae7a5aa6b27c4ae7f36211fff9f11943623515cf1c1e3d4ed8c230 WatchSource:0}: Error finding container f9020f051cae7a5aa6b27c4ae7f36211fff9f11943623515cf1c1e3d4ed8c230: Status 404 returned error can't find the container with id f9020f051cae7a5aa6b27c4ae7f36211fff9f11943623515cf1c1e3d4ed8c230
Jul 17 15:09:11.526852 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:11.526748    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf2031e_cd00_45d5_8356_40222284359c.slice/crio-8684991772fb22bd1c436bbeacade52629c255b9d249a7030386092723103a80 WatchSource:0}: Error finding container 8684991772fb22bd1c436bbeacade52629c255b9d249a7030386092723103a80: Status 404 returned error can't find the container with id 8684991772fb22bd1c436bbeacade52629c255b9d249a7030386092723103a80
Jul 17 15:09:11.528990 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:11.528869    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21493365_4d8d_4699_967a_59fefc50cc48.slice/crio-63f8d6b6d4d74b7699c3177318562e8ad0ba43cce7134e68911b4d365911dd8e WatchSource:0}: Error finding container 63f8d6b6d4d74b7699c3177318562e8ad0ba43cce7134e68911b4d365911dd8e: Status 404 returned error can't find the container with id 63f8d6b6d4d74b7699c3177318562e8ad0ba43cce7134e68911b4d365911dd8e
Jul 17 15:09:11.529602 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:11.529517    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc89220_a098_4a76_8a2c_af11347ca2b0.slice/crio-7e596ed7421577351cc6e9382fbfffa88f2b6f39e52cdda4633a95bf53f63835 WatchSource:0}: Error finding container 7e596ed7421577351cc6e9382fbfffa88f2b6f39e52cdda4633a95bf53f63835: Status 404 returned error can't find the container with id 7e596ed7421577351cc6e9382fbfffa88f2b6f39e52cdda4633a95bf53f63835
Jul 17 15:09:11.530397 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:11.530318    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8c0375_ef66_439c_afef_5e3663eec682.slice/crio-498b806f7b9be64a387935eaf2d0f95fc746afb42b5e6fcea25ee91d3abdb320 WatchSource:0}: Error finding container 498b806f7b9be64a387935eaf2d0f95fc746afb42b5e6fcea25ee91d3abdb320: Status 404 returned error can't find the container with id 498b806f7b9be64a387935eaf2d0f95fc746afb42b5e6fcea25ee91d3abdb320
Jul 17 15:09:11.532564 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:11.532503    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786e60ba_f181_460e_a035_2193c89f3350.slice/crio-a9ed93712be8fe353677d452219cd96faf33cb6e4515d11d38006af69a1142ba WatchSource:0}: Error finding container a9ed93712be8fe353677d452219cd96faf33cb6e4515d11d38006af69a1142ba: Status 404 returned error can't find the container with id a9ed93712be8fe353677d452219cd96faf33cb6e4515d11d38006af69a1142ba
Jul 17 15:09:11.532907 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:11.532837    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0758be33_496e_4076_a0ea_0aa599cd3acc.slice/crio-9e190477233f0c5a7a595b1472666aa1dbdf0959f6f1192ca522c48503f4cf26 WatchSource:0}: Error finding container 9e190477233f0c5a7a595b1472666aa1dbdf0959f6f1192ca522c48503f4cf26: Status 404 returned error can't find the container with id 9e190477233f0c5a7a595b1472666aa1dbdf0959f6f1192ca522c48503f4cf26
Jul 17 15:09:11.534575 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:11.534068    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d86cbc_8f78_4545_ae1c_cea35f949693.slice/crio-ba11bdd0e9a8422ce510e2e9ac4a3f23db92427798d5c610eda48065c4fdeca7 WatchSource:0}: Error finding container ba11bdd0e9a8422ce510e2e9ac4a3f23db92427798d5c610eda48065c4fdeca7: Status 404 returned error can't find the container with id ba11bdd0e9a8422ce510e2e9ac4a3f23db92427798d5c610eda48065c4fdeca7
Jul 17 15:09:11.754698 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.754639    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 15:04:11 +0000 UTC" deadline="2028-02-02 08:19:32.520927483 +0000 UTC"
Jul 17 15:09:11.754698 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.754687    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13553h10m20.766243249s"
Jul 17 15:09:11.903867 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.903767    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5" event={"ID":"d7d86cbc-8f78-4545-ae1c-cea35f949693","Type":"ContainerStarted","Data":"ba11bdd0e9a8422ce510e2e9ac4a3f23db92427798d5c610eda48065c4fdeca7"}
Jul 17 15:09:11.904902 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.904874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dbmhn" event={"ID":"0758be33-496e-4076-a0ea-0aa599cd3acc","Type":"ContainerStarted","Data":"9e190477233f0c5a7a595b1472666aa1dbdf0959f6f1192ca522c48503f4cf26"}
Jul 17 15:09:11.905858 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.905838    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kkxts" event={"ID":"fd8c0375-ef66-439c-afef-5e3663eec682","Type":"ContainerStarted","Data":"498b806f7b9be64a387935eaf2d0f95fc746afb42b5e6fcea25ee91d3abdb320"}
Jul 17 15:09:11.906892 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.906849    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-64fwm" event={"ID":"8fc89220-a098-4a76-8a2c-af11347ca2b0","Type":"ContainerStarted","Data":"7e596ed7421577351cc6e9382fbfffa88f2b6f39e52cdda4633a95bf53f63835"}
Jul 17 15:09:11.908010 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.907985    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6grj" event={"ID":"acf2031e-cd00-45d5-8356-40222284359c","Type":"ContainerStarted","Data":"8684991772fb22bd1c436bbeacade52629c255b9d249a7030386092723103a80"}
Jul 17 15:09:11.909079 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.909055    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ml224" event={"ID":"6f5da215-d35b-40d3-a7e8-04073e6510e7","Type":"ContainerStarted","Data":"fd084ee3bd68b4679d0eecdf1cad84cf6c75a1f39e465968a0f2a23294468501"}
Jul 17 15:09:11.913068 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.913048    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-239.ec2.internal" event={"ID":"2f114662f8c568f2e1d8877c1f328796","Type":"ContainerStarted","Data":"1e83eb0a27bc5254c19c6848e12afc41bc2554dbdd488f8619a0d14f1b6ae366"}
Jul 17 15:09:11.914225 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.914206    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8" event={"ID":"786e60ba-f181-460e-a035-2193c89f3350","Type":"ContainerStarted","Data":"a9ed93712be8fe353677d452219cd96faf33cb6e4515d11d38006af69a1142ba"}
Jul 17 15:09:11.915300 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.915280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jqm97" event={"ID":"21493365-4d8d-4699-967a-59fefc50cc48","Type":"ContainerStarted","Data":"63f8d6b6d4d74b7699c3177318562e8ad0ba43cce7134e68911b4d365911dd8e"}
Jul 17 15:09:11.916272 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.916253    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvx7b" event={"ID":"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4","Type":"ContainerStarted","Data":"f9020f051cae7a5aa6b27c4ae7f36211fff9f11943623515cf1c1e3d4ed8c230"}
Jul 17 15:09:11.941693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:11.939972    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-239.ec2.internal" podStartSLOduration=1.9399532320000001 podStartE2EDuration="1.939953232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:11.938756302 +0000 UTC m=+3.603206410" watchObservedRunningTime="2026-07-17 15:09:11.939953232 +0000 UTC m=+3.604403341"
Jul 17 15:09:12.331419 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:12.331332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:12.331591 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:12.331514    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:12.331591 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:12.331578    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs podName:6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:14.331559799 +0000 UTC m=+5.996009886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs") pod "network-metrics-daemon-8xxqp" (UID: "6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:12.432440 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:12.432401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:12.432615 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:12.432599    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:12.432689 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:12.432676    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret podName:cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:14.432643451 +0000 UTC m=+6.097093538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret") pod "global-pull-secret-syncer-pqp8d" (UID: "cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:12.533279 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:12.533225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5gqp\" (UniqueName: \"kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp\") pod \"network-check-target-8kx7g\" (UID: \"1a6337dd-e0d3-430e-9575-4ba6f2278cd2\") " pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:12.533476 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:12.533443    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 15:09:12.533476 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:12.533465    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 15:09:12.533592 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:12.533479    2582 projected.go:196] Error preparing data for projected volume kube-api-access-z5gqp for pod openshift-network-diagnostics/network-check-target-8kx7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:12.533592 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:12.533540    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp podName:1a6337dd-e0d3-430e-9575-4ba6f2278cd2 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:14.533520253 +0000 UTC m=+6.197970346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5gqp" (UniqueName: "kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp") pod "network-check-target-8kx7g" (UID: "1a6337dd-e0d3-430e-9575-4ba6f2278cd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:12.754968 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:12.754788    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 15:04:11 +0000 UTC" deadline="2028-04-17 14:38:54.31507725 +0000 UTC"
Jul 17 15:09:12.754968 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:12.754874    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15359h29m41.560208055s"
Jul 17 15:09:12.901278 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:12.900384    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:12.901278 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:12.900524    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:12.901278 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:12.900913    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:12.901278 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:12.901030    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:12.901278 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:12.901125    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:12.901278 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:12.901222    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:14.349336 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:14.348997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:14.349336 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:14.349139    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:14.349336 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:14.349198    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs podName:6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:18.349178851 +0000 UTC m=+10.013628942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs") pod "network-metrics-daemon-8xxqp" (UID: "6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:14.450817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:14.450238    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:14.450817 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:14.450402    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:14.450817 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:14.450463    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret podName:cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:18.450444407 +0000 UTC m=+10.114894495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret") pod "global-pull-secret-syncer-pqp8d" (UID: "cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:14.551626 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:14.550937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5gqp\" (UniqueName: \"kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp\") pod \"network-check-target-8kx7g\" (UID: \"1a6337dd-e0d3-430e-9575-4ba6f2278cd2\") " pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:14.551626 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:14.551137    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 15:09:14.551626 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:14.551156    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 15:09:14.551626 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:14.551170    2582 projected.go:196] Error preparing data for projected volume kube-api-access-z5gqp for pod openshift-network-diagnostics/network-check-target-8kx7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:14.551626 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:14.551228    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp podName:1a6337dd-e0d3-430e-9575-4ba6f2278cd2 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:18.551209918 +0000 UTC m=+10.215660009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5gqp" (UniqueName: "kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp") pod "network-check-target-8kx7g" (UID: "1a6337dd-e0d3-430e-9575-4ba6f2278cd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:14.898499 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:14.898258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:14.898499 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:14.898409    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:14.898746 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:14.898733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:14.898888 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:14.898852    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:14.898978 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:14.898908    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:14.899031 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:14.899005    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:16.898373 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:16.898294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:16.898373 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:16.898317    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:16.899100 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:16.898294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:16.899100 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:16.898437    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:16.899100 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:16.898526    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:16.899100 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:16.898604    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:18.384796 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:18.384765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:18.385237 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:18.384914    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:18.385237 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:18.384984    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs podName:6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:26.384963427 +0000 UTC m=+18.049413529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs") pod "network-metrics-daemon-8xxqp" (UID: "6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:18.486436 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:18.485914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:18.486436 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:18.486057    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:18.486436 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:18.486126    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret podName:cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:26.486106956 +0000 UTC m=+18.150557062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret") pod "global-pull-secret-syncer-pqp8d" (UID: "cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:18.587208 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:18.587167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5gqp\" (UniqueName: \"kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp\") pod \"network-check-target-8kx7g\" (UID: \"1a6337dd-e0d3-430e-9575-4ba6f2278cd2\") " pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:18.587383 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:18.587353    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 15:09:18.587383 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:18.587382    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 15:09:18.587567 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:18.587396    2582 projected.go:196] Error preparing data for projected volume kube-api-access-z5gqp for pod openshift-network-diagnostics/network-check-target-8kx7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:18.587567 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:18.587461    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp podName:1a6337dd-e0d3-430e-9575-4ba6f2278cd2 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:26.587442838 +0000 UTC m=+18.251892924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5gqp" (UniqueName: "kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp") pod "network-check-target-8kx7g" (UID: "1a6337dd-e0d3-430e-9575-4ba6f2278cd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:18.899664 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:18.899631    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:18.899818 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:18.899751    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:18.900148 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:18.900124    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:18.900249 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:18.900225    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:18.900310 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:18.900266    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:18.900360 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:18.900328    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:20.260617 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:20.260426    2582 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = creating pod sandbox with name \"k8s_kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal_openshift-machine-config-operator_99e8cbbe054290ef3790809ab0d9cb94_0\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0: reading manifest sha256:c0d22b13389b1d604e9a8b20e162b5d378b25005d04bbd2cf7f74c9782415acd in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image"
Jul 17 15:09:20.260617 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:20.260509    2582 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = creating pod sandbox with name \"k8s_kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal_openshift-machine-config-operator_99e8cbbe054290ef3790809ab0d9cb94_0\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0: reading manifest sha256:c0d22b13389b1d604e9a8b20e162b5d378b25005d04bbd2cf7f74c9782415acd in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:20.260617 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:20.260531    2582 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = creating pod sandbox with name \"k8s_kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal_openshift-machine-config-operator_99e8cbbe054290ef3790809ab0d9cb94_0\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0: reading manifest sha256:c0d22b13389b1d604e9a8b20e162b5d378b25005d04bbd2cf7f74c9782415acd in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:20.261070 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:20.260608    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal_openshift-machine-config-operator(99e8cbbe054290ef3790809ab0d9cb94)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal_openshift-machine-config-operator(99e8cbbe054290ef3790809ab0d9cb94)\\\": rpc error: code = Unknown desc = creating pod sandbox with name \\\"k8s_kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal_openshift-machine-config-operator_99e8cbbe054290ef3790809ab0d9cb94_0\\\": unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0: reading manifest sha256:c0d22b13389b1d604e9a8b20e162b5d378b25005d04bbd2cf7f74c9782415acd in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal" podUID="99e8cbbe054290ef3790809ab0d9cb94"
Jul 17 15:09:20.899151 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:20.899102    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:20.899319 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:20.899112    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:20.899319 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:20.899244    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:20.899445 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:20.899123    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:20.899445 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:20.899356    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:20.899537 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:20.899486    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:20.942975 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:20.942943    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:20.943261 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:20.943241    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal"
Jul 17 15:09:21.946111 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:21.946027    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal" event={"ID":"99e8cbbe054290ef3790809ab0d9cb94","Type":"ContainerStarted","Data":"088c3a4093b5763e5dca4ecfc66b617dca7eaaec1ff188abee44d107f93eaa40"}
Jul 17 15:09:22.898121 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:22.898085    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:22.898121 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:22.898113    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:22.898355 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:22.898085    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:22.898355 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:22.898231    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:22.898450 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:22.898375    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:22.898503 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:22.898448    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:22.949744 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:22.949715    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dbmhn" event={"ID":"0758be33-496e-4076-a0ea-0aa599cd3acc","Type":"ContainerStarted","Data":"9be06a82bd50ffb9af1e323a40731cb123afa2957ba1fed3fc860a4c16f7e5f1"}
Jul 17 15:09:22.966346 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:22.966265    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dbmhn" podStartSLOduration=3.7887209520000003 podStartE2EDuration="13.966250219s" totalImagesPullingTime="10.177529267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:22.966066002 +0000 UTC m=+14.630516109" watchObservedRunningTime="2026-07-17 15:09:22.966250219 +0000 UTC m=+14.630700326"
Jul 17 15:09:23.953180 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:23.953140    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kkxts" event={"ID":"fd8c0375-ef66-439c-afef-5e3663eec682","Type":"ContainerStarted","Data":"6b0ba3df504b4466e885bc5a7780e1abafa97d1f2bbd5e884254b193a35d801d"}
Jul 17 15:09:23.971326 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:23.971277    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kkxts" podStartSLOduration=4.791831547 podStartE2EDuration="14.971258247s" totalImagesPullingTime="10.1794267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:23.971166701 +0000 UTC m=+15.635616805" watchObservedRunningTime="2026-07-17 15:09:23.971258247 +0000 UTC m=+15.635708350"
Jul 17 15:09:24.898290 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:24.898257    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:24.898478 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:24.898271    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:24.898478 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:24.898383    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:24.898478 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:24.898399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:24.898622 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:24.898487    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:24.898622 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:24.898539    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:24.979522 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:24.979485    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:24.980284 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:24.980261    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:25.957284 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:25.957251    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:25.957861 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:25.957827    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dbmhn"
Jul 17 15:09:26.453311 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:26.453233    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:26.453700 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:26.453359    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:26.453700 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:26.453426    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs podName:6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:42.453406136 +0000 UTC m=+34.117856222 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs") pod "network-metrics-daemon-8xxqp" (UID: "6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:26.554294 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:26.554253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:26.554476 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:26.554384    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:26.554476 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:26.554464    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret podName:cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:42.554444248 +0000 UTC m=+34.218894352 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret") pod "global-pull-secret-syncer-pqp8d" (UID: "cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:26.654681 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:26.654647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5gqp\" (UniqueName: \"kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp\") pod \"network-check-target-8kx7g\" (UID: \"1a6337dd-e0d3-430e-9575-4ba6f2278cd2\") " pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:26.654901 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:26.654795    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 15:09:26.654901 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:26.654819    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 15:09:26.654901 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:26.654832    2582 projected.go:196] Error preparing data for projected volume kube-api-access-z5gqp for pod openshift-network-diagnostics/network-check-target-8kx7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:26.655032 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:26.654927    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp podName:1a6337dd-e0d3-430e-9575-4ba6f2278cd2 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:42.654906987 +0000 UTC m=+34.319357104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5gqp" (UniqueName: "kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp") pod "network-check-target-8kx7g" (UID: "1a6337dd-e0d3-430e-9575-4ba6f2278cd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:26.899104 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:26.899028    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:26.899251 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:26.899035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:26.899251 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:26.899155    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:26.899251 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:26.899155    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:26.899408 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:26.899257    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:26.899408 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:26.899343    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:28.899545 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:28.899507    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:28.900014 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:28.899561    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:28.900014 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:28.899642    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:28.900014 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:28.899735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:28.900014 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:28.899728    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:28.900014 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:28.899834    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:30.898626 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.898333    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:30.899199 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.898333    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:30.899199 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:30.898703    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:30.899199 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.898399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:30.899199 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:30.898814    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:30.899199 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:30.898915    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:30.967371 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.967339    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8" event={"ID":"786e60ba-f181-460e-a035-2193c89f3350","Type":"ContainerStarted","Data":"206b0e30837e2f84917656eccc0a240bf246a2c52c1d97fab6300015a11db021"}
Jul 17 15:09:30.968564 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.968544    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jqm97" event={"ID":"21493365-4d8d-4699-967a-59fefc50cc48","Type":"ContainerStarted","Data":"ca5f9696c11ada6d289bc12af825cb5b2d58c69b2e17d778d6fc61fd3dfb1f06"}
Jul 17 15:09:30.969832 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.969811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvx7b" event={"ID":"edfdf2b3-e75a-48e4-ad3c-9a80c60f81d4","Type":"ContainerStarted","Data":"09884d0b8c5058afa523c664838fbf39da5ae0dceca305a4d413fa2ff5881f9b"}
Jul 17 15:09:30.972270 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.972251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5" event={"ID":"d7d86cbc-8f78-4545-ae1c-cea35f949693","Type":"ContainerStarted","Data":"3968ab704970afa43d6b194e5b30a680b4b6388497479ada5283fcc9ccf0e904"}
Jul 17 15:09:30.972360 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.972323    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5" event={"ID":"d7d86cbc-8f78-4545-ae1c-cea35f949693","Type":"ContainerStarted","Data":"7edb73b74783301b0cbf06f7ab2127ca7e25c2cc3fe6401ac7e85f8829f19e5b"}
Jul 17 15:09:30.972411 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.972373    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5" event={"ID":"d7d86cbc-8f78-4545-ae1c-cea35f949693","Type":"ContainerStarted","Data":"c738fef830e80734e0ce78eab765b74948877f041a5d784b32524687e77a89af"}
Jul 17 15:09:30.972449 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.972419    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5" event={"ID":"d7d86cbc-8f78-4545-ae1c-cea35f949693","Type":"ContainerStarted","Data":"51606afefc853b68175463e368837f0de50912690e46d5cd19dbe97cba38d088"}
Jul 17 15:09:30.972487 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.972452    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5" event={"ID":"d7d86cbc-8f78-4545-ae1c-cea35f949693","Type":"ContainerStarted","Data":"dcd05222db17e872388030a4cd2ada5b8a2c0087915fe887252e73678b2bd2bb"}
Jul 17 15:09:30.973566 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.973549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-64fwm" event={"ID":"8fc89220-a098-4a76-8a2c-af11347ca2b0","Type":"ContainerStarted","Data":"c9e70fc91a59cba133f99db71c721a59ee743b1d785dc31e8f7192fdfbb9c8ab"}
Jul 17 15:09:30.974882 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.974841    2582 generic.go:356] "Generic (PLEG): container finished" podID="acf2031e-cd00-45d5-8356-40222284359c" containerID="d6f8b8134ac50ac54d0be14faf633b26a9b82b92d260f2574c61bb05aa577530" exitCode=0
Jul 17 15:09:30.974882 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.974873    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6grj" event={"ID":"acf2031e-cd00-45d5-8356-40222284359c","Type":"ContainerDied","Data":"d6f8b8134ac50ac54d0be14faf633b26a9b82b92d260f2574c61bb05aa577530"}
Jul 17 15:09:30.979215 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.976871    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ml224" event={"ID":"6f5da215-d35b-40d3-a7e8-04073e6510e7","Type":"ContainerStarted","Data":"53974f7f2ff2afa8d7dbe1e5fb24af1d3050286585a1384656c4b088176a6457"}
Jul 17 15:09:30.981063 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.981036    2582 generic.go:356] "Generic (PLEG): container finished" podID="99e8cbbe054290ef3790809ab0d9cb94" containerID="3903e7a198a65733d28392a8006d37c2dc820423d8da965e0cf2abc35c5fbca2" exitCode=0
Jul 17 15:09:30.981138 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:30.981079    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal" event={"ID":"99e8cbbe054290ef3790809ab0d9cb94","Type":"ContainerDied","Data":"3903e7a198a65733d28392a8006d37c2dc820423d8da965e0cf2abc35c5fbca2"}
Jul 17 15:09:31.005339 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:31.005286    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jqm97" podStartSLOduration=11.795826447 podStartE2EDuration="22.005268945s" totalImagesPullingTime="10.209442498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:30.985272886 +0000 UTC m=+22.649722990" watchObservedRunningTime="2026-07-17 15:09:31.005268945 +0000 UTC m=+22.669719049"
Jul 17 15:09:31.005589 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:31.005565    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vvx7b" podStartSLOduration=3.172992927 podStartE2EDuration="22.005558802s" totalImagesPullingTime="18.832565875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:31.004951653 +0000 UTC m=+22.669401756" watchObservedRunningTime="2026-07-17 15:09:31.005558802 +0000 UTC m=+22.670008923"
Jul 17 15:09:31.058773 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:31.058718    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ml224" podStartSLOduration=11.867539537 podStartE2EDuration="22.058697238s" totalImagesPullingTime="10.191157701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:31.039468446 +0000 UTC m=+22.703918552" watchObservedRunningTime="2026-07-17 15:09:31.058697238 +0000 UTC m=+22.723147344"
Jul 17 15:09:31.058931 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:31.058820    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-64fwm" podStartSLOduration=3.232397872 podStartE2EDuration="22.058812498s" totalImagesPullingTime="18.826414626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:31.058152403 +0000 UTC m=+22.722602502" watchObservedRunningTime="2026-07-17 15:09:31.058812498 +0000 UTC m=+22.723262603"
Jul 17 15:09:31.809146 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:31.809107    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 15:09:31.985447 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:31.985369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal" event={"ID":"99e8cbbe054290ef3790809ab0d9cb94","Type":"ContainerStarted","Data":"2f5ac1e5d0ab01a63cd094fb066538b83396b52f0c89f0e95722098b27bc5511"}
Jul 17 15:09:31.987565 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:31.987539    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8" event={"ID":"786e60ba-f181-460e-a035-2193c89f3350","Type":"ContainerStarted","Data":"d03f2441e65ed9f108d96d50b640d0148c02c0d7439ec72764a6d7a1c0337f75"}
Jul 17 15:09:31.991009 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:31.990983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5" event={"ID":"d7d86cbc-8f78-4545-ae1c-cea35f949693","Type":"ContainerStarted","Data":"f8b7746ee163dbbb56b96fb14322d002268d6bc065978879ff1d7c9cb6f12c40"}
Jul 17 15:09:32.003670 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:32.003633    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-239.ec2.internal" podStartSLOduration=22.003618637 podStartE2EDuration="22.003618637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:32.003610982 +0000 UTC m=+23.668061088" watchObservedRunningTime="2026-07-17 15:09:32.003618637 +0000 UTC m=+23.668068741"
Jul 17 15:09:32.784743 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:32.784655    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T15:09:31.809128482Z","UUID":"29e29374-7f14-4f0c-b1ec-59fb630251f2","Handler":null,"Name":"","Endpoint":""}
Jul 17 15:09:32.786286 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:32.786261    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 15:09:32.786402 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:32.786297    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 15:09:32.898368 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:32.898171    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:32.898519 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:32.898214    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:32.898519 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:32.898458    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:32.898519 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:32.898219    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:32.898519 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:32.898508    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:32.898661 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:32.898574    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:33.997693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:33.997656    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5" event={"ID":"d7d86cbc-8f78-4545-ae1c-cea35f949693","Type":"ContainerStarted","Data":"ca3a67fbd5fad8c131bdfcb9664532028873b83e2d4514188eee85f975a08b16"}
Jul 17 15:09:33.999532 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:33.999511    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8" event={"ID":"786e60ba-f181-460e-a035-2193c89f3350","Type":"ContainerStarted","Data":"998a0cab3fac2fce4bb5478180249e3f48157c44626f31f4fd3caa69363e3dda"}
Jul 17 15:09:34.020693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:34.020654    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hnvc8" podStartSLOduration=12.369839953 podStartE2EDuration="25.020632547s" totalImagesPullingTime="12.650792594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:34.020117852 +0000 UTC m=+25.684567955" watchObservedRunningTime="2026-07-17 15:09:34.020632547 +0000 UTC m=+25.685082651"
Jul 17 15:09:34.898622 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:34.898588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:34.898622 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:34.898607    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:34.898909 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:34.898588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:34.898909 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:34.898710    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:34.898909 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:34.898799    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:34.898909 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:34.898890    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:36.898921 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:36.898897    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:36.898921 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:36.898911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:36.899656 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:36.898911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:36.899656 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:36.899017    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:36.899656 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:36.899073    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:36.899656 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:36.899124    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:37.009438 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:37.009376    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5" event={"ID":"d7d86cbc-8f78-4545-ae1c-cea35f949693","Type":"ContainerStarted","Data":"e0511e5b36fc5ca281a3bfb6abb1caa7225746ca4fd1e6787d1299e33b3e3c7b"}
Jul 17 15:09:37.009591 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:37.009574    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:37.009660 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:37.009645    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:37.011319 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:37.011299    2582 generic.go:356] "Generic (PLEG): container finished" podID="acf2031e-cd00-45d5-8356-40222284359c" containerID="f21eec076d1d9aeebc6d4e18f6737c872f148ac092d6138167afbf188f3632b7" exitCode=0
Jul 17 15:09:37.011406 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:37.011331    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6grj" event={"ID":"acf2031e-cd00-45d5-8356-40222284359c","Type":"ContainerDied","Data":"f21eec076d1d9aeebc6d4e18f6737c872f148ac092d6138167afbf188f3632b7"}
Jul 17 15:09:37.023926 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:37.023908    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:37.043560 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:37.043517    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5" podStartSLOduration=9.221452713 podStartE2EDuration="28.043505812s" totalImagesPullingTime="18.822053099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:37.042948005 +0000 UTC m=+28.707398108" watchObservedRunningTime="2026-07-17 15:09:37.043505812 +0000 UTC m=+28.707955916"
Jul 17 15:09:38.013783 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:38.013755    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:38.027732 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:38.027709    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:09:38.838478 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:38.838447    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pqp8d"]
Jul 17 15:09:38.838639 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:38.838574    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:38.838682 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:38.838648    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:38.840824 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:38.840799    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8xxqp"]
Jul 17 15:09:38.840951 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:38.840927    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:38.841065 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:38.841042    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:38.854747 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:38.854686    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8kx7g"]
Jul 17 15:09:38.854841 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:38.854765    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:38.854841 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:38.854831    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:39.017389 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:39.017357    2582 generic.go:356] "Generic (PLEG): container finished" podID="acf2031e-cd00-45d5-8356-40222284359c" containerID="1756f7ef6c18185dcd39292193da4e79fd1869eefab813c533a13f745c73b311" exitCode=0
Jul 17 15:09:39.017788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:39.017441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6grj" event={"ID":"acf2031e-cd00-45d5-8356-40222284359c","Type":"ContainerDied","Data":"1756f7ef6c18185dcd39292193da4e79fd1869eefab813c533a13f745c73b311"}
Jul 17 15:09:39.371099 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:39.371071    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:39.473703 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:39.473663    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:40.022456 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:40.022403    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6grj" event={"ID":"acf2031e-cd00-45d5-8356-40222284359c","Type":"ContainerStarted","Data":"11e1938990a3d912e903142042a8ee02796a4c16dbaab7e45912b18df032c89b"}
Jul 17 15:09:40.899020 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:40.898797    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:40.899143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:40.898804    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:40.899143 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:40.899061    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:40.899143 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:40.899121    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:40.899143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:40.898837    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:40.899273 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:40.899225    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:41.026404 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:41.026371    2582 generic.go:356] "Generic (PLEG): container finished" podID="acf2031e-cd00-45d5-8356-40222284359c" containerID="11e1938990a3d912e903142042a8ee02796a4c16dbaab7e45912b18df032c89b" exitCode=0
Jul 17 15:09:41.026717 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:41.026412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6grj" event={"ID":"acf2031e-cd00-45d5-8356-40222284359c","Type":"ContainerDied","Data":"11e1938990a3d912e903142042a8ee02796a4c16dbaab7e45912b18df032c89b"}
Jul 17 15:09:41.990086 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:41.989996    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:42.065129 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:42.065093    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:42.479933 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:42.479826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:42.480061 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:42.480008    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:42.480111 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:42.480100    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs podName:6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7 nodeName:}" failed. No retries permitted until 2026-07-17 15:10:14.480079098 +0000 UTC m=+66.144529185 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs") pod "network-metrics-daemon-8xxqp" (UID: "6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 15:09:42.580402 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:42.580368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:42.580568 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:42.580509    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:42.580621 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:42.580597    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret podName:cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8 nodeName:}" failed. No retries permitted until 2026-07-17 15:10:14.580574741 +0000 UTC m=+66.245024833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret") pod "global-pull-secret-syncer-pqp8d" (UID: "cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8") : object "kube-system"/"original-pull-secret" not registered
Jul 17 15:09:42.681164 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:42.681133    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5gqp\" (UniqueName: \"kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp\") pod \"network-check-target-8kx7g\" (UID: \"1a6337dd-e0d3-430e-9575-4ba6f2278cd2\") " pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:42.681330 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:42.681309    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 15:09:42.681330 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:42.681330    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 15:09:42.681409 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:42.681344    2582 projected.go:196] Error preparing data for projected volume kube-api-access-z5gqp for pod openshift-network-diagnostics/network-check-target-8kx7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:42.681409 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:42.681404    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp podName:1a6337dd-e0d3-430e-9575-4ba6f2278cd2 nodeName:}" failed. No retries permitted until 2026-07-17 15:10:14.681389458 +0000 UTC m=+66.345839545 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5gqp" (UniqueName: "kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp") pod "network-check-target-8kx7g" (UID: "1a6337dd-e0d3-430e-9575-4ba6f2278cd2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 15:09:42.898948 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:42.898911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:42.898948 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:42.898939    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:42.899172 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:42.898911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:42.899172 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:42.899040    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kx7g" podUID="1a6337dd-e0d3-430e-9575-4ba6f2278cd2"
Jul 17 15:09:42.899172 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:42.899121    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8xxqp" podUID="6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7"
Jul 17 15:09:42.899311 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:42.899172    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pqp8d" podUID="cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8"
Jul 17 15:09:43.120292 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.120221    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-239.ec2.internal" event="NodeReady"
Jul 17 15:09:43.120694 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.120389    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 15:09:43.170880 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.170833    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v2wgw"]
Jul 17 15:09:43.193099 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.193068    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ph9b2"]
Jul 17 15:09:43.193253 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.193182    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.196129 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.196100    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 15:09:43.196259 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.196103    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m7zkr\""
Jul 17 15:09:43.196325 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.196112    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 15:09:43.208864 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.208807    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2wgw"]
Jul 17 15:09:43.209015 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.208884    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ph9b2"]
Jul 17 15:09:43.209015 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.208892    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ph9b2"
Jul 17 15:09:43.212037 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.211926    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 15:09:43.212037 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.211936    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hhvk5\""
Jul 17 15:09:43.212037 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.211934    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 15:09:43.212037 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.212019    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 15:09:43.386730 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.386639    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.386730 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.386679    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htvxq\" (UniqueName: \"kubernetes.io/projected/50c7fa37-6581-4c75-9081-eca174cc2681-kube-api-access-htvxq\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.386957 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.386752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-678fz\" (UniqueName: \"kubernetes.io/projected/2ed94aac-788d-4c4e-9e41-22c864979f4b-kube-api-access-678fz\") pod \"ingress-canary-ph9b2\" (UID: \"2ed94aac-788d-4c4e-9e41-22c864979f4b\") " pod="openshift-ingress-canary/ingress-canary-ph9b2"
Jul 17 15:09:43.386957 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.386775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50c7fa37-6581-4c75-9081-eca174cc2681-tmp-dir\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.386957 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.386807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed94aac-788d-4c4e-9e41-22c864979f4b-cert\") pod \"ingress-canary-ph9b2\" (UID: \"2ed94aac-788d-4c4e-9e41-22c864979f4b\") " pod="openshift-ingress-canary/ingress-canary-ph9b2"
Jul 17 15:09:43.386957 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.386825    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50c7fa37-6581-4c75-9081-eca174cc2681-config-volume\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.487523 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.487492    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-678fz\" (UniqueName: \"kubernetes.io/projected/2ed94aac-788d-4c4e-9e41-22c864979f4b-kube-api-access-678fz\") pod \"ingress-canary-ph9b2\" (UID: \"2ed94aac-788d-4c4e-9e41-22c864979f4b\") " pod="openshift-ingress-canary/ingress-canary-ph9b2"
Jul 17 15:09:43.487702 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.487533    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50c7fa37-6581-4c75-9081-eca174cc2681-tmp-dir\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.487702 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.487570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed94aac-788d-4c4e-9e41-22c864979f4b-cert\") pod \"ingress-canary-ph9b2\" (UID: \"2ed94aac-788d-4c4e-9e41-22c864979f4b\") " pod="openshift-ingress-canary/ingress-canary-ph9b2"
Jul 17 15:09:43.487702 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.487584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50c7fa37-6581-4c75-9081-eca174cc2681-config-volume\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.487702 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.487634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.487702 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.487656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htvxq\" (UniqueName: \"kubernetes.io/projected/50c7fa37-6581-4c75-9081-eca174cc2681-kube-api-access-htvxq\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.487972 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:43.487797    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 15:09:43.487972 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:43.487875    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls podName:50c7fa37-6581-4c75-9081-eca174cc2681 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:43.98784231 +0000 UTC m=+35.652292399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls") pod "dns-default-v2wgw" (UID: "50c7fa37-6581-4c75-9081-eca174cc2681") : secret "dns-default-metrics-tls" not found
Jul 17 15:09:43.488078 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.487980    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50c7fa37-6581-4c75-9081-eca174cc2681-tmp-dir\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.488286 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.488255    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50c7fa37-6581-4c75-9081-eca174cc2681-config-volume\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.492144 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.492122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed94aac-788d-4c4e-9e41-22c864979f4b-cert\") pod \"ingress-canary-ph9b2\" (UID: \"2ed94aac-788d-4c4e-9e41-22c864979f4b\") " pod="openshift-ingress-canary/ingress-canary-ph9b2"
Jul 17 15:09:43.498415 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.498393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-678fz\" (UniqueName: \"kubernetes.io/projected/2ed94aac-788d-4c4e-9e41-22c864979f4b-kube-api-access-678fz\") pod \"ingress-canary-ph9b2\" (UID: \"2ed94aac-788d-4c4e-9e41-22c864979f4b\") " pod="openshift-ingress-canary/ingress-canary-ph9b2"
Jul 17 15:09:43.498572 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.498554    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htvxq\" (UniqueName: \"kubernetes.io/projected/50c7fa37-6581-4c75-9081-eca174cc2681-kube-api-access-htvxq\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.518561 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.518530    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ph9b2"
Jul 17 15:09:43.914595 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.914557    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:43.981223 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.981190    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:43.991305 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:43.991281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:43.991444 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:43.991424    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 15:09:43.991499 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:43.991489    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls podName:50c7fa37-6581-4c75-9081-eca174cc2681 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:44.991472833 +0000 UTC m=+36.655922915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls") pod "dns-default-v2wgw" (UID: "50c7fa37-6581-4c75-9081-eca174cc2681") : secret "dns-default-metrics-tls" not found
Jul 17 15:09:44.047535 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:44.047505    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:44.898457 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:44.898420    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:09:44.898457 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:44.898459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:09:44.899123 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:44.898420    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:09:44.904460 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:44.901884    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 15:09:44.904460 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:44.901892    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8gqh\""
Jul 17 15:09:44.904460 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:44.903152    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 15:09:44.904460 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:44.903366    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 15:09:44.904460 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:44.903389    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54ptc\""
Jul 17 15:09:44.904460 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:44.903685    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 15:09:44.999281 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:44.999252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:44.999431 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:44.999373    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 15:09:44.999479 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:44.999442    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls podName:50c7fa37-6581-4c75-9081-eca174cc2681 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:46.99942178 +0000 UTC m=+38.663871864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls") pod "dns-default-v2wgw" (UID: "50c7fa37-6581-4c75-9081-eca174cc2681") : secret "dns-default-metrics-tls" not found
Jul 17 15:09:45.115919 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:45.115890    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ph9b2"]
Jul 17 15:09:45.179661 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:45.179594    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed94aac_788d_4c4e_9e41_22c864979f4b.slice/crio-e9750599e3f9db8304969ad9f887c4e26f9ff971212234c184b3808b80c8038f WatchSource:0}: Error finding container e9750599e3f9db8304969ad9f887c4e26f9ff971212234c184b3808b80c8038f: Status 404 returned error can't find the container with id e9750599e3f9db8304969ad9f887c4e26f9ff971212234c184b3808b80c8038f
Jul 17 15:09:46.039383 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:46.039097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ph9b2" event={"ID":"2ed94aac-788d-4c4e-9e41-22c864979f4b","Type":"ContainerStarted","Data":"e9750599e3f9db8304969ad9f887c4e26f9ff971212234c184b3808b80c8038f"}
Jul 17 15:09:46.042131 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:46.042101    2582 generic.go:356] "Generic (PLEG): container finished" podID="acf2031e-cd00-45d5-8356-40222284359c" containerID="a5485be6ab3f0826eb8bf52bc6d0591ce0c76286f20f7f1a60911dc8c1124ee8" exitCode=0
Jul 17 15:09:46.042237 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:46.042134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6grj" event={"ID":"acf2031e-cd00-45d5-8356-40222284359c","Type":"ContainerDied","Data":"a5485be6ab3f0826eb8bf52bc6d0591ce0c76286f20f7f1a60911dc8c1124ee8"}
Jul 17 15:09:47.011730 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:47.011700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:47.011896 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:47.011855    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 15:09:47.011951 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:47.011914    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls podName:50c7fa37-6581-4c75-9081-eca174cc2681 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:51.011898594 +0000 UTC m=+42.676348676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls") pod "dns-default-v2wgw" (UID: "50c7fa37-6581-4c75-9081-eca174cc2681") : secret "dns-default-metrics-tls" not found
Jul 17 15:09:47.047650 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:47.047619    2582 generic.go:356] "Generic (PLEG): container finished" podID="acf2031e-cd00-45d5-8356-40222284359c" containerID="c065ac62500f7ebe86ab9a88b2365edf4e2ead6f8c9ab02cdffbe1495862eaf2" exitCode=0
Jul 17 15:09:47.048013 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:47.047656    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6grj" event={"ID":"acf2031e-cd00-45d5-8356-40222284359c","Type":"ContainerDied","Data":"c065ac62500f7ebe86ab9a88b2365edf4e2ead6f8c9ab02cdffbe1495862eaf2"}
Jul 17 15:09:47.611880 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:47.611800    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:47.713770 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:47.713657    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:47.914209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:47.914185    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:48.016200 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:48.016165    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:48.052534 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:48.052503    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r6grj" event={"ID":"acf2031e-cd00-45d5-8356-40222284359c","Type":"ContainerStarted","Data":"c429207f6b460428150f085b8039a990eff31bc900124c1e8690368ed0960e88"}
Jul 17 15:09:48.217225 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:48.217201    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:48.284578 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:48.284547    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:48.542591 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:48.542420    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:48.916615 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:48.916533    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:48.982989 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:48.982957    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:49.056277 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.056241    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ph9b2" event={"ID":"2ed94aac-788d-4c4e-9e41-22c864979f4b","Type":"ContainerStarted","Data":"a21488e3a1982130cc2d6782f61a596dab24a07070da5e87f0bd30167aa77fe8"}
Jul 17 15:09:49.076797 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.076752    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r6grj" podStartSLOduration=17.958920066 podStartE2EDuration="40.076738603s" totalImagesPullingTime="22.117818537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:48.089477335 +0000 UTC m=+39.753927451" watchObservedRunningTime="2026-07-17 15:09:49.076738603 +0000 UTC m=+40.741188769"
Jul 17 15:09:49.076923 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.076871    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ph9b2" podStartSLOduration=3.086073527 podStartE2EDuration="6.076867086s" totalImagesPullingTime="2.990793559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:49.076042928 +0000 UTC m=+40.740493033" watchObservedRunningTime="2026-07-17 15:09:49.076867086 +0000 UTC m=+40.741317184"
Jul 17 15:09:49.113784 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.113760    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4nldf"]
Jul 17 15:09:49.134156 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.134133    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4nldf"]
Jul 17 15:09:49.134268 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.134221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.136809 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.136785    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 15:09:49.136964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.136793    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 15:09:49.136964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.136904    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 15:09:49.136964 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.136908    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 15:09:49.137194 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.137180    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rtllk\""
Jul 17 15:09:49.147078 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.147056    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:49.224874 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.224786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.224874 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.224817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8jpv\" (UniqueName: \"kubernetes.io/projected/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-api-access-p8jpv\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.224874 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.224863    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1731595-b5af-4867-8aa9-2fc220ff1a51-crio-socket\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.225053 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.225002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1731595-b5af-4867-8aa9-2fc220ff1a51-data-volume\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.225053 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.225030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.227406 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.227384    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:49.313669 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.313638    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd"]
Jul 17 15:09:49.325658 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.325499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1731595-b5af-4867-8aa9-2fc220ff1a51-data-volume\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.325658 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.325544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.325658 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.325608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.325658 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.325641    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8jpv\" (UniqueName: \"kubernetes.io/projected/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-api-access-p8jpv\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.325958 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.325681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1731595-b5af-4867-8aa9-2fc220ff1a51-crio-socket\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.325958 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:49.325703    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 15:09:49.325958 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:49.325734    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 15:09:49.325958 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:49.325781    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm podName:d1731595-b5af-4867-8aa9-2fc220ff1a51 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:49.825758782 +0000 UTC m=+41.490208876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nldf" (UID: "d1731595-b5af-4867-8aa9-2fc220ff1a51") : configmap "kube-rbac-proxy" not found
Jul 17 15:09:49.325958 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:49.325800    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls podName:d1731595-b5af-4867-8aa9-2fc220ff1a51 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:49.825790603 +0000 UTC m=+41.490240691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nldf" (UID: "d1731595-b5af-4867-8aa9-2fc220ff1a51") : secret "insights-runtime-extractor-tls" not found
Jul 17 15:09:49.326144 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.325977    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1731595-b5af-4867-8aa9-2fc220ff1a51-data-volume\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.326144 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.325999    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1731595-b5af-4867-8aa9-2fc220ff1a51-crio-socket\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.328083 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.327072    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:49.334535 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.334097    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd"]
Jul 17 15:09:49.334535 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.334215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd"
Jul 17 15:09:49.339689 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.337197    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 17 15:09:49.339689 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.337506    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 17 15:09:49.339689 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.337708    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lvsfg\""
Jul 17 15:09:49.343180 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.343148    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8jpv\" (UniqueName: \"kubernetes.io/projected/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-api-access-p8jpv\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.400187 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.400162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:49.426796 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.426767    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2pkp\" (UniqueName: \"kubernetes.io/projected/9281490b-5e58-4901-9883-fbda88af0e75-kube-api-access-x2pkp\") pod \"migrator-7cc9c7ffd7-mrdcd\" (UID: \"9281490b-5e58-4901-9883-fbda88af0e75\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd"
Jul 17 15:09:49.527278 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.527248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2pkp\" (UniqueName: \"kubernetes.io/projected/9281490b-5e58-4901-9883-fbda88af0e75-kube-api-access-x2pkp\") pod \"migrator-7cc9c7ffd7-mrdcd\" (UID: \"9281490b-5e58-4901-9883-fbda88af0e75\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd"
Jul 17 15:09:49.537488 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.537462    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2pkp\" (UniqueName: \"kubernetes.io/projected/9281490b-5e58-4901-9883-fbda88af0e75-kube-api-access-x2pkp\") pod \"migrator-7cc9c7ffd7-mrdcd\" (UID: \"9281490b-5e58-4901-9883-fbda88af0e75\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd"
Jul 17 15:09:49.662293 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.662259    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd"
Jul 17 15:09:49.799233 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.799161    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd"]
Jul 17 15:09:49.802043 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:49.802015    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9281490b_5e58_4901_9883_fbda88af0e75.slice/crio-5dac6f1ca5dc0defc3f42b7498315550c8d4afd4541ae86b2ee471090d264f8c WatchSource:0}: Error finding container 5dac6f1ca5dc0defc3f42b7498315550c8d4afd4541ae86b2ee471090d264f8c: Status 404 returned error can't find the container with id 5dac6f1ca5dc0defc3f42b7498315550c8d4afd4541ae86b2ee471090d264f8c
Jul 17 15:09:49.828224 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.828196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:49.829468 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.829447    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.829526 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.829491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:49.829611 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:49.829599    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 15:09:49.829658 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:49.829648    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls podName:d1731595-b5af-4867-8aa9-2fc220ff1a51 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:50.829636902 +0000 UTC m=+42.494086997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nldf" (UID: "d1731595-b5af-4867-8aa9-2fc220ff1a51") : secret "insights-runtime-extractor-tls" not found
Jul 17 15:09:49.829696 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:49.829599    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 15:09:49.829738 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:49.829728    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm podName:d1731595-b5af-4867-8aa9-2fc220ff1a51 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:50.829716779 +0000 UTC m=+42.494166864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nldf" (UID: "d1731595-b5af-4867-8aa9-2fc220ff1a51") : configmap "kube-rbac-proxy" not found
Jul 17 15:09:49.936051 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:49.936009    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:50.059766 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:50.059684    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd" event={"ID":"9281490b-5e58-4901-9883-fbda88af0e75","Type":"ContainerStarted","Data":"5dac6f1ca5dc0defc3f42b7498315550c8d4afd4541ae86b2ee471090d264f8c"}
Jul 17 15:09:50.256920 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:50.256886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:50.313417 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:50.313342    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:50.546333 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:50.546298    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:50.637634 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:50.637550    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:50.836797 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:50.836759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:50.836980 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:50.836831    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 15:09:50.836980 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:50.836861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:50.836980 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:50.836908    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm podName:d1731595-b5af-4867-8aa9-2fc220ff1a51 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:52.836890958 +0000 UTC m=+44.501341040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nldf" (UID: "d1731595-b5af-4867-8aa9-2fc220ff1a51") : configmap "kube-rbac-proxy" not found
Jul 17 15:09:50.836980 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:50.836968    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 15:09:50.837192 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:50.837018    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls podName:d1731595-b5af-4867-8aa9-2fc220ff1a51 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:52.83700687 +0000 UTC m=+44.501456954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nldf" (UID: "d1731595-b5af-4867-8aa9-2fc220ff1a51") : secret "insights-runtime-extractor-tls" not found
Jul 17 15:09:51.038237 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:51.038205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:51.038396 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:51.038353    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 15:09:51.038438 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:51.038414    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls podName:50c7fa37-6581-4c75-9081-eca174cc2681 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:59.038399068 +0000 UTC m=+50.702849150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls") pod "dns-default-v2wgw" (UID: "50c7fa37-6581-4c75-9081-eca174cc2681") : secret "dns-default-metrics-tls" not found
Jul 17 15:09:51.312323 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:51.312258    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jqm97_21493365-4d8d-4699-967a-59fefc50cc48/dns-node-resolver/0.log"
Jul 17 15:09:52.064985 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.064950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd" event={"ID":"9281490b-5e58-4901-9883-fbda88af0e75","Type":"ContainerStarted","Data":"eb0172d2ac58b8fdd13264c329586aafef530446046d01f3253503a662047156"}
Jul 17 15:09:52.065126 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.065004    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd" event={"ID":"9281490b-5e58-4901-9883-fbda88af0e75","Type":"ContainerStarted","Data":"cdceabe3f91c2f056872a423887e0f76b5c7001bd46a3e44f2eb9cebd6d42411"}
Jul 17 15:09:52.082252 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.082183    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mrdcd" podStartSLOduration=1.417222033 podStartE2EDuration="3.082164627s" totalImagesPullingTime="1.664942594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:52.081868288 +0000 UTC m=+43.746318382" watchObservedRunningTime="2026-07-17 15:09:52.082164627 +0000 UTC m=+43.746614732"
Jul 17 15:09:52.112890 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.112869    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ml224_6f5da215-d35b-40d3-a7e8-04073e6510e7/node-ca/0.log"
Jul 17 15:09:52.142661 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.142635    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qqjm8"]
Jul 17 15:09:52.168658 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.168626    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qqjm8"]
Jul 17 15:09:52.168754 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.168738    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-qqjm8"
Jul 17 15:09:52.172285 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.172252    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 17 15:09:52.172405 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.172307    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 17 15:09:52.172405 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.172312    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 17 15:09:52.172405 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.172381    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5q6sp\""
Jul 17 15:09:52.172538 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.172410    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 17 15:09:52.174199 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.174174    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:52.236677 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.236640    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:52.247253 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.247232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4da0e0b8-d58e-4751-9996-531015ef1081-signing-key\") pod \"service-ca-58598695f7-qqjm8\" (UID: \"4da0e0b8-d58e-4751-9996-531015ef1081\") " pod="openshift-service-ca/service-ca-58598695f7-qqjm8"
Jul 17 15:09:52.247318 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.247257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4da0e0b8-d58e-4751-9996-531015ef1081-signing-cabundle\") pod \"service-ca-58598695f7-qqjm8\" (UID: \"4da0e0b8-d58e-4751-9996-531015ef1081\") " pod="openshift-service-ca/service-ca-58598695f7-qqjm8"
Jul 17 15:09:52.247318 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.247304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld9fm\" (UniqueName: \"kubernetes.io/projected/4da0e0b8-d58e-4751-9996-531015ef1081-kube-api-access-ld9fm\") pod \"service-ca-58598695f7-qqjm8\" (UID: \"4da0e0b8-d58e-4751-9996-531015ef1081\") " pod="openshift-service-ca/service-ca-58598695f7-qqjm8"
Jul 17 15:09:52.348607 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.348518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4da0e0b8-d58e-4751-9996-531015ef1081-signing-key\") pod \"service-ca-58598695f7-qqjm8\" (UID: \"4da0e0b8-d58e-4751-9996-531015ef1081\") " pod="openshift-service-ca/service-ca-58598695f7-qqjm8"
Jul 17 15:09:52.348607 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.348555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4da0e0b8-d58e-4751-9996-531015ef1081-signing-cabundle\") pod \"service-ca-58598695f7-qqjm8\" (UID: \"4da0e0b8-d58e-4751-9996-531015ef1081\") " pod="openshift-service-ca/service-ca-58598695f7-qqjm8"
Jul 17 15:09:52.349119 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.348690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld9fm\" (UniqueName: \"kubernetes.io/projected/4da0e0b8-d58e-4751-9996-531015ef1081-kube-api-access-ld9fm\") pod \"service-ca-58598695f7-qqjm8\" (UID: \"4da0e0b8-d58e-4751-9996-531015ef1081\") " pod="openshift-service-ca/service-ca-58598695f7-qqjm8"
Jul 17 15:09:52.349303 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.349266    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4da0e0b8-d58e-4751-9996-531015ef1081-signing-cabundle\") pod \"service-ca-58598695f7-qqjm8\" (UID: \"4da0e0b8-d58e-4751-9996-531015ef1081\") " pod="openshift-service-ca/service-ca-58598695f7-qqjm8"
Jul 17 15:09:52.351021 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.350998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4da0e0b8-d58e-4751-9996-531015ef1081-signing-key\") pod \"service-ca-58598695f7-qqjm8\" (UID: \"4da0e0b8-d58e-4751-9996-531015ef1081\") " pod="openshift-service-ca/service-ca-58598695f7-qqjm8"
Jul 17 15:09:52.358675 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.358656    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld9fm\" (UniqueName: \"kubernetes.io/projected/4da0e0b8-d58e-4751-9996-531015ef1081-kube-api-access-ld9fm\") pod \"service-ca-58598695f7-qqjm8\" (UID: \"4da0e0b8-d58e-4751-9996-531015ef1081\") " pod="openshift-service-ca/service-ca-58598695f7-qqjm8"
Jul 17 15:09:52.477075 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.477040    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-qqjm8"
Jul 17 15:09:52.604730 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.604663    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-qqjm8"]
Jul 17 15:09:52.622412 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:09:52.622374    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da0e0b8_d58e_4751_9996_531015ef1081.slice/crio-ed6dbd56424c9aa5cffa45188db15f067e4dd6adde04700d356cb82303fffd4d WatchSource:0}: Error finding container ed6dbd56424c9aa5cffa45188db15f067e4dd6adde04700d356cb82303fffd4d: Status 404 returned error can't find the container with id ed6dbd56424c9aa5cffa45188db15f067e4dd6adde04700d356cb82303fffd4d
Jul 17 15:09:52.710104 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.710064    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ph9b2_2ed94aac-788d-4c4e-9e41-22c864979f4b/serve-healthcheck-canary/0.log"
Jul 17 15:09:52.852566 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.852528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:52.852727 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:52.852575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:52.852727 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:52.852681    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 15:09:52.852792 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:52.852741    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm podName:d1731595-b5af-4867-8aa9-2fc220ff1a51 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:56.852727915 +0000 UTC m=+48.517177998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nldf" (UID: "d1731595-b5af-4867-8aa9-2fc220ff1a51") : configmap "kube-rbac-proxy" not found
Jul 17 15:09:52.852792 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:52.852682    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 15:09:52.852883 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:52.852817    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls podName:d1731595-b5af-4867-8aa9-2fc220ff1a51 nodeName:}" failed. No retries permitted until 2026-07-17 15:09:56.852804014 +0000 UTC m=+48.517254096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nldf" (UID: "d1731595-b5af-4867-8aa9-2fc220ff1a51") : secret "insights-runtime-extractor-tls" not found
Jul 17 15:09:53.068211 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:53.068175    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-qqjm8" event={"ID":"4da0e0b8-d58e-4751-9996-531015ef1081","Type":"ContainerStarted","Data":"ed6dbd56424c9aa5cffa45188db15f067e4dd6adde04700d356cb82303fffd4d"}
Jul 17 15:09:53.085455 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:53.085432    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:53.217614 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:53.217576    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:55.734406 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:55.734373    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:56.076534 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:56.076506    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-qqjm8" event={"ID":"4da0e0b8-d58e-4751-9996-531015ef1081","Type":"ContainerStarted","Data":"f48cd890794cfae4383e31ec724c59ce5cada77c527f4d1beeaaa9ac8f337a88"}
Jul 17 15:09:56.095318 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:56.095272    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-qqjm8" podStartSLOduration=1.5575907450000002 podStartE2EDuration="4.095258457s" totalImagesPullingTime="2.537667712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:09:56.094108499 +0000 UTC m=+47.758558603" watchObservedRunningTime="2026-07-17 15:09:56.095258457 +0000 UTC m=+47.759708610"
Jul 17 15:09:56.278233 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:56.278197    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:56.379581 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:56.379489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:56.480816 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:56.480778    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:56.580578 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:56.580543    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:56.886801 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:56.886767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:56.887209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:56.886822    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:56.887209 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:56.886948    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 15:09:56.887209 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:56.887024    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls podName:d1731595-b5af-4867-8aa9-2fc220ff1a51 nodeName:}" failed. No retries permitted until 2026-07-17 15:10:04.887001876 +0000 UTC m=+56.551451967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nldf" (UID: "d1731595-b5af-4867-8aa9-2fc220ff1a51") : secret "insights-runtime-extractor-tls" not found
Jul 17 15:09:56.887322 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:56.887306    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1731595-b5af-4867-8aa9-2fc220ff1a51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:09:57.171197 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:57.171117    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:57.780856 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:57.780822    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:58.371521 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:58.371484    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:58.573280 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:58.573240    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:58.765256 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:58.765223    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:58.979133 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:58.979097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:59.105730 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:59.105655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:09:59.105884 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:59.105795    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 15:09:59.105884 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:09:59.105871    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls podName:50c7fa37-6581-4c75-9081-eca174cc2681 nodeName:}" failed. No retries permitted until 2026-07-17 15:10:15.10583682 +0000 UTC m=+66.770286902 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls") pod "dns-default-v2wgw" (UID: "50c7fa37-6581-4c75-9081-eca174cc2681") : secret "dns-default-metrics-tls" not found
Jul 17 15:09:59.170126 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:59.170095    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:59.232317 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:59.232285    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:59.768431 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:59.768398    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:09:59.966348 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:09:59.966313    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:00.096483 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:00.096381    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:00.382411 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:00.382333    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:00.570448 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:00.570413    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:00.671143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:00.671059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:00.770610 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:00.770570    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:00.871931 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:00.871901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:01.060369 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:01.060342    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:01.127154 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:01.127116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:01.210563 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:01.210530    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:01.311250 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:01.311181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:01.653831 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:01.653750    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:01.757016 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:01.756986    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:01.972507 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:01.972425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:02.172567 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:02.172536    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:02.276008 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:02.275976    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:02.606150 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:02.606070    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:02.706226 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:02.706197    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:02.807067 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:02.807033    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:02.911266 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:02.911189    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:03.011599 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:03.011569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:03.367616 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:03.367576    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:03.774117 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:03.774087    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:04.171130 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:04.171059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:04.569346 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:04.569320    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:04.952598 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:04.952514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:10:04.954698 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:04.954671    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1731595-b5af-4867-8aa9-2fc220ff1a51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nldf\" (UID: \"d1731595-b5af-4867-8aa9-2fc220ff1a51\") " pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:10:04.969137 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:04.969108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:05.043263 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:05.043240    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4nldf"
Jul 17 15:10:05.166396 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:05.166369    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4nldf"]
Jul 17 15:10:05.169623 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:10:05.169595    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1731595_b5af_4867_8aa9_2fc220ff1a51.slice/crio-8aefb9a8212eec1616eff63d2f8c0c9c6eabba7d3b766925c37cf191afb96d66 WatchSource:0}: Error finding container 8aefb9a8212eec1616eff63d2f8c0c9c6eabba7d3b766925c37cf191afb96d66: Status 404 returned error can't find the container with id 8aefb9a8212eec1616eff63d2f8c0c9c6eabba7d3b766925c37cf191afb96d66
Jul 17 15:10:05.175441 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:05.175414    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:05.784123 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:05.784079    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:06.104505 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:06.104413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nldf" event={"ID":"d1731595-b5af-4867-8aa9-2fc220ff1a51","Type":"ContainerStarted","Data":"8aefb9a8212eec1616eff63d2f8c0c9c6eabba7d3b766925c37cf191afb96d66"}
Jul 17 15:10:06.376895 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:06.376798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:06.568092 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:06.568059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:06.769875 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:06.769829    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:06.972025 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:06.971980    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:07.378589 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:07.378556    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:08.883199 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:08.883161    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:08.983647 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:08.983609    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:10.040350 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.040318    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pvtq5"
Jul 17 15:10:10.673821 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.673745    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl"]
Jul 17 15:10:10.690932 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.689670    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9"]
Jul 17 15:10:10.690932 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.690605    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl"
Jul 17 15:10:10.693866 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.693823    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4gm8h\""
Jul 17 15:10:10.693979 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.693888    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 17 15:10:10.694026 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.693998    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 17 15:10:10.703287 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.703267    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"]
Jul 17 15:10:10.703394 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.703379    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9"
Jul 17 15:10:10.706728 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.706712    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 15:10:10.707923 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.707905    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t9f4x\""
Jul 17 15:10:10.708001 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.707906    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 17 15:10:10.708439 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.708367    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 15:10:10.708584 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.708564    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 15:10:10.724218 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.724194    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl"]
Jul 17 15:10:10.724313 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.724228    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9"]
Jul 17 15:10:10.724313 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.724239    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"]
Jul 17 15:10:10.724434 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.724311    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.726837 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.726817    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 17 15:10:10.726963 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.726821    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 17 15:10:10.727024 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.727009    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 17 15:10:10.727103 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.727081    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 17 15:10:10.797261 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.797230    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-ca\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.797261 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.797260    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-hub\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.797488 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.797279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b3259bdf-a344-4624-bf7f-957e6d70543a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-qgqnl\" (UID: \"b3259bdf-a344-4624-bf7f-957e6d70543a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl"
Jul 17 15:10:10.797488 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.797411    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.797488 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.797461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/08fd7a41-ee09-4775-86b9-ad9aa9133477-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.797640 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.797491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.797640 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.797531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf9xq\" (UniqueName: \"kubernetes.io/projected/08fd7a41-ee09-4775-86b9-ad9aa9133477-kube-api-access-lf9xq\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.797640 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.797558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlgns\" (UniqueName: \"kubernetes.io/projected/c62ec158-7584-4247-a814-d929c0688ad7-kube-api-access-tlgns\") pod \"managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9\" (UID: \"c62ec158-7584-4247-a814-d929c0688ad7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9"
Jul 17 15:10:10.797640 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.797604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c62ec158-7584-4247-a814-d929c0688ad7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9\" (UID: \"c62ec158-7584-4247-a814-d929c0688ad7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9"
Jul 17 15:10:10.797640 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.797634    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3259bdf-a344-4624-bf7f-957e6d70543a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qgqnl\" (UID: \"b3259bdf-a344-4624-bf7f-957e6d70543a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl"
Jul 17 15:10:10.818011 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.817971    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:10.898620 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.898589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-ca\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.898620 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.898617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-hub\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.898810 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.898635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b3259bdf-a344-4624-bf7f-957e6d70543a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-qgqnl\" (UID: \"b3259bdf-a344-4624-bf7f-957e6d70543a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl"
Jul 17 15:10:10.898810 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.898681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.898810 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.898717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/08fd7a41-ee09-4775-86b9-ad9aa9133477-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.898810 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.898739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.898810 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.898775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf9xq\" (UniqueName: \"kubernetes.io/projected/08fd7a41-ee09-4775-86b9-ad9aa9133477-kube-api-access-lf9xq\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.898810 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.898798    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlgns\" (UniqueName: \"kubernetes.io/projected/c62ec158-7584-4247-a814-d929c0688ad7-kube-api-access-tlgns\") pod \"managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9\" (UID: \"c62ec158-7584-4247-a814-d929c0688ad7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9"
Jul 17 15:10:10.899131 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.898833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c62ec158-7584-4247-a814-d929c0688ad7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9\" (UID: \"c62ec158-7584-4247-a814-d929c0688ad7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9"
Jul 17 15:10:10.899131 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.898884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3259bdf-a344-4624-bf7f-957e6d70543a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qgqnl\" (UID: \"b3259bdf-a344-4624-bf7f-957e6d70543a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl"
Jul 17 15:10:10.899541 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.899489    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b3259bdf-a344-4624-bf7f-957e6d70543a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-qgqnl\" (UID: \"b3259bdf-a344-4624-bf7f-957e6d70543a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl"
Jul 17 15:10:10.899700 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.899659    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/08fd7a41-ee09-4775-86b9-ad9aa9133477-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.901606 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.901584    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-ca\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.901725 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.901699    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-hub\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.901799 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.901787    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.902368 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.902347    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c62ec158-7584-4247-a814-d929c0688ad7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9\" (UID: \"c62ec158-7584-4247-a814-d929c0688ad7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9"
Jul 17 15:10:10.902790 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.902765    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/08fd7a41-ee09-4775-86b9-ad9aa9133477-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.902902 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.902775    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3259bdf-a344-4624-bf7f-957e6d70543a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qgqnl\" (UID: \"b3259bdf-a344-4624-bf7f-957e6d70543a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl"
Jul 17 15:10:10.908622 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.908601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf9xq\" (UniqueName: \"kubernetes.io/projected/08fd7a41-ee09-4775-86b9-ad9aa9133477-kube-api-access-lf9xq\") pod \"cluster-proxy-proxy-agent-6b74b4574f-2pdxr\" (UID: \"08fd7a41-ee09-4775-86b9-ad9aa9133477\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:10.908796 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.908773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlgns\" (UniqueName: \"kubernetes.io/projected/c62ec158-7584-4247-a814-d929c0688ad7-kube-api-access-tlgns\") pod \"managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9\" (UID: \"c62ec158-7584-4247-a814-d929c0688ad7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9"
Jul 17 15:10:10.922788 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.922761    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:10.999948 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:10.999919    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl"
Jul 17 15:10:11.023406 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:11.023357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:11.026193 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:11.026170    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9"
Jul 17 15:10:11.032471 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:11.032347    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"
Jul 17 15:10:11.131659 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:11.131627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nldf" event={"ID":"d1731595-b5af-4867-8aa9-2fc220ff1a51","Type":"ContainerStarted","Data":"febf85a2da54852d5162c6fdaa1cfc5cd58143bd671b55dc84c57526fb067c07"}
Jul 17 15:10:11.173714 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:11.173632    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl"]
Jul 17 15:10:11.200419 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:11.200395    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9"]
Jul 17 15:10:11.205879 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:10:11.205832    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc62ec158_7584_4247_a814_d929c0688ad7.slice/crio-b65c130d17cbbaacce6baa6384548f58b94e6cb7c1eb5fbf2750189d53e2c00c WatchSource:0}: Error finding container b65c130d17cbbaacce6baa6384548f58b94e6cb7c1eb5fbf2750189d53e2c00c: Status 404 returned error can't find the container with id b65c130d17cbbaacce6baa6384548f58b94e6cb7c1eb5fbf2750189d53e2c00c
Jul 17 15:10:11.222215 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:11.222167    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr"]
Jul 17 15:10:11.225364 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:10:11.225338    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08fd7a41_ee09_4775_86b9_ad9aa9133477.slice/crio-e85016d8588933d1a30dbf7df1ce4298897bac8d93d9ed2079d946504dbe7184 WatchSource:0}: Error finding container e85016d8588933d1a30dbf7df1ce4298897bac8d93d9ed2079d946504dbe7184: Status 404 returned error can't find the container with id e85016d8588933d1a30dbf7df1ce4298897bac8d93d9ed2079d946504dbe7184
Jul 17 15:10:12.137726 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:12.137656    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr" event={"ID":"08fd7a41-ee09-4775-86b9-ad9aa9133477","Type":"ContainerStarted","Data":"e85016d8588933d1a30dbf7df1ce4298897bac8d93d9ed2079d946504dbe7184"}
Jul 17 15:10:12.139148 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:12.139105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9" event={"ID":"c62ec158-7584-4247-a814-d929c0688ad7","Type":"ContainerStarted","Data":"b65c130d17cbbaacce6baa6384548f58b94e6cb7c1eb5fbf2750189d53e2c00c"}
Jul 17 15:10:12.140421 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:12.140393    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl" event={"ID":"b3259bdf-a344-4624-bf7f-957e6d70543a","Type":"ContainerStarted","Data":"50dfdb73521a6cb64eae45dfba2c8dc1fd88f4eadc3ffa3fb285dc51096338e7"}
Jul 17 15:10:14.528554 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.528480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:10:14.532048 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.532021    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 15:10:14.541251 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.541223    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7-metrics-certs\") pod \"network-metrics-daemon-8xxqp\" (UID: \"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7\") " pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:10:14.619948 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.619912    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8gqh\""
Jul 17 15:10:14.627573 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.627549    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8xxqp"
Jul 17 15:10:14.629088 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.628943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:10:14.632816 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.632795    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 15:10:14.642605 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.642586    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8-original-pull-secret\") pod \"global-pull-secret-syncer-pqp8d\" (UID: \"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8\") " pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:10:14.729453 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.729423    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5gqp\" (UniqueName: \"kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp\") pod \"network-check-target-8kx7g\" (UID: \"1a6337dd-e0d3-430e-9575-4ba6f2278cd2\") " pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:10:14.733470 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.733449    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 15:10:14.742738 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.742713    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 15:10:14.753954 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.753814    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5gqp\" (UniqueName: \"kubernetes.io/projected/1a6337dd-e0d3-430e-9575-4ba6f2278cd2-kube-api-access-z5gqp\") pod \"network-check-target-8kx7g\" (UID: \"1a6337dd-e0d3-430e-9575-4ba6f2278cd2\") " pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:10:14.914724 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.914655    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54ptc\""
Jul 17 15:10:14.920875 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.920837    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pqp8d"
Jul 17 15:10:14.921958 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:14.921894    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:10:15.131580 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:15.131546    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:10:15.134239 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:15.134212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50c7fa37-6581-4c75-9081-eca174cc2681-metrics-tls\") pod \"dns-default-v2wgw\" (UID: \"50c7fa37-6581-4c75-9081-eca174cc2681\") " pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:10:15.306587 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:15.306555    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m7zkr\""
Jul 17 15:10:15.314947 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:15.314921    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:10:15.676174 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:15.676091    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:15.776814 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:15.776769    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:17.610009 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:17.609943    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pqp8d"]
Jul 17 15:10:17.622477 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:17.622412    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8kx7g"]
Jul 17 15:10:17.626889 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:10:17.626518    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a6337dd_e0d3_430e_9575_4ba6f2278cd2.slice/crio-ac949a0e6134aa7aa699811d6836d0ec0eaa083ebf877add2bec311ba8c540fd WatchSource:0}: Error finding container ac949a0e6134aa7aa699811d6836d0ec0eaa083ebf877add2bec311ba8c540fd: Status 404 returned error can't find the container with id ac949a0e6134aa7aa699811d6836d0ec0eaa083ebf877add2bec311ba8c540fd
Jul 17 15:10:17.628657 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:17.628421    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8xxqp"]
Jul 17 15:10:17.631343 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:10:17.631321    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec8ca32_252c_4d64_90d8_d2f11ea3a1c7.slice/crio-a31e65265b0e9867e127a4e827e763f992a720e5978e684db450453dab6fa2d4 WatchSource:0}: Error finding container a31e65265b0e9867e127a4e827e763f992a720e5978e684db450453dab6fa2d4: Status 404 returned error can't find the container with id a31e65265b0e9867e127a4e827e763f992a720e5978e684db450453dab6fa2d4
Jul 17 15:10:17.655069 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:17.655005    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2wgw"]
Jul 17 15:10:17.658084 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:10:17.658047    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c7fa37_6581_4c75_9081_eca174cc2681.slice/crio-2420b43dcfb1cd34e7e0a7291db483a082f0e54c8ffd4ca46bea23e4bef2ffd5 WatchSource:0}: Error finding container 2420b43dcfb1cd34e7e0a7291db483a082f0e54c8ffd4ca46bea23e4bef2ffd5: Status 404 returned error can't find the container with id 2420b43dcfb1cd34e7e0a7291db483a082f0e54c8ffd4ca46bea23e4bef2ffd5
Jul 17 15:10:17.919267 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:17.919199    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:18.023923 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.023891    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:18.162287 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.162252    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr" event={"ID":"08fd7a41-ee09-4775-86b9-ad9aa9133477","Type":"ContainerStarted","Data":"cfd8f7a2378e2db824c9099ad43d7b230e49c05bbc325385db4dd6fbf14f2209"}
Jul 17 15:10:18.162512 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.162493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr" event={"ID":"08fd7a41-ee09-4775-86b9-ad9aa9133477","Type":"ContainerStarted","Data":"35e35738653e11209aee1e6489867b0123bfe7aa10c7f24004445dd45d88a75e"}
Jul 17 15:10:18.162592 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.162558    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr" event={"ID":"08fd7a41-ee09-4775-86b9-ad9aa9133477","Type":"ContainerStarted","Data":"2dbcf62c20cad01a5f5e17493ff1e8fa373e38d940a55030ee4ed8a75a28ca10"}
Jul 17 15:10:18.164195 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.164162    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9" event={"ID":"c62ec158-7584-4247-a814-d929c0688ad7","Type":"ContainerStarted","Data":"664cb3ba192570a24a39d88cd3a0baf1ba3e94d2e566e1999f6f514abe1eb648"}
Jul 17 15:10:18.165493 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.165469    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2wgw" event={"ID":"50c7fa37-6581-4c75-9081-eca174cc2681","Type":"ContainerStarted","Data":"2420b43dcfb1cd34e7e0a7291db483a082f0e54c8ffd4ca46bea23e4bef2ffd5"}
Jul 17 15:10:18.166720 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.166690    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8xxqp" event={"ID":"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7","Type":"ContainerStarted","Data":"a31e65265b0e9867e127a4e827e763f992a720e5978e684db450453dab6fa2d4"}
Jul 17 15:10:18.167870 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.167832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pqp8d" event={"ID":"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8","Type":"ContainerStarted","Data":"bfc4cd81c030f0869adf08cad5ed629eff80292754c456ac6066eec70db125c1"}
Jul 17 15:10:18.170200 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.170138    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nldf" event={"ID":"d1731595-b5af-4867-8aa9-2fc220ff1a51","Type":"ContainerStarted","Data":"acc22a53025a0c6f434c6f73da3345880597b600b34ca6a804ec937402b82404"}
Jul 17 15:10:18.171485 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.171462    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8kx7g" event={"ID":"1a6337dd-e0d3-430e-9575-4ba6f2278cd2","Type":"ContainerStarted","Data":"ac949a0e6134aa7aa699811d6836d0ec0eaa083ebf877add2bec311ba8c540fd"}
Jul 17 15:10:18.173027 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.173008    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl" event={"ID":"b3259bdf-a344-4624-bf7f-957e6d70543a","Type":"ContainerStarted","Data":"322edb9cc4e9110dfd693943f2f99cb25fca998ac7eee7b17f01f7c51020720c"}
Jul 17 15:10:18.184097 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.184049    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b74b4574f-2pdxr" podStartSLOduration=1.965436024 podStartE2EDuration="8.184032576s" totalImagesPullingTime="6.218596552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:18.183234376 +0000 UTC m=+69.847684479" watchObservedRunningTime="2026-07-17 15:10:18.184032576 +0000 UTC m=+69.848482676"
Jul 17 15:10:18.201973 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.201939    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c9bbcd6d-m5cf9" podStartSLOduration=1.9815629399999999 podStartE2EDuration="8.20192723s" totalImagesPullingTime="6.22036429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:18.200665765 +0000 UTC m=+69.865115870" watchObservedRunningTime="2026-07-17 15:10:18.20192723 +0000 UTC m=+69.866377312"
Jul 17 15:10:18.225186 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.225145    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qgqnl" podStartSLOduration=1.9843433369999999 podStartE2EDuration="8.225129358s" totalImagesPullingTime="6.240786021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:18.224736592 +0000 UTC m=+69.889186699" watchObservedRunningTime="2026-07-17 15:10:18.225129358 +0000 UTC m=+69.889579464"
Jul 17 15:10:18.328926 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.328858    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:18.426075 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.425966    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:18.526804 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.526715    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:18.944055 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:18.944020    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:19.044865 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:19.044813    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:19.137884 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:19.137739    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:19.203128 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:19.203052    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:19.286482 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:19.286442    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:20.315171 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:20.315104    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:20.695401 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:20.695310    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:20.769052 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:20.769008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:21.989149 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:21.989109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:22.068386 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:22.068350    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:23.293283 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:23.293249    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:23.394170 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:23.394116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:24.167171 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:24.167138    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:24.238602 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:24.238569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:24.667751 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:24.667665    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:24.731733 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:24.731703    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:25.199285 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.199251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2wgw" event={"ID":"50c7fa37-6581-4c75-9081-eca174cc2681","Type":"ContainerStarted","Data":"2d3a5d60c44870d3042eb4e73233c0f295a1afab61e2c9a901b641f9627598ab"}
Jul 17 15:10:25.199466 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.199301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2wgw" event={"ID":"50c7fa37-6581-4c75-9081-eca174cc2681","Type":"ContainerStarted","Data":"034fdd69a10774ec4a6561b35b0b6a5fc7ea3e2b7a7e4b5912be92091cba11e4"}
Jul 17 15:10:25.199466 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.199357    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:10:25.201086 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.201062    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8xxqp" event={"ID":"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7","Type":"ContainerStarted","Data":"10a89531f8b1ab00319b5af2591131c809ec84b791c3af1d7ea99f26a3c20110"}
Jul 17 15:10:25.201188 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.201109    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8xxqp" event={"ID":"6ec8ca32-252c-4d64-90d8-d2f11ea3a1c7","Type":"ContainerStarted","Data":"3328b8e700fc208b86c9955902c679f17d6027f19c4cee1cc91d8d296e663ffa"}
Jul 17 15:10:25.202351 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.202331    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pqp8d" event={"ID":"cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8","Type":"ContainerStarted","Data":"5b94e0bd02441e7b7ca6171d8ca059b99c0b1bfc5e37b47e34ac7fb6a1cc0a0e"}
Jul 17 15:10:25.204382 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.204363    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nldf" event={"ID":"d1731595-b5af-4867-8aa9-2fc220ff1a51","Type":"ContainerStarted","Data":"17d8f846fc9a91440db78670e432ed47590464bf544e3f1779946b00269eb3fb"}
Jul 17 15:10:25.205618 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.205600    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8kx7g" event={"ID":"1a6337dd-e0d3-430e-9575-4ba6f2278cd2","Type":"ContainerStarted","Data":"93931abea8a15aabb1b0dcc2538a9e5500ebcc517b642e2ee5d211e7e2fb0c35"}
Jul 17 15:10:25.205741 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.205720    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:10:25.223183 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.223136    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v2wgw" podStartSLOduration=35.565909037 podStartE2EDuration="42.223124633s" totalImagesPullingTime="6.657215596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:25.222017988 +0000 UTC m=+76.886468092" watchObservedRunningTime="2026-07-17 15:10:25.223124633 +0000 UTC m=+76.887574736"
Jul 17 15:10:25.262683 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.262639    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4nldf" podStartSLOduration=17.447039271 podStartE2EDuration="36.262624568s" totalImagesPullingTime="18.815585297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:25.261353627 +0000 UTC m=+76.925803731" watchObservedRunningTime="2026-07-17 15:10:25.262624568 +0000 UTC m=+76.927074672"
Jul 17 15:10:25.262951 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.262929    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8kx7g" podStartSLOduration=69.566642522 podStartE2EDuration="1m16.262922383s" totalImagesPullingTime="6.696279861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:25.239842383 +0000 UTC m=+76.904292487" watchObservedRunningTime="2026-07-17 15:10:25.262922383 +0000 UTC m=+76.927372486"
Jul 17 15:10:25.278593 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.278549    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8xxqp" podStartSLOduration=69.600551023 podStartE2EDuration="1m16.278537139s" totalImagesPullingTime="6.677986116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:25.278032425 +0000 UTC m=+76.942482530" watchObservedRunningTime="2026-07-17 15:10:25.278537139 +0000 UTC m=+76.942987243"
Jul 17 15:10:25.297143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.297078    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pqp8d" podStartSLOduration=69.582158126 podStartE2EDuration="1m16.297066533s" totalImagesPullingTime="6.714908407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 15:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:25.296327346 +0000 UTC m=+76.960777452" watchObservedRunningTime="2026-07-17 15:10:25.297066533 +0000 UTC m=+76.961516636"
Jul 17 15:10:25.417616 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.417584    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:25.511133 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:25.511104    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:26.500795 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:26.500764    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:26.603741 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:26.603694    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:27.903281 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:27.903248    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:31.069050 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:31.068932    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:31.170408 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:31.170381    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:32.069464 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:32.069425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:32.170033 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:32.170003    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:32.697942 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:32.697913    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:32.761517 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:32.761492    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:33.097908 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:33.097881    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:33.199344 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:33.199314    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:33.298681 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:33.298658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:34.931343 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:34.931305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:35.031097 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:35.031054    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:35.211346 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:35.211283    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v2wgw"
Jul 17 15:10:37.436045 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:37.436012    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:38.074170 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:38.074137    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:38.175931 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:38.175901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:39.309640 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.309600    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:39.433909 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.433883    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:39.543288 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.543252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:39.600650 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.600586    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g8vs4"]
Jul 17 15:10:39.603825 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.603807    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.606766 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.606726    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 15:10:39.606999 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.606981    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 15:10:39.608253 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.608032    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 15:10:39.608253 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.608047    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wtgbr\""
Jul 17 15:10:39.608253 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.608084    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 15:10:39.608495 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.608358    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 15:10:39.608549 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.608539    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 15:10:39.644261 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.644243    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:39.704063 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.704035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-tls\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.704151 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.704076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.704151 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.704107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-textfile\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.704151 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.704132    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-root\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.704281 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.704156    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-wtmp\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.704281 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.704186    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-metrics-client-ca\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.704281 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.704230    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.704281 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.704256    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-sys\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.704281 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.704272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgpvz\" (UniqueName: \"kubernetes.io/projected/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-kube-api-access-jgpvz\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.712019 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.711996    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:39.804665 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.804633    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-tls\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.804816 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.804683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.804816 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.804716    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-textfile\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.804816 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.804746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-root\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.804816 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.804769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-wtmp\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.804816 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.804802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-metrics-client-ca\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.805089 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.804829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.805089 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.804872    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-sys\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.805089 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.804894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgpvz\" (UniqueName: \"kubernetes.io/projected/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-kube-api-access-jgpvz\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.805265 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.805239    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-wtmp\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.805373 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.805348    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.805508 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.805489    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-root\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.805601 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.805579    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-sys\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.805765 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.805528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-textfile\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.805861 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.805639    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-metrics-client-ca\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.807839 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.807822    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-tls\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.808128 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.808110    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.814174 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.814156    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgpvz\" (UniqueName: \"kubernetes.io/projected/9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630-kube-api-access-jgpvz\") pod \"node-exporter-g8vs4\" (UID: \"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630\") " pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.826612 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.826586    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:39.913668 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.913594    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g8vs4"
Jul 17 15:10:39.922419 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:39.922394    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:39.924204 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:10:39.924178    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1fbe6b_bc5e_480d_a86f_6c2d01dd7630.slice/crio-6515aa08385ccf15f65de045f5c7f0dea776ba5444844d562ffab39d372c0277 WatchSource:0}: Error finding container 6515aa08385ccf15f65de045f5c7f0dea776ba5444844d562ffab39d372c0277: Status 404 returned error can't find the container with id 6515aa08385ccf15f65de045f5c7f0dea776ba5444844d562ffab39d372c0277
Jul 17 15:10:40.045221 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:40.045192    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:40.252734 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:40.252702    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8vs4" event={"ID":"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630","Type":"ContainerStarted","Data":"6515aa08385ccf15f65de045f5c7f0dea776ba5444844d562ffab39d372c0277"}
Jul 17 15:10:40.572215 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:40.572136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:40.659907 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:40.659879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:40.783609 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:40.783576    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:40.883178 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:40.883097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:41.257609 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:41.257577    2582 generic.go:356] "Generic (PLEG): container finished" podID="9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630" containerID="b68c716cb22c513749dc7edafa2ee09aef714453b9f15e9129b336ab0618a20d" exitCode=0
Jul 17 15:10:41.257736 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:41.257643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8vs4" event={"ID":"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630","Type":"ContainerDied","Data":"b68c716cb22c513749dc7edafa2ee09aef714453b9f15e9129b336ab0618a20d"}
Jul 17 15:10:42.008457 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:42.008424    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:42.108469 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:42.108430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:42.263463 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:42.263394    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8vs4" event={"ID":"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630","Type":"ContainerStarted","Data":"546e4e93e1aead128178292748828bf7d737870a3c3c54d2a8bff924c0e95607"}
Jul 17 15:10:42.263589 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:42.263467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8vs4" event={"ID":"9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630","Type":"ContainerStarted","Data":"353db32ef218f9e54c22b97dfbd941591e0677f02dd4295512c8591d7703c623"}
Jul 17 15:10:42.285079 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:42.285037    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g8vs4" podStartSLOduration=2.108480169 podStartE2EDuration="3.285024578s" totalImagesPullingTime="1.117144932s" totalInitContainerRuntime="59.399477ms" isStatefulPod=true podCreationTimestamp="2026-07-17 15:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:10:42.283642582 +0000 UTC m=+93.948092685" watchObservedRunningTime="2026-07-17 15:10:42.285024578 +0000 UTC m=+93.949474681"
Jul 17 15:10:42.546062 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:42.545993    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:42.643075 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:42.643048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:42.780830 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:42.780803    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:42.865457 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:42.865402    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:43.317935 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:43.317900    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:43.416717 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:43.416691    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:44.395337 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:44.395302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:44.493741 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:44.493715    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:44.578134 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:44.578108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:44.779338 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:44.779307    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:45.909666 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:45.909637    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:47.187332 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:47.187295    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:47.268720 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:47.268693    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:47.926625 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:47.926597    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:48.027023 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:48.026990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:48.151240 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:48.151212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:48.251049 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:48.251022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:56.014121 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:56.014088    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:56.114593 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:56.114565    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:10:56.211136 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:56.211112    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8kx7g"
Jul 17 15:10:56.218929 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:10:56.218906    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:11:02.913576 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:11:02.913542    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:11:03.011398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:11:03.011365    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:11:12.033423 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:11:12.033390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:11:59.043171 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:11:59.043139    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:11:59.369996 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:11:59.369915    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:12:08.202284 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:12:08.202206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:12:08.271840 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:12:08.271805    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:12:19.614747 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:12:19.614714    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:12:19.715785 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:12:19.715752    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:12:19.815046 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:12:19.815014    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:12:45.272403 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:12:45.272372    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:12:45.342228 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:12:45.342201    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:05.880971 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:05.880941    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:14.299264 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:14.299232    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:14.372235 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:14.372210    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:17.731886 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:17.731836    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:17.789660 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:17.789624    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:26.307201 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:26.307173    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:26.371061 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:26.371034    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:28.887713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:28.887679    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:28.991573 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:28.991543    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:29.060435 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:29.060412    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:32.926320 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:32.926246    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:13:33.026135 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:13:33.026110    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:08.122607 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:14:08.122578    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:08.713532 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:14:08.713506    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 15:14:13.685777 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:14:13.685738    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:14:13.781745 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:14:13.781718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:05.779592 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:05.779513    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:06.601049 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:06.601015    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:09.393762 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:09.393726    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:09.459651 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:09.459623    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:10.780985 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:10.780949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:10.876146 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:10.876120    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:11.545263 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:11.545234    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:11.636902 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:11.636862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:13.009511 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:13.009480    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:13.233314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:13.233282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:16.196251 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:16.196218    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:16.273109 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:16.273084    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:21.003122 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.003091    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:21.449637 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.449553    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nxm2r"]
Jul 17 15:15:21.454265 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.452574    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nxm2r"
Jul 17 15:15:21.455599 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.455575    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 15:15:21.455708 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.455665    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ntcxr\""
Jul 17 15:15:21.456833 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.456817    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 15:15:21.462835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.462812    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nxm2r"]
Jul 17 15:15:21.523252 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.523224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/327c9de7-a3f6-4d93-8d52-788df1642ce0-bound-sa-token\") pod \"cert-manager-55b4d954d5-nxm2r\" (UID: \"327c9de7-a3f6-4d93-8d52-788df1642ce0\") " pod="cert-manager/cert-manager-55b4d954d5-nxm2r"
Jul 17 15:15:21.523406 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.523277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqghz\" (UniqueName: \"kubernetes.io/projected/327c9de7-a3f6-4d93-8d52-788df1642ce0-kube-api-access-jqghz\") pod \"cert-manager-55b4d954d5-nxm2r\" (UID: \"327c9de7-a3f6-4d93-8d52-788df1642ce0\") " pod="cert-manager/cert-manager-55b4d954d5-nxm2r"
Jul 17 15:15:21.624480 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.624448    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/327c9de7-a3f6-4d93-8d52-788df1642ce0-bound-sa-token\") pod \"cert-manager-55b4d954d5-nxm2r\" (UID: \"327c9de7-a3f6-4d93-8d52-788df1642ce0\") " pod="cert-manager/cert-manager-55b4d954d5-nxm2r"
Jul 17 15:15:21.624638 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.624504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqghz\" (UniqueName: \"kubernetes.io/projected/327c9de7-a3f6-4d93-8d52-788df1642ce0-kube-api-access-jqghz\") pod \"cert-manager-55b4d954d5-nxm2r\" (UID: \"327c9de7-a3f6-4d93-8d52-788df1642ce0\") " pod="cert-manager/cert-manager-55b4d954d5-nxm2r"
Jul 17 15:15:21.634497 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.634475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/327c9de7-a3f6-4d93-8d52-788df1642ce0-bound-sa-token\") pod \"cert-manager-55b4d954d5-nxm2r\" (UID: \"327c9de7-a3f6-4d93-8d52-788df1642ce0\") " pod="cert-manager/cert-manager-55b4d954d5-nxm2r"
Jul 17 15:15:21.634713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.634690    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqghz\" (UniqueName: \"kubernetes.io/projected/327c9de7-a3f6-4d93-8d52-788df1642ce0-kube-api-access-jqghz\") pod \"cert-manager-55b4d954d5-nxm2r\" (UID: \"327c9de7-a3f6-4d93-8d52-788df1642ce0\") " pod="cert-manager/cert-manager-55b4d954d5-nxm2r"
Jul 17 15:15:21.762011 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.761984    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nxm2r"
Jul 17 15:15:21.882560 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.882487    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nxm2r"]
Jul 17 15:15:21.885100 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:15:21.885072    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod327c9de7_a3f6_4d93_8d52_788df1642ce0.slice/crio-b8eda0b58e53635d682786c7a9524355769d93e06531a713075aa8d84df0172c WatchSource:0}: Error finding container b8eda0b58e53635d682786c7a9524355769d93e06531a713075aa8d84df0172c: Status 404 returned error can't find the container with id b8eda0b58e53635d682786c7a9524355769d93e06531a713075aa8d84df0172c
Jul 17 15:15:21.886829 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:21.886811    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 15:15:22.136684 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:22.136600    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nxm2r" event={"ID":"327c9de7-a3f6-4d93-8d52-788df1642ce0","Type":"ContainerStarted","Data":"b8eda0b58e53635d682786c7a9524355769d93e06531a713075aa8d84df0172c"}
Jul 17 15:15:23.501251 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:23.501218    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:23.597175 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:23.597137    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:24.848975 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:24.848943    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw"]
Jul 17 15:15:24.851076 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:24.851058    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw"
Jul 17 15:15:24.853740 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:24.853714    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 15:15:24.853740 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:24.853714    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zsdjb\""
Jul 17 15:15:24.854914 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:24.854892    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 15:15:24.860709 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:24.860682    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw"]
Jul 17 15:15:24.946095 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:24.946070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54ec3df-8d14-4038-822e-b05e3c3b1dcb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpmzw\" (UID: \"d54ec3df-8d14-4038-822e-b05e3c3b1dcb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw"
Jul 17 15:15:24.946255 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:24.946111    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h6tj\" (UniqueName: \"kubernetes.io/projected/d54ec3df-8d14-4038-822e-b05e3c3b1dcb-kube-api-access-5h6tj\") pod \"openshift-lws-operator-fd8ccff4c-lpmzw\" (UID: \"d54ec3df-8d14-4038-822e-b05e3c3b1dcb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw"
Jul 17 15:15:25.047184 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:25.047157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54ec3df-8d14-4038-822e-b05e3c3b1dcb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpmzw\" (UID: \"d54ec3df-8d14-4038-822e-b05e3c3b1dcb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw"
Jul 17 15:15:25.047341 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:25.047201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h6tj\" (UniqueName: \"kubernetes.io/projected/d54ec3df-8d14-4038-822e-b05e3c3b1dcb-kube-api-access-5h6tj\") pod \"openshift-lws-operator-fd8ccff4c-lpmzw\" (UID: \"d54ec3df-8d14-4038-822e-b05e3c3b1dcb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw"
Jul 17 15:15:25.047621 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:25.047597    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54ec3df-8d14-4038-822e-b05e3c3b1dcb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpmzw\" (UID: \"d54ec3df-8d14-4038-822e-b05e3c3b1dcb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw"
Jul 17 15:15:25.056545 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:25.056525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h6tj\" (UniqueName: \"kubernetes.io/projected/d54ec3df-8d14-4038-822e-b05e3c3b1dcb-kube-api-access-5h6tj\") pod \"openshift-lws-operator-fd8ccff4c-lpmzw\" (UID: \"d54ec3df-8d14-4038-822e-b05e3c3b1dcb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw"
Jul 17 15:15:25.161755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:25.161727    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw"
Jul 17 15:15:25.286718 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:25.286691    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw"]
Jul 17 15:15:25.289001 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:15:25.288972    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd54ec3df_8d14_4038_822e_b05e3c3b1dcb.slice/crio-56704c810c654c7f84c71a770b10e2a9a0cd306628a7fbe1e06ac4761f22b9db WatchSource:0}: Error finding container 56704c810c654c7f84c71a770b10e2a9a0cd306628a7fbe1e06ac4761f22b9db: Status 404 returned error can't find the container with id 56704c810c654c7f84c71a770b10e2a9a0cd306628a7fbe1e06ac4761f22b9db
Jul 17 15:15:26.151906 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:26.151868    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nxm2r" event={"ID":"327c9de7-a3f6-4d93-8d52-788df1642ce0","Type":"ContainerStarted","Data":"ea53727752f1c322ff9c9e58ea67754c4635b1c4fec03661b385048dc6e90cdf"}
Jul 17 15:15:26.153110 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:26.153087    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw" event={"ID":"d54ec3df-8d14-4038-822e-b05e3c3b1dcb","Type":"ContainerStarted","Data":"56704c810c654c7f84c71a770b10e2a9a0cd306628a7fbe1e06ac4761f22b9db"}
Jul 17 15:15:26.170076 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:26.170033    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nxm2r" podStartSLOduration=1.914325579 podStartE2EDuration="5.170019867s" totalImagesPullingTime="3.255694288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:15:26.169334848 +0000 UTC m=+377.833784964" watchObservedRunningTime="2026-07-17 15:15:26.170019867 +0000 UTC m=+377.834469970"
Jul 17 15:15:29.165197 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:29.165156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw" event={"ID":"d54ec3df-8d14-4038-822e-b05e3c3b1dcb","Type":"ContainerStarted","Data":"15824e4f635765fef305cddc78c0ba9d84a4c7ff7a071af217ad33787f582ff3"}
Jul 17 15:15:29.186708 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:29.186656    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpmzw" podStartSLOduration=2.329579639 podStartE2EDuration="5.186643096s" totalImagesPullingTime="2.857063457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:15:29.185603199 +0000 UTC m=+380.850053305" watchObservedRunningTime="2026-07-17 15:15:29.186643096 +0000 UTC m=+380.851093200"
Jul 17 15:15:29.906712 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:29.906678    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:30.007407 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:30.007379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:32.074244 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:32.074213    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:35.468820 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:35.468786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:35.722255 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:35.722171    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:43.616662 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:43.616623    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:43.721776 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:43.721743    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:44.247233 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.247201    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:44.448222 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.448195    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:44.544146 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.544084    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:44.606863 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.606827    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"]
Jul 17 15:15:44.609942 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.609920    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.612533 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.612513    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 15:15:44.612874 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.612856    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 15:15:44.612960 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.612943    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 15:15:44.613164 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.613147    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 15:15:44.613241 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.613207    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qzq56\""
Jul 17 15:15:44.627128 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.627109    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"]
Jul 17 15:15:44.682763 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.682737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.682871 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.682779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-tmp\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.682871 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.682795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.682950 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.682894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-manifests\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.682950 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.682917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jbnh\" (UniqueName: \"kubernetes.io/projected/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-kube-api-access-5jbnh\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.723989 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.723965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:44.783996 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.783972    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.784092 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.784020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-tmp\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.784092 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.784046    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.784198 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.784090    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-manifests\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.784198 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.784114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jbnh\" (UniqueName: \"kubernetes.io/projected/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-kube-api-access-5jbnh\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.784424 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.784399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-manifests\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.786177 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.786161    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-tmp\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.786398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.786377    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.786517 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.786501    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.794252 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.794202    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jbnh\" (UniqueName: \"kubernetes.io/projected/a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a-kube-api-access-5jbnh\") pod \"opendatahub-operator-controller-manager-6fb95c7566-hjjvf\" (UID: \"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.826298 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.826273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:44.920249 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.920220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:44.929238 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:44.929216    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:45.024290 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:45.024263    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:45.042891 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:45.042872    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"]
Jul 17 15:15:45.045394 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:15:45.045342    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53b60f2_cc62_4d81_8ce0_4a8a1e3caf1a.slice/crio-2b7afe3cd1ddae5ad78f55091abd8183b962b3852f2cf88c9a3ea6f04a4fe7c4 WatchSource:0}: Error finding container 2b7afe3cd1ddae5ad78f55091abd8183b962b3852f2cf88c9a3ea6f04a4fe7c4: Status 404 returned error can't find the container with id 2b7afe3cd1ddae5ad78f55091abd8183b962b3852f2cf88c9a3ea6f04a4fe7c4
Jul 17 15:15:45.095736 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:45.095710    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:45.216979 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:45.216948    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf" event={"ID":"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a","Type":"ContainerStarted","Data":"2b7afe3cd1ddae5ad78f55091abd8183b962b3852f2cf88c9a3ea6f04a4fe7c4"}
Jul 17 15:15:45.874280 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:45.874215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:45.979953 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:45.975757    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:15:48.229389 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:48.229315    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf" event={"ID":"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a","Type":"ContainerStarted","Data":"38b4599d52b3adc6fde936ee3050a4381824924a811a8e7073897e204bdb6370"}
Jul 17 15:15:49.233883 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:49.233784    2582 generic.go:356] "Generic (PLEG): container finished" podID="a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a" containerID="38b4599d52b3adc6fde936ee3050a4381824924a811a8e7073897e204bdb6370" exitCode=0
Jul 17 15:15:49.233883 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:49.233826    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf" event={"ID":"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a","Type":"ContainerDied","Data":"38b4599d52b3adc6fde936ee3050a4381824924a811a8e7073897e204bdb6370"}
Jul 17 15:15:50.239496 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:50.239459    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf" event={"ID":"a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a","Type":"ContainerStarted","Data":"10fa7be6bcfb73ad399ef1d40a9485255a4cc6dd6259e8e78d7909128f831ea8"}
Jul 17 15:15:50.239975 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:50.239573    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:15:50.264987 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:15:50.264925    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf" podStartSLOduration=2.0563919 podStartE2EDuration="6.26490454s" totalImagesPullingTime="3.225793281s" totalInitContainerRuntime="982.719359ms" isStatefulPod=false podCreationTimestamp="2026-07-17 15:15:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:15:50.262810431 +0000 UTC m=+401.927260536" watchObservedRunningTime="2026-07-17 15:15:50.26490454 +0000 UTC m=+401.929354644"
Jul 17 15:16:00.472550 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:00.472514    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:00.570926 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:00.570897    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:01.244797 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:01.244768    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fb95c7566-hjjvf"
Jul 17 15:16:04.000212 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.000170    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:04.120971 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.120940    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:04.687908 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.687876    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9xfc5"]
Jul 17 15:16:04.690128 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.690113    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5"
Jul 17 15:16:04.692654 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.692610    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 17 15:16:04.692787 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.692732    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-w9kdr\""
Jul 17 15:16:04.702504 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.702478    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9xfc5"]
Jul 17 15:16:04.732826 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.732802    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:04.828021 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.827982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3-cert\") pod \"odh-model-controller-7998c67dc4-9xfc5\" (UID: \"95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5"
Jul 17 15:16:04.828021 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.828022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt998\" (UniqueName: \"kubernetes.io/projected/95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3-kube-api-access-tt998\") pod \"odh-model-controller-7998c67dc4-9xfc5\" (UID: \"95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5"
Jul 17 15:16:04.833840 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.833812    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:04.929323 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.929294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3-cert\") pod \"odh-model-controller-7998c67dc4-9xfc5\" (UID: \"95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5"
Jul 17 15:16:04.929479 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.929332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt998\" (UniqueName: \"kubernetes.io/projected/95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3-kube-api-access-tt998\") pod \"odh-model-controller-7998c67dc4-9xfc5\" (UID: \"95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5"
Jul 17 15:16:04.931773 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.931750    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:04.931888 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.931775    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3-cert\") pod \"odh-model-controller-7998c67dc4-9xfc5\" (UID: \"95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5"
Jul 17 15:16:04.938481 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.938435    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt998\" (UniqueName: \"kubernetes.io/projected/95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3-kube-api-access-tt998\") pod \"odh-model-controller-7998c67dc4-9xfc5\" (UID: \"95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5"
Jul 17 15:16:04.999355 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:04.999313    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5"
Jul 17 15:16:05.115447 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.115416    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-68pzl"]
Jul 17 15:16:05.117886 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.117867    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-68pzl"
Jul 17 15:16:05.120543 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.120522    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 17 15:16:05.129108 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.129085    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-68pzl"]
Jul 17 15:16:05.137000 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.136978    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:05.141607 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.141559    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9xfc5"]
Jul 17 15:16:05.145050 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:16:05.145028    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bc5d2a_890a_4ebb_b55a_9a2fedbc4ac3.slice/crio-a0c9c3527308a931dfc026c62c565387615ef19233ed1087eb48a20d2458c9c6 WatchSource:0}: Error finding container a0c9c3527308a931dfc026c62c565387615ef19233ed1087eb48a20d2458c9c6: Status 404 returned error can't find the container with id a0c9c3527308a931dfc026c62c565387615ef19233ed1087eb48a20d2458c9c6
Jul 17 15:16:05.221777 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.221693    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:05.230850 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.230829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaaf47bd-cf34-4110-a478-918dd4d56231-tls-certs\") pod \"model-serving-api-54d89bd5fc-68pzl\" (UID: \"eaaf47bd-cf34-4110-a478-918dd4d56231\") " pod="opendatahub/model-serving-api-54d89bd5fc-68pzl"
Jul 17 15:16:05.230901 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.230892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srsd9\" (UniqueName: \"kubernetes.io/projected/eaaf47bd-cf34-4110-a478-918dd4d56231-kube-api-access-srsd9\") pod \"model-serving-api-54d89bd5fc-68pzl\" (UID: \"eaaf47bd-cf34-4110-a478-918dd4d56231\") " pod="opendatahub/model-serving-api-54d89bd5fc-68pzl"
Jul 17 15:16:05.293657 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.293620    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5" event={"ID":"95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3","Type":"ContainerStarted","Data":"a0c9c3527308a931dfc026c62c565387615ef19233ed1087eb48a20d2458c9c6"}
Jul 17 15:16:05.331919 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.331894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srsd9\" (UniqueName: \"kubernetes.io/projected/eaaf47bd-cf34-4110-a478-918dd4d56231-kube-api-access-srsd9\") pod \"model-serving-api-54d89bd5fc-68pzl\" (UID: \"eaaf47bd-cf34-4110-a478-918dd4d56231\") " pod="opendatahub/model-serving-api-54d89bd5fc-68pzl"
Jul 17 15:16:05.332041 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.331945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaaf47bd-cf34-4110-a478-918dd4d56231-tls-certs\") pod \"model-serving-api-54d89bd5fc-68pzl\" (UID: \"eaaf47bd-cf34-4110-a478-918dd4d56231\") " pod="opendatahub/model-serving-api-54d89bd5fc-68pzl"
Jul 17 15:16:05.334173 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.334156    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaaf47bd-cf34-4110-a478-918dd4d56231-tls-certs\") pod \"model-serving-api-54d89bd5fc-68pzl\" (UID: \"eaaf47bd-cf34-4110-a478-918dd4d56231\") " pod="opendatahub/model-serving-api-54d89bd5fc-68pzl"
Jul 17 15:16:05.340940 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.340923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srsd9\" (UniqueName: \"kubernetes.io/projected/eaaf47bd-cf34-4110-a478-918dd4d56231-kube-api-access-srsd9\") pod \"model-serving-api-54d89bd5fc-68pzl\" (UID: \"eaaf47bd-cf34-4110-a478-918dd4d56231\") " pod="opendatahub/model-serving-api-54d89bd5fc-68pzl"
Jul 17 15:16:05.430959 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.430924    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-68pzl"
Jul 17 15:16:05.554219 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:05.554194    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-68pzl"]
Jul 17 15:16:05.557117 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:16:05.557090    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaaf47bd_cf34_4110_a478_918dd4d56231.slice/crio-e10b360308a97fe63c25fe006966080b68b18db6ff43afce0a649025126286f2 WatchSource:0}: Error finding container e10b360308a97fe63c25fe006966080b68b18db6ff43afce0a649025126286f2: Status 404 returned error can't find the container with id e10b360308a97fe63c25fe006966080b68b18db6ff43afce0a649025126286f2
Jul 17 15:16:06.300912 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:06.300782    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-68pzl" event={"ID":"eaaf47bd-cf34-4110-a478-918dd4d56231","Type":"ContainerStarted","Data":"e10b360308a97fe63c25fe006966080b68b18db6ff43afce0a649025126286f2"}
Jul 17 15:16:09.314228 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:09.314190    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5" event={"ID":"95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3","Type":"ContainerStarted","Data":"ef2540ac509861ff3f1fefd1822bcc25074ee39afc63e71ff856688acad25a4d"}
Jul 17 15:16:09.314678 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:09.314314    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5"
Jul 17 15:16:09.315577 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:09.315555    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-68pzl" event={"ID":"eaaf47bd-cf34-4110-a478-918dd4d56231","Type":"ContainerStarted","Data":"5e255da518b81392e5bb5d7c4a04e29a84d6f6a461c4b15058c301dd86dabee7"}
Jul 17 15:16:09.315667 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:09.315619    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-68pzl"
Jul 17 15:16:09.333445 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:09.333400    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5" podStartSLOduration=2.144504467 podStartE2EDuration="5.333384141s" totalImagesPullingTime="3.188879674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:16:09.332881755 +0000 UTC m=+420.997331858" watchObservedRunningTime="2026-07-17 15:16:09.333384141 +0000 UTC m=+420.997834248"
Jul 17 15:16:09.350572 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:09.350532    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-68pzl" podStartSLOduration=1.5772261680000002 podStartE2EDuration="4.350519141s" totalImagesPullingTime="2.773292973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:16:09.350005818 +0000 UTC m=+421.014455932" watchObservedRunningTime="2026-07-17 15:16:09.350519141 +0000 UTC m=+421.014969247"
Jul 17 15:16:14.776299 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.776247    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:14.873523 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.873476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:14.875044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.875021    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"]
Jul 17 15:16:14.878583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.878555    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"
Jul 17 15:16:14.885616 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.885596    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 17 15:16:14.885710 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.885687    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tmqcx\""
Jul 17 15:16:14.899405 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.899381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpmsw\" (UniqueName: \"kubernetes.io/projected/be2edea6-69ac-4d1c-b91a-8e222d7cb7d5-kube-api-access-tpmsw\") pod \"kserve-controller-manager-d6f4b65b8-ftpfd\" (UID: \"be2edea6-69ac-4d1c-b91a-8e222d7cb7d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"
Jul 17 15:16:14.899529 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.899449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be2edea6-69ac-4d1c-b91a-8e222d7cb7d5-cert\") pod \"kserve-controller-manager-d6f4b65b8-ftpfd\" (UID: \"be2edea6-69ac-4d1c-b91a-8e222d7cb7d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"
Jul 17 15:16:14.903534 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.903518    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"]
Jul 17 15:16:14.903612 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.903558    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"]
Jul 17 15:16:14.905701 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.905688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"
Jul 17 15:16:14.915444 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.915428    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 17 15:16:14.915768 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.915756    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vw8dm\""
Jul 17 15:16:14.931365 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.931337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"]
Jul 17 15:16:14.981309 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:14.981272    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:15.000601 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.000573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpmsw\" (UniqueName: \"kubernetes.io/projected/be2edea6-69ac-4d1c-b91a-8e222d7cb7d5-kube-api-access-tpmsw\") pod \"kserve-controller-manager-d6f4b65b8-ftpfd\" (UID: \"be2edea6-69ac-4d1c-b91a-8e222d7cb7d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"
Jul 17 15:16:15.000742 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.000648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be2edea6-69ac-4d1c-b91a-8e222d7cb7d5-cert\") pod \"kserve-controller-manager-d6f4b65b8-ftpfd\" (UID: \"be2edea6-69ac-4d1c-b91a-8e222d7cb7d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"
Jul 17 15:16:15.000742 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.000680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvbx\" (UniqueName: \"kubernetes.io/projected/1a46bc35-85b8-4794-824b-7712a8b40fe7-kube-api-access-khvbx\") pod \"llmisvc-controller-manager-777c6bd7d5-2pn4s\" (UID: \"1a46bc35-85b8-4794-824b-7712a8b40fe7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"
Jul 17 15:16:15.000934 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.000741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a46bc35-85b8-4794-824b-7712a8b40fe7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2pn4s\" (UID: \"1a46bc35-85b8-4794-824b-7712a8b40fe7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"
Jul 17 15:16:15.003025 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.003006    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be2edea6-69ac-4d1c-b91a-8e222d7cb7d5-cert\") pod \"kserve-controller-manager-d6f4b65b8-ftpfd\" (UID: \"be2edea6-69ac-4d1c-b91a-8e222d7cb7d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"
Jul 17 15:16:15.013458 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.013434    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpmsw\" (UniqueName: \"kubernetes.io/projected/be2edea6-69ac-4d1c-b91a-8e222d7cb7d5-kube-api-access-tpmsw\") pod \"kserve-controller-manager-d6f4b65b8-ftpfd\" (UID: \"be2edea6-69ac-4d1c-b91a-8e222d7cb7d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"
Jul 17 15:16:15.049608 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.049516    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"]
Jul 17 15:16:15.052465 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.052444    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:15.055220 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.055201    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 15:16:15.055572 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.055553    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 15:16:15.055675 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.055640    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 15:16:15.055739 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.055644    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m87gx\""
Jul 17 15:16:15.056012 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.055995    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 15:16:15.057728 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.057687    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:15.068883 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.068863    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"]
Jul 17 15:16:15.101475 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.101440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3581556-2089-4836-a5a5-12032ba35eea-tls-certs\") pod \"kube-auth-proxy-77c457bb55-vszsf\" (UID: \"d3581556-2089-4836-a5a5-12032ba35eea\") " pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:15.101608 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.101490    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3581556-2089-4836-a5a5-12032ba35eea-tmp\") pod \"kube-auth-proxy-77c457bb55-vszsf\" (UID: \"d3581556-2089-4836-a5a5-12032ba35eea\") " pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:15.101608 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.101520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khvbx\" (UniqueName: \"kubernetes.io/projected/1a46bc35-85b8-4794-824b-7712a8b40fe7-kube-api-access-khvbx\") pod \"llmisvc-controller-manager-777c6bd7d5-2pn4s\" (UID: \"1a46bc35-85b8-4794-824b-7712a8b40fe7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"
Jul 17 15:16:15.101608 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.101560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n56pk\" (UniqueName: \"kubernetes.io/projected/d3581556-2089-4836-a5a5-12032ba35eea-kube-api-access-n56pk\") pod \"kube-auth-proxy-77c457bb55-vszsf\" (UID: \"d3581556-2089-4836-a5a5-12032ba35eea\") " pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:15.101608 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.101583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a46bc35-85b8-4794-824b-7712a8b40fe7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2pn4s\" (UID: \"1a46bc35-85b8-4794-824b-7712a8b40fe7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"
Jul 17 15:16:15.104019 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.103998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a46bc35-85b8-4794-824b-7712a8b40fe7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2pn4s\" (UID: \"1a46bc35-85b8-4794-824b-7712a8b40fe7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"
Jul 17 15:16:15.113670 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.113647    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvbx\" (UniqueName: \"kubernetes.io/projected/1a46bc35-85b8-4794-824b-7712a8b40fe7-kube-api-access-khvbx\") pod \"llmisvc-controller-manager-777c6bd7d5-2pn4s\" (UID: \"1a46bc35-85b8-4794-824b-7712a8b40fe7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"
Jul 17 15:16:15.146563 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.146542    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:15.188652 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.188614    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"
Jul 17 15:16:15.202933 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.202902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3581556-2089-4836-a5a5-12032ba35eea-tmp\") pod \"kube-auth-proxy-77c457bb55-vszsf\" (UID: \"d3581556-2089-4836-a5a5-12032ba35eea\") " pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:15.203044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.202959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n56pk\" (UniqueName: \"kubernetes.io/projected/d3581556-2089-4836-a5a5-12032ba35eea-kube-api-access-n56pk\") pod \"kube-auth-proxy-77c457bb55-vszsf\" (UID: \"d3581556-2089-4836-a5a5-12032ba35eea\") " pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:15.203044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.203014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3581556-2089-4836-a5a5-12032ba35eea-tls-certs\") pod \"kube-auth-proxy-77c457bb55-vszsf\" (UID: \"d3581556-2089-4836-a5a5-12032ba35eea\") " pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:15.203159 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:16:15.203145    2582 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 17 15:16:15.203233 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:16:15.203222    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3581556-2089-4836-a5a5-12032ba35eea-tls-certs podName:d3581556-2089-4836-a5a5-12032ba35eea nodeName:}" failed. No retries permitted until 2026-07-17 15:16:15.703201473 +0000 UTC m=+427.367651572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d3581556-2089-4836-a5a5-12032ba35eea-tls-certs") pod "kube-auth-proxy-77c457bb55-vszsf" (UID: "d3581556-2089-4836-a5a5-12032ba35eea") : secret "kube-auth-proxy-tls" not found
Jul 17 15:16:15.204983 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.204965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3581556-2089-4836-a5a5-12032ba35eea-tmp\") pod \"kube-auth-proxy-77c457bb55-vszsf\" (UID: \"d3581556-2089-4836-a5a5-12032ba35eea\") " pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:15.214121 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.214100    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"
Jul 17 15:16:15.214951 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.214927    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n56pk\" (UniqueName: \"kubernetes.io/projected/d3581556-2089-4836-a5a5-12032ba35eea-kube-api-access-n56pk\") pod \"kube-auth-proxy-77c457bb55-vszsf\" (UID: \"d3581556-2089-4836-a5a5-12032ba35eea\") " pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:15.248021 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.247954    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:15.359224 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.359193    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"]
Jul 17 15:16:15.360614 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:16:15.360587    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2edea6_69ac_4d1c_b91a_8e222d7cb7d5.slice/crio-2f33c42ae2075704c918664cfca93e5fd08dfbeb9792fb34452a3100f69f0404 WatchSource:0}: Error finding container 2f33c42ae2075704c918664cfca93e5fd08dfbeb9792fb34452a3100f69f0404: Status 404 returned error can't find the container with id 2f33c42ae2075704c918664cfca93e5fd08dfbeb9792fb34452a3100f69f0404
Jul 17 15:16:15.361668 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.361640    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:15.399993 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.399971    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"]
Jul 17 15:16:15.401476 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:16:15.401450    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1a46bc35_85b8_4794_824b_7712a8b40fe7.slice/crio-0d3b4ed3af27b4f8166a3070b94c0e2b201a2f29aed0b386ba67d0e491f268bc WatchSource:0}: Error finding container 0d3b4ed3af27b4f8166a3070b94c0e2b201a2f29aed0b386ba67d0e491f268bc: Status 404 returned error can't find the container with id 0d3b4ed3af27b4f8166a3070b94c0e2b201a2f29aed0b386ba67d0e491f268bc
Jul 17 15:16:15.706432 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.706337    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3581556-2089-4836-a5a5-12032ba35eea-tls-certs\") pod \"kube-auth-proxy-77c457bb55-vszsf\" (UID: \"d3581556-2089-4836-a5a5-12032ba35eea\") " pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:15.706588 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:16:15.706501    2582 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 17 15:16:15.706588 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:16:15.706571    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3581556-2089-4836-a5a5-12032ba35eea-tls-certs podName:d3581556-2089-4836-a5a5-12032ba35eea nodeName:}" failed. No retries permitted until 2026-07-17 15:16:16.706553136 +0000 UTC m=+428.371003223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d3581556-2089-4836-a5a5-12032ba35eea-tls-certs") pod "kube-auth-proxy-77c457bb55-vszsf" (UID: "d3581556-2089-4836-a5a5-12032ba35eea") : secret "kube-auth-proxy-tls" not found
Jul 17 15:16:15.989178 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:15.989075    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:16.351703 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.351669    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd" event={"ID":"be2edea6-69ac-4d1c-b91a-8e222d7cb7d5","Type":"ContainerStarted","Data":"2f33c42ae2075704c918664cfca93e5fd08dfbeb9792fb34452a3100f69f0404"}
Jul 17 15:16:16.353268 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.353239    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s" event={"ID":"1a46bc35-85b8-4794-824b-7712a8b40fe7","Type":"ContainerStarted","Data":"0d3b4ed3af27b4f8166a3070b94c0e2b201a2f29aed0b386ba67d0e491f268bc"}
Jul 17 15:16:16.717133 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.717042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3581556-2089-4836-a5a5-12032ba35eea-tls-certs\") pod \"kube-auth-proxy-77c457bb55-vszsf\" (UID: \"d3581556-2089-4836-a5a5-12032ba35eea\") " pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:16.719480 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.719444    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3581556-2089-4836-a5a5-12032ba35eea-tls-certs\") pod \"kube-auth-proxy-77c457bb55-vszsf\" (UID: \"d3581556-2089-4836-a5a5-12032ba35eea\") " pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:16.832071 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.832022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:16.855517 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.855488    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"]
Jul 17 15:16:16.857589 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.857566    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:16.863439 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.863407    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"
Jul 17 15:16:16.864062 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.864044    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 15:16:16.864149 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.864115    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 15:16:16.864149 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.864046    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 15:16:16.864301 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.864286    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ppgbw\""
Jul 17 15:16:16.867631 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.867614    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 15:16:16.907735 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.907705    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"]
Jul 17 15:16:16.913548 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.913513    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:16.919199 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.919171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca775dad-164f-4530-9c7b-f95adf410803-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:16.919332 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.919225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65fnt\" (UniqueName: \"kubernetes.io/projected/ca775dad-164f-4530-9c7b-f95adf410803-kube-api-access-65fnt\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:16.919332 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.919266    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca775dad-164f-4530-9c7b-f95adf410803-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:16.919332 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.919289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca775dad-164f-4530-9c7b-f95adf410803-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:16.919332 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.919320    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca775dad-164f-4530-9c7b-f95adf410803-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:16.919536 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.919381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca775dad-164f-4530-9c7b-f95adf410803-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:16.919536 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:16.919407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca775dad-164f-4530-9c7b-f95adf410803-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.020010 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.019976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65fnt\" (UniqueName: \"kubernetes.io/projected/ca775dad-164f-4530-9c7b-f95adf410803-kube-api-access-65fnt\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.020423 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.020037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca775dad-164f-4530-9c7b-f95adf410803-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.020423 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.020065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca775dad-164f-4530-9c7b-f95adf410803-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.020423 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.020098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca775dad-164f-4530-9c7b-f95adf410803-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.020423 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.020150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca775dad-164f-4530-9c7b-f95adf410803-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.020423 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.020179    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca775dad-164f-4530-9c7b-f95adf410803-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.020423 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.020237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca775dad-164f-4530-9c7b-f95adf410803-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.022524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.022479    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ca775dad-164f-4530-9c7b-f95adf410803-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.023253 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.023182    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ca775dad-164f-4530-9c7b-f95adf410803-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.024702 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.024675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca775dad-164f-4530-9c7b-f95adf410803-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.026956 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.026918    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca775dad-164f-4530-9c7b-f95adf410803-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.027425 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.027373    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ca775dad-164f-4530-9c7b-f95adf410803-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.037704 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.037662    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65fnt\" (UniqueName: \"kubernetes.io/projected/ca775dad-164f-4530-9c7b-f95adf410803-kube-api-access-65fnt\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.038563 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.038542    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca775dad-164f-4530-9c7b-f95adf410803-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s6f84\" (UID: \"ca775dad-164f-4530-9c7b-f95adf410803\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.059555 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.059527    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77c457bb55-vszsf"]
Jul 17 15:16:17.062644 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:16:17.062616    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3581556_2089_4836_a5a5_12032ba35eea.slice/crio-08cd513c1942277ffc15e97ab6bc83f392fc1f926ae6904a7f13f362cbd8f095 WatchSource:0}: Error finding container 08cd513c1942277ffc15e97ab6bc83f392fc1f926ae6904a7f13f362cbd8f095: Status 404 returned error can't find the container with id 08cd513c1942277ffc15e97ab6bc83f392fc1f926ae6904a7f13f362cbd8f095
Jul 17 15:16:17.176032 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.176005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:17.347783 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.347746    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"]
Jul 17 15:16:17.350205 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:16:17.350173    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca775dad_164f_4530_9c7b_f95adf410803.slice/crio-0b108e97e7b95b9ba714ab742806ff0c6259ec44338c5e47419c9e967287d71d WatchSource:0}: Error finding container 0b108e97e7b95b9ba714ab742806ff0c6259ec44338c5e47419c9e967287d71d: Status 404 returned error can't find the container with id 0b108e97e7b95b9ba714ab742806ff0c6259ec44338c5e47419c9e967287d71d
Jul 17 15:16:17.359490 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.359447    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf" event={"ID":"d3581556-2089-4836-a5a5-12032ba35eea","Type":"ContainerStarted","Data":"08cd513c1942277ffc15e97ab6bc83f392fc1f926ae6904a7f13f362cbd8f095"}
Jul 17 15:16:17.361260 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:17.361232    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84" event={"ID":"ca775dad-164f-4530-9c7b-f95adf410803","Type":"ContainerStarted","Data":"0b108e97e7b95b9ba714ab742806ff0c6259ec44338c5e47419c9e967287d71d"}
Jul 17 15:16:18.300977 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:18.300898    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:18.367946 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:18.367899    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd" event={"ID":"be2edea6-69ac-4d1c-b91a-8e222d7cb7d5","Type":"ContainerStarted","Data":"104848f34300b66d6d111f6870512ce2d4015acbd51313fcae7612355b5afc65"}
Jul 17 15:16:18.368103 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:18.368024    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"
Jul 17 15:16:18.388107 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:18.388016    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd" podStartSLOduration=1.7393953089999998 podStartE2EDuration="4.387997029s" totalImagesPullingTime="2.64860172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:16:18.387706109 +0000 UTC m=+430.052156216" watchObservedRunningTime="2026-07-17 15:16:18.387997029 +0000 UTC m=+430.052447134"
Jul 17 15:16:19.375397 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:19.375050    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s" event={"ID":"1a46bc35-85b8-4794-824b-7712a8b40fe7","Type":"ContainerStarted","Data":"2b5ff72af246cfa96b9f33b44fab13d7ca4335292aac1e1483decbaf87e506dd"}
Jul 17 15:16:19.375397 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:19.375138    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"
Jul 17 15:16:19.406829 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:19.406758    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s" podStartSLOduration=1.8741343449999999 podStartE2EDuration="5.406738809s" totalImagesPullingTime="3.532604464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:16:19.406141551 +0000 UTC m=+431.070591657" watchObservedRunningTime="2026-07-17 15:16:19.406738809 +0000 UTC m=+431.071188914"
Jul 17 15:16:20.328047 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:20.328018    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9xfc5"
Jul 17 15:16:20.330398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:20.330377    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-68pzl"
Jul 17 15:16:21.344905 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:21.344873    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 15:16:21.345164 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:21.344938    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 15:16:22.389014 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:22.388975    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf" event={"ID":"d3581556-2089-4836-a5a5-12032ba35eea","Type":"ContainerStarted","Data":"2d9b3b2c8959dc006647f85e7a5c10669781f086315dcf2329ca29fa9020e516"}
Jul 17 15:16:22.391622 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:22.391587    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84" event={"ID":"ca775dad-164f-4530-9c7b-f95adf410803","Type":"ContainerStarted","Data":"585fc23d7ea3f705a286c2b03af2f006296e638e27e6c345d06085a00c73fef1"}
Jul 17 15:16:22.391791 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:22.391777    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:22.393405 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:22.393374    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-s6f84 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 15:16:22.393530 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:22.393440    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84" podUID="ca775dad-164f-4530-9c7b-f95adf410803" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 15:16:22.403329 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:22.403298    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:22.409859 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:22.409803    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77c457bb55-vszsf" podStartSLOduration=3.131999797 podStartE2EDuration="7.409784594s" totalImagesPullingTime="4.277784797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:16:22.407808325 +0000 UTC m=+434.072258429" watchObservedRunningTime="2026-07-17 15:16:22.409784594 +0000 UTC m=+434.074234767"
Jul 17 15:16:22.434884 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:22.434821    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84" podStartSLOduration=2.44319709 podStartE2EDuration="6.43480469s" totalImagesPullingTime="3.9916076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:16:22.433558563 +0000 UTC m=+434.098008667" watchObservedRunningTime="2026-07-17 15:16:22.43480469 +0000 UTC m=+434.099254793"
Jul 17 15:16:22.501276 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:22.501248    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:22.773665 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:22.773633    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:22.997491 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:22.997458    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:23.093154 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:23.093080    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:16:23.396621 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:23.396556    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6f84"
Jul 17 15:16:49.380107 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:49.380080    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ftpfd"
Jul 17 15:16:50.382129 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:16:50.382100    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2pn4s"
Jul 17 15:17:05.478180 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:05.478148    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:05.550163 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:05.550132    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:05.651548 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:05.651513    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:06.397196 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:06.397159    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:06.607409 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:06.607375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:16.933915 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:16.933880    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:33.935237 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:33.935203    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:40.137249 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:40.137207    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:42.536371 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:42.536336    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:42.896432 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:42.896351    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:43.130569 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:43.130535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:44.575017 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:44.574979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:45.800533 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:45.800502    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:46.963824 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:46.963788    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:47.213402 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:47.213370    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:47.321692 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:47.321660    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:48.453401 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:48.453359    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:48.735996 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:48.735898    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:49.178078 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.178047    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:49.258321 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.258288    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb"]
Jul 17 15:17:49.260393 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.260378    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb"
Jul 17 15:17:49.263259 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.263230    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 17 15:17:49.263259 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.263243    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 15:17:49.263441 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.263294    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2bxs6\""
Jul 17 15:17:49.264274 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.264260    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 15:17:49.272832 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.272805    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb"]
Jul 17 15:17:49.314271 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.314241    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44cgx\" (UniqueName: \"kubernetes.io/projected/aab4c7e8-41e6-4e6e-b8aa-0d1c1467bc90-kube-api-access-44cgx\") pod \"dns-operator-controller-manager-864dd78c4c-fflnb\" (UID: \"aab4c7e8-41e6-4e6e-b8aa-0d1c1467bc90\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb"
Jul 17 15:17:49.415025 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.414994    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44cgx\" (UniqueName: \"kubernetes.io/projected/aab4c7e8-41e6-4e6e-b8aa-0d1c1467bc90-kube-api-access-44cgx\") pod \"dns-operator-controller-manager-864dd78c4c-fflnb\" (UID: \"aab4c7e8-41e6-4e6e-b8aa-0d1c1467bc90\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb"
Jul 17 15:17:49.424706 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.424674    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44cgx\" (UniqueName: \"kubernetes.io/projected/aab4c7e8-41e6-4e6e-b8aa-0d1c1467bc90-kube-api-access-44cgx\") pod \"dns-operator-controller-manager-864dd78c4c-fflnb\" (UID: \"aab4c7e8-41e6-4e6e-b8aa-0d1c1467bc90\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb"
Jul 17 15:17:49.570428 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.570399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb"
Jul 17 15:17:49.702409 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.702365    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb"]
Jul 17 15:17:49.704687 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:17:49.704664    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab4c7e8_41e6_4e6e_b8aa_0d1c1467bc90.slice/crio-f30aad8b76420e2adf39f17dded0548938af93f26438eb628fd657dbba25264a WatchSource:0}: Error finding container f30aad8b76420e2adf39f17dded0548938af93f26438eb628fd657dbba25264a: Status 404 returned error can't find the container with id f30aad8b76420e2adf39f17dded0548938af93f26438eb628fd657dbba25264a
Jul 17 15:17:49.743951 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:49.743924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb" event={"ID":"aab4c7e8-41e6-4e6e-b8aa-0d1c1467bc90","Type":"ContainerStarted","Data":"f30aad8b76420e2adf39f17dded0548938af93f26438eb628fd657dbba25264a"}
Jul 17 15:17:51.536646 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:51.536616    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:51.605485 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:51.605452    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:17:51.754020 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:51.753992    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb" event={"ID":"aab4c7e8-41e6-4e6e-b8aa-0d1c1467bc90","Type":"ContainerStarted","Data":"508cc5bc7a795b329795e150e557c30088b357c163eee62a71a496ab773115fb"}
Jul 17 15:17:51.754192 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:51.754122    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb"
Jul 17 15:17:51.774500 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:51.774455    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb" podStartSLOduration=1.09695874 podStartE2EDuration="2.774436694s" totalImagesPullingTime="1.677477954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:17:51.773206984 +0000 UTC m=+523.437657089" watchObservedRunningTime="2026-07-17 15:17:51.774436694 +0000 UTC m=+523.438886799"
Jul 17 15:17:59.035204 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.035170    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"]
Jul 17 15:17:59.038288 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.038268    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:17:59.041070 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.041051    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z6xtm\""
Jul 17 15:17:59.051216 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.051194    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"]
Jul 17 15:17:59.079708 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.079675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzrjc\" (UniqueName: \"kubernetes.io/projected/3ffe4f93-765f-4a29-b8f4-b3249c788945-kube-api-access-nzrjc\") pod \"kuadrant-operator-controller-manager-86878c769f-bjz2c\" (UID: \"3ffe4f93-765f-4a29-b8f4-b3249c788945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:17:59.079884 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.079760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ffe4f93-765f-4a29-b8f4-b3249c788945-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bjz2c\" (UID: \"3ffe4f93-765f-4a29-b8f4-b3249c788945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:17:59.180771 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.180737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzrjc\" (UniqueName: \"kubernetes.io/projected/3ffe4f93-765f-4a29-b8f4-b3249c788945-kube-api-access-nzrjc\") pod \"kuadrant-operator-controller-manager-86878c769f-bjz2c\" (UID: \"3ffe4f93-765f-4a29-b8f4-b3249c788945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:17:59.180936 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.180800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ffe4f93-765f-4a29-b8f4-b3249c788945-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bjz2c\" (UID: \"3ffe4f93-765f-4a29-b8f4-b3249c788945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:17:59.181125 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.181111    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ffe4f93-765f-4a29-b8f4-b3249c788945-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bjz2c\" (UID: \"3ffe4f93-765f-4a29-b8f4-b3249c788945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:17:59.192990 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.192967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzrjc\" (UniqueName: \"kubernetes.io/projected/3ffe4f93-765f-4a29-b8f4-b3249c788945-kube-api-access-nzrjc\") pod \"kuadrant-operator-controller-manager-86878c769f-bjz2c\" (UID: \"3ffe4f93-765f-4a29-b8f4-b3249c788945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:17:59.347687 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.347607    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:17:59.474700 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.474675    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"]
Jul 17 15:17:59.477490 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:17:59.477455    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ffe4f93_765f_4a29_b8f4_b3249c788945.slice/crio-5a79c6c7af720522f2feea22edfe5697197d4d3e65612b6cadff3e052707c321 WatchSource:0}: Error finding container 5a79c6c7af720522f2feea22edfe5697197d4d3e65612b6cadff3e052707c321: Status 404 returned error can't find the container with id 5a79c6c7af720522f2feea22edfe5697197d4d3e65612b6cadff3e052707c321
Jul 17 15:17:59.788302 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.788264    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c" event={"ID":"3ffe4f93-765f-4a29-b8f4-b3249c788945","Type":"ContainerStarted","Data":"5a79c6c7af720522f2feea22edfe5697197d4d3e65612b6cadff3e052707c321"}
Jul 17 15:17:59.981504 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:17:59.981466    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:00.083998 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:00.083929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:00.638412 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:00.638380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:02.761408 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:02.761342    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fflnb"
Jul 17 15:18:03.812857 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:03.812802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c" event={"ID":"3ffe4f93-765f-4a29-b8f4-b3249c788945","Type":"ContainerStarted","Data":"5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59"}
Jul 17 15:18:03.813208 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:03.812912    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:18:03.857390 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:03.857336    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c" podStartSLOduration=0.653688186 podStartE2EDuration="4.857320709s" totalImagesPullingTime="4.203632523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:18:03.855007184 +0000 UTC m=+535.519457286" watchObservedRunningTime="2026-07-17 15:18:03.857320709 +0000 UTC m=+535.521770806"
Jul 17 15:18:04.797208 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:04.797171    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:04.883005 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:04.882971    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:05.757604 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:05.757570    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:07.218059 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:07.218028    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:07.288816 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:07.288786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:12.956405 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:12.956357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:13.022767 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:13.022729    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:14.819450 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:14.819418    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:18:20.771592 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:20.771561    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:20.863051 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:20.863021    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:25.171406 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:25.171374    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:25.272293 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:25.272249    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:27.619038 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:27.619000    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:27.678611 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:27.678575    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:31.254949 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:31.254841    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:31.326429 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:31.326397    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:33.232330 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.232298    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:33.338580 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.338542    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:33.444640 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.444600    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:33.732868 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.732821    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:18:33.736035 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.736018    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"
Jul 17 15:18:33.738656 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.738631    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 15:18:33.738656 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.738631    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pg8td\""
Jul 17 15:18:33.747827 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.747805    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:18:33.782639 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.782615    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:18:33.841643 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.841612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f86885d-b856-42ff-b1de-85dccf857c37-config-file\") pod \"limitador-limitador-54d6d988d5-7tbx7\" (UID: \"5f86885d-b856-42ff-b1de-85dccf857c37\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"
Jul 17 15:18:33.841643 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.841642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p57mk\" (UniqueName: \"kubernetes.io/projected/5f86885d-b856-42ff-b1de-85dccf857c37-kube-api-access-p57mk\") pod \"limitador-limitador-54d6d988d5-7tbx7\" (UID: \"5f86885d-b856-42ff-b1de-85dccf857c37\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"
Jul 17 15:18:33.942976 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.942936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f86885d-b856-42ff-b1de-85dccf857c37-config-file\") pod \"limitador-limitador-54d6d988d5-7tbx7\" (UID: \"5f86885d-b856-42ff-b1de-85dccf857c37\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"
Jul 17 15:18:33.942976 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.942970    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p57mk\" (UniqueName: \"kubernetes.io/projected/5f86885d-b856-42ff-b1de-85dccf857c37-kube-api-access-p57mk\") pod \"limitador-limitador-54d6d988d5-7tbx7\" (UID: \"5f86885d-b856-42ff-b1de-85dccf857c37\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"
Jul 17 15:18:33.943560 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.943542    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f86885d-b856-42ff-b1de-85dccf857c37-config-file\") pod \"limitador-limitador-54d6d988d5-7tbx7\" (UID: \"5f86885d-b856-42ff-b1de-85dccf857c37\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"
Jul 17 15:18:33.952556 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:33.952533    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p57mk\" (UniqueName: \"kubernetes.io/projected/5f86885d-b856-42ff-b1de-85dccf857c37-kube-api-access-p57mk\") pod \"limitador-limitador-54d6d988d5-7tbx7\" (UID: \"5f86885d-b856-42ff-b1de-85dccf857c37\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"
Jul 17 15:18:34.045155 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:34.045127    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"
Jul 17 15:18:34.142543 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:34.142496    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:34.175805 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:34.175728    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:18:34.178144 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:18:34.178120    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f86885d_b856_42ff_b1de_85dccf857c37.slice/crio-54d5af6d11674138f7c0a912da21826f799d2f40a4ad385f8af509d5a2c76d0c WatchSource:0}: Error finding container 54d5af6d11674138f7c0a912da21826f799d2f40a4ad385f8af509d5a2c76d0c: Status 404 returned error can't find the container with id 54d5af6d11674138f7c0a912da21826f799d2f40a4ad385f8af509d5a2c76d0c
Jul 17 15:18:34.245467 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:34.245423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:34.937175 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:34.937138    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7" event={"ID":"5f86885d-b856-42ff-b1de-85dccf857c37","Type":"ContainerStarted","Data":"54d5af6d11674138f7c0a912da21826f799d2f40a4ad385f8af509d5a2c76d0c"}
Jul 17 15:18:37.951814 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:37.951782    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7" event={"ID":"5f86885d-b856-42ff-b1de-85dccf857c37","Type":"ContainerStarted","Data":"f0ad26f8a23476c5bb3b0aa863db93531027cc81472048a4f7bc090f8cc86148"}
Jul 17 15:18:37.952203 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:37.951868    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"
Jul 17 15:18:37.984755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:37.984700    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7" podStartSLOduration=1.937154871 podStartE2EDuration="4.984685266s" totalImagesPullingTime="3.047530395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:18:37.983102319 +0000 UTC m=+569.647552434" watchObservedRunningTime="2026-07-17 15:18:37.984685266 +0000 UTC m=+569.649135393"
Jul 17 15:18:48.957827 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:48.957798    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"
Jul 17 15:18:54.446446 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:54.446402    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:54.547235 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:54.547206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:18:54.901914 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:18:54.901883    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:01.787427 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:01.787391    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:07.216123 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:07.216086    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:07.749217 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:07.749184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:14.439554 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:14.439512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:15.632832 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:15.632801    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:18.464984 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:18.464925    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:18.548801 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:18.548775    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:49.057223 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:49.057181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:49.155922 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:49.155882    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:49.546720 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:49.546664    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:49.785258 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:49.785227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:50.075495 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:50.075450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:50.175827 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:50.175796    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:50.416345 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:50.416272    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:19:54.717804 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:54.717750    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:19:54.786814 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:19:54.786783    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:20:00.716201 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:00.716168    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:20:00.802039 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:00.802005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:20:08.748935 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:08.748903    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:20:09.232656 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:09.232573    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:20:16.504666 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:16.504607    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:20:17.257231 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:17.257194    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:20:40.232014 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:40.231982    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:20:41.504534 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:41.504502    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:20:47.394018 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.393974    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"]
Jul 17 15:20:47.397803 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.397784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.401897 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.401877    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 15:20:47.402002 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.401910    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 15:20:47.402002 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.401944    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 15:20:47.402116 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.401878    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fwpbb\""
Jul 17 15:20:47.408198 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.408177    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"]
Jul 17 15:20:47.439929 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.439897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh87h\" (UniqueName: \"kubernetes.io/projected/98ab0e06-0907-45a6-85cf-21bc2caa1424-kube-api-access-nh87h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.440079 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.439951    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.440079 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.440026    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.440079 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.440067    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.440214 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.440090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.440214 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.440121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ab0e06-0907-45a6-85cf-21bc2caa1424-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.440214 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.440133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:20:47.540734 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.540700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh87h\" (UniqueName: \"kubernetes.io/projected/98ab0e06-0907-45a6-85cf-21bc2caa1424-kube-api-access-nh87h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.540734 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.540737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.540990 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.540835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.540990 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.540875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.540990 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.540903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.540990 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.540935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ab0e06-0907-45a6-85cf-21bc2caa1424-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.541254 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.541230    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.541299 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.541279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.541345 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.541330    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.543204 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.543181    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ab0e06-0907-45a6-85cf-21bc2caa1424-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.543307 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.543289    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ab0e06-0907-45a6-85cf-21bc2caa1424-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.551284 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.551260    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh87h\" (UniqueName: \"kubernetes.io/projected/98ab0e06-0907-45a6-85cf-21bc2caa1424-kube-api-access-nh87h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78\" (UID: \"98ab0e06-0907-45a6-85cf-21bc2caa1424\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.709741 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.709666    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:47.840279 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.840253    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"]
Jul 17 15:20:47.842019 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:20:47.841995    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ab0e06_0907_45a6_85cf_21bc2caa1424.slice/crio-37f2f325c2d43fff0f4aab327e2c9668e3f4ebd8ef17e8a6cebaa0099c2bc064 WatchSource:0}: Error finding container 37f2f325c2d43fff0f4aab327e2c9668e3f4ebd8ef17e8a6cebaa0099c2bc064: Status 404 returned error can't find the container with id 37f2f325c2d43fff0f4aab327e2c9668e3f4ebd8ef17e8a6cebaa0099c2bc064
Jul 17 15:20:47.843266 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:47.843248    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 15:20:48.488864 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:48.488809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78" event={"ID":"98ab0e06-0907-45a6-85cf-21bc2caa1424","Type":"ContainerStarted","Data":"37f2f325c2d43fff0f4aab327e2c9668e3f4ebd8ef17e8a6cebaa0099c2bc064"}
Jul 17 15:20:49.020496 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:49.020458    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:20:49.494767 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:49.494725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78" event={"ID":"98ab0e06-0907-45a6-85cf-21bc2caa1424","Type":"ContainerStarted","Data":"db374e515d0bbf413dc322f6ed38665c40cf9635b8898fb44fd3b912d275bf91"}
Jul 17 15:20:49.513600 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:49.513552    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78" podStartSLOduration=1.5123998680000001 podStartE2EDuration="2.51353743s" totalImagesPullingTime="1.001137562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:20:49.512771408 +0000 UTC m=+701.177221512" watchObservedRunningTime="2026-07-17 15:20:49.51353743 +0000 UTC m=+701.177987533"
Jul 17 15:20:56.047538 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:56.047508    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:20:57.710201 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:57.710165    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:57.710575 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:57.710235    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:57.722492 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:57.722464    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:20:57.934110 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:57.934081    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:20:58.545089 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:20:58.545054    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78"
Jul 17 15:21:10.018539 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:21:10.018469    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:12.308560 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:21:12.308528    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:21:27.442142 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:21:27.442103    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:21:27.566603 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:21:27.566559    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:14.310363 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:14.310331    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:14.408628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:14.408579    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:15.445776 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:15.445746    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:15.542185 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:15.542128    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:43.140951 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:43.140872    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:22:46.025587 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:46.025555    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:48.247954 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:48.247916    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:48.314225 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:48.314179    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:52.507179 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:52.507147    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:22:53.496823 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:53.496787    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:53.566388 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:53.566348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:59.153419 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:59.153382    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:59.264223 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:59.264183    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:22:59.373027 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:22:59.372981    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:23:03.107259 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:23:03.107227    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:23:11.059363 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:23:11.059327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:24:18.733122 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:24:18.733084    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:24:20.066720 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:24:20.066671    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:24:22.797211 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:24:22.797178    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:24:22.880773 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:24:22.880738    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:24:42.314812 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:24:42.314775    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:24:53.326119 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:24:53.326083    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:24:58.444240 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:24:58.444198    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:24:58.544424 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:24:58.544391    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:24:58.663290 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:24:58.663253    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:05.103243 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:25:05.103201    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:05.207176 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:25:05.207115    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:05.305824 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:25:05.305796    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:05.456716 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:25:05.456592    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:12.148983 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:25:12.148936    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:12.220157 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:25:12.220124    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:25:29.112238 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:25:29.112197    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:25:38.615451 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:25:38.615374    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:25:48.521025 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:25:48.520982    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:25:55.517442 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:25:55.517406    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:26:05.212627 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:26:05.212594    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:26:14.631204 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:26:14.631167    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:26:26.226765 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:26:26.226734    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:26:36.001383 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:26:36.001349    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:26:42.465744 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:26:42.465712    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:27:01.047567 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:27:01.047486    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:27:10.631269 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:27:10.631236    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:27:40.336717 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:27:40.336680    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:27:50.741550 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:27:50.741515    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:28:06.242047 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:28:06.242005    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:28:15.817820 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:28:15.817783    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:28:25.111434 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:28:25.111403    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:28:34.013129 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:28:34.013049    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:28:44.382790 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:28:44.382751    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:29:11.281689 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:11.281649    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"]
Jul 17 15:29:11.282241 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:11.281903    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c" podUID="3ffe4f93-765f-4a29-b8f4-b3249c788945" containerName="manager" containerID="cri-o://5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59" gracePeriod=10
Jul 17 15:29:14.131612 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.131589    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:29:14.238472 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.238385    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ffe4f93-765f-4a29-b8f4-b3249c788945-extensions-socket-volume\") pod \"3ffe4f93-765f-4a29-b8f4-b3249c788945\" (UID: \"3ffe4f93-765f-4a29-b8f4-b3249c788945\") "
Jul 17 15:29:14.238472 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.238437    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzrjc\" (UniqueName: \"kubernetes.io/projected/3ffe4f93-765f-4a29-b8f4-b3249c788945-kube-api-access-nzrjc\") pod \"3ffe4f93-765f-4a29-b8f4-b3249c788945\" (UID: \"3ffe4f93-765f-4a29-b8f4-b3249c788945\") "
Jul 17 15:29:14.238782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.238748    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ffe4f93-765f-4a29-b8f4-b3249c788945-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3ffe4f93-765f-4a29-b8f4-b3249c788945" (UID: "3ffe4f93-765f-4a29-b8f4-b3249c788945"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:29:14.240454 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.240431    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ffe4f93-765f-4a29-b8f4-b3249c788945-kube-api-access-nzrjc" (OuterVolumeSpecName: "kube-api-access-nzrjc") pod "3ffe4f93-765f-4a29-b8f4-b3249c788945" (UID: "3ffe4f93-765f-4a29-b8f4-b3249c788945"). InnerVolumeSpecName "kube-api-access-nzrjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:29:14.339742 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.339706    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ffe4f93-765f-4a29-b8f4-b3249c788945-extensions-socket-volume\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:29:14.339742 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.339736    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzrjc\" (UniqueName: \"kubernetes.io/projected/3ffe4f93-765f-4a29-b8f4-b3249c788945-kube-api-access-nzrjc\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:29:14.651515 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.651476    2582 generic.go:356] "Generic (PLEG): container finished" podID="3ffe4f93-765f-4a29-b8f4-b3249c788945" containerID="5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59" exitCode=0
Jul 17 15:29:14.651710 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.651522    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"
Jul 17 15:29:14.651710 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.651531    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c" event={"ID":"3ffe4f93-765f-4a29-b8f4-b3249c788945","Type":"ContainerDied","Data":"5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59"}
Jul 17 15:29:14.651710 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.651595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c" event={"ID":"3ffe4f93-765f-4a29-b8f4-b3249c788945","Type":"ContainerDied","Data":"5a79c6c7af720522f2feea22edfe5697197d4d3e65612b6cadff3e052707c321"}
Jul 17 15:29:14.651710 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.651625    2582 scope.go:117] "RemoveContainer" containerID="5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59"
Jul 17 15:29:14.660490 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.660469    2582 scope.go:117] "RemoveContainer" containerID="5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59"
Jul 17 15:29:14.660756 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:29:14.660739    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59\": container with ID starting with 5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59 not found: ID does not exist" containerID="5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59"
Jul 17 15:29:14.660826 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.660767    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59"} err="failed to get container status \"5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59\": rpc error: code = NotFound desc = could not find container \"5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59\": container with ID starting with 5f7abb20d16dc42da310b0ca60b7695210c7a2ca688109faba73f2ed7da62b59 not found: ID does not exist"
Jul 17 15:29:14.678620 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.678590    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"]
Jul 17 15:29:14.682795 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.682775    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjz2c"]
Jul 17 15:29:14.905226 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:14.905138    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ffe4f93-765f-4a29-b8f4-b3249c788945" path="/var/lib/kubelet/pods/3ffe4f93-765f-4a29-b8f4-b3249c788945/volumes"
Jul 17 15:29:46.607723 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:46.607690    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:29:47.864974 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:29:47.864930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:00.176273 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:00.176234    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6"]
Jul 17 15:30:00.176821 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:00.176652    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ffe4f93-765f-4a29-b8f4-b3249c788945" containerName="manager"
Jul 17 15:30:00.176821 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:00.176671    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ffe4f93-765f-4a29-b8f4-b3249c788945" containerName="manager"
Jul 17 15:30:00.176821 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:00.176795    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ffe4f93-765f-4a29-b8f4-b3249c788945" containerName="manager"
Jul 17 15:30:00.179660 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:00.179640    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6"
Jul 17 15:30:00.183510 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:00.183493    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:30:00.188319 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:00.188301    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6"
Jul 17 15:30:00.190393 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:00.190371    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6"]
Jul 17 15:30:00.317659 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:00.317635    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6"]
Jul 17 15:30:00.319597 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:30:00.319572    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50364f71_6b78_4784_b06e_962c902d6cb3.slice/crio-f4eba71418ef9cf724c8a830e563531f1aeaf2be49e3f8c3cabd44af746e27ed WatchSource:0}: Error finding container f4eba71418ef9cf724c8a830e563531f1aeaf2be49e3f8c3cabd44af746e27ed: Status 404 returned error can't find the container with id f4eba71418ef9cf724c8a830e563531f1aeaf2be49e3f8c3cabd44af746e27ed
Jul 17 15:30:00.321474 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:00.321454    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 15:30:00.838327 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:00.838295    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6" event={"ID":"50364f71-6b78-4784-b06e-962c902d6cb3","Type":"ContainerStarted","Data":"f4eba71418ef9cf724c8a830e563531f1aeaf2be49e3f8c3cabd44af746e27ed"}
Jul 17 15:30:02.848334 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:02.848297    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6" event={"ID":"50364f71-6b78-4784-b06e-962c902d6cb3","Type":"ContainerStarted","Data":"5a7a71f90b8f98b44a89d7d94bd74e0520d100ebc090db9b933e959ba0e5e448"}
Jul 17 15:30:02.872512 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:02.872465    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6" podStartSLOduration=0.847759422 podStartE2EDuration="2.872451688s" totalImagesPullingTime="2.024692266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:30:02.871449267 +0000 UTC m=+1254.535899368" watchObservedRunningTime="2026-07-17 15:30:02.872451688 +0000 UTC m=+1254.536901770"
Jul 17 15:30:03.854456 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:03.854423    2582 generic.go:356] "Generic (PLEG): container finished" podID="50364f71-6b78-4784-b06e-962c902d6cb3" containerID="5a7a71f90b8f98b44a89d7d94bd74e0520d100ebc090db9b933e959ba0e5e448" exitCode=0
Jul 17 15:30:03.854860 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:03.854506    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6" event={"ID":"50364f71-6b78-4784-b06e-962c902d6cb3","Type":"ContainerDied","Data":"5a7a71f90b8f98b44a89d7d94bd74e0520d100ebc090db9b933e959ba0e5e448"}
Jul 17 15:30:04.983011 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:04.982983    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6"
Jul 17 15:30:05.863352 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:05.863321    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6" event={"ID":"50364f71-6b78-4784-b06e-962c902d6cb3","Type":"ContainerDied","Data":"f4eba71418ef9cf724c8a830e563531f1aeaf2be49e3f8c3cabd44af746e27ed"}
Jul 17 15:30:05.863594 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:05.863359    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738370-g48d6"
Jul 17 15:30:05.863594 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:05.863367    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4eba71418ef9cf724c8a830e563531f1aeaf2be49e3f8c3cabd44af746e27ed"
Jul 17 15:30:12.590547 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.590509    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"]
Jul 17 15:30:12.591014 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.590993    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50364f71-6b78-4784-b06e-962c902d6cb3" containerName="cleanup"
Jul 17 15:30:12.591014 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.591014    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="50364f71-6b78-4784-b06e-962c902d6cb3" containerName="cleanup"
Jul 17 15:30:12.591122 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.591112    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="50364f71-6b78-4784-b06e-962c902d6cb3" containerName="cleanup"
Jul 17 15:30:12.594348 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.594329    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"
Jul 17 15:30:12.598476 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.598458    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z6xtm\""
Jul 17 15:30:12.615664 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.615637    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"]
Jul 17 15:30:12.700058 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.700017    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhz42\" (UniqueName: \"kubernetes.io/projected/d8da98df-0056-4040-a186-79938f996c2b-kube-api-access-qhz42\") pod \"kuadrant-operator-controller-manager-86878c769f-p4tmk\" (UID: \"d8da98df-0056-4040-a186-79938f996c2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"
Jul 17 15:30:12.700241 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.700076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8da98df-0056-4040-a186-79938f996c2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p4tmk\" (UID: \"d8da98df-0056-4040-a186-79938f996c2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"
Jul 17 15:30:12.801041 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.800999    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhz42\" (UniqueName: \"kubernetes.io/projected/d8da98df-0056-4040-a186-79938f996c2b-kube-api-access-qhz42\") pod \"kuadrant-operator-controller-manager-86878c769f-p4tmk\" (UID: \"d8da98df-0056-4040-a186-79938f996c2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"
Jul 17 15:30:12.801185 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.801059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8da98df-0056-4040-a186-79938f996c2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p4tmk\" (UID: \"d8da98df-0056-4040-a186-79938f996c2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"
Jul 17 15:30:12.801475 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.801457    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8da98df-0056-4040-a186-79938f996c2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p4tmk\" (UID: \"d8da98df-0056-4040-a186-79938f996c2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"
Jul 17 15:30:12.817547 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.817517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhz42\" (UniqueName: \"kubernetes.io/projected/d8da98df-0056-4040-a186-79938f996c2b-kube-api-access-qhz42\") pod \"kuadrant-operator-controller-manager-86878c769f-p4tmk\" (UID: \"d8da98df-0056-4040-a186-79938f996c2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"
Jul 17 15:30:12.903473 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:12.903395    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"
Jul 17 15:30:13.056246 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:30:13.056217    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8da98df_0056_4040_a186_79938f996c2b.slice/crio-e0d2060a6cb5088e546a450abbcfc5cd6988e05d56cb1d8951fe9db95a16588f WatchSource:0}: Error finding container e0d2060a6cb5088e546a450abbcfc5cd6988e05d56cb1d8951fe9db95a16588f: Status 404 returned error can't find the container with id e0d2060a6cb5088e546a450abbcfc5cd6988e05d56cb1d8951fe9db95a16588f
Jul 17 15:30:13.059053 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:13.059031    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"]
Jul 17 15:30:13.902634 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:13.902597    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk" event={"ID":"d8da98df-0056-4040-a186-79938f996c2b","Type":"ContainerStarted","Data":"c6b4572bd105a8bc0da54ee298ef7647b7789afd5a5e57bae4504a5b1eea7a93"}
Jul 17 15:30:13.903127 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:13.902654    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk" event={"ID":"d8da98df-0056-4040-a186-79938f996c2b","Type":"ContainerStarted","Data":"e0d2060a6cb5088e546a450abbcfc5cd6988e05d56cb1d8951fe9db95a16588f"}
Jul 17 15:30:13.903127 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:13.902733    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"
Jul 17 15:30:13.937768 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:13.937719    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk" podStartSLOduration=1.937704538 podStartE2EDuration="1.937704538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:30:13.935598021 +0000 UTC m=+1265.600048125" watchObservedRunningTime="2026-07-17 15:30:13.937704538 +0000 UTC m=+1265.602154698"
Jul 17 15:30:21.483737 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:21.483699    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:30:24.908924 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:24.908895    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p4tmk"
Jul 17 15:30:32.511080 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:32.511040    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:30:41.313256 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:41.313220    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:30:53.451703 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:30:53.451668    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:31:06.616752 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:31:06.616720    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:31:15.918604 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:31:15.918565    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:31:27.106328 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:31:27.106297    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:31:34.299088 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:31:34.299009    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:31:43.105436 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:31:43.105401    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:31:51.005885 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:31:51.005837    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:32:03.513150 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:32:03.513111    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:32:12.603658 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:32:12.603624    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:32:23.809013 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:32:23.808978    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:32:41.202836 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:32:41.202800    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:32:49.814621 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:32:49.814587    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:33:00.035060 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:33:00.035026    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:33:10.916799 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:33:10.916765    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:33:26.914702 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:33:26.914664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:33:36.833691 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:33:36.833659    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:33:45.607073 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:33:45.607039    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:33:55.419609 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:33:55.419576    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:34:05.118618 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:34:05.118587    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:34:16.302044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:34:16.302008    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:34:28.617000 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:34:28.616969    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:34:37.416319 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:34:37.416240    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:34:46.917576 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:34:46.917542    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:34:58.613154 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:34:58.613117    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:35:08.614350 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:35:08.614313    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:35:19.933955 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:35:19.933922    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:35:30.919265 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:35:30.919231    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:35:41.909397 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:35:41.909362    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:35:52.115067 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:35:52.115027    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:35:57.436958 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:35:57.436922    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:35:58.800365 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:35:58.800336    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:03.690294 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:03.690222    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:03.792692 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:03.792654    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:03.892083 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:03.892058    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:03.958260 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:03.958175    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:05.085706 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:05.085676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:05.183942 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:05.183910    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:05.352674 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:05.352565    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:05.534781 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:05.534741    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:05.864545 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:05.864506    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:05.966725 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:05.966686    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:07.471085 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:07.471057    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:10.008418 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:10.008383    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"]
Jul 17 15:36:10.011612 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:10.011596    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"
Jul 17 15:36:10.014239 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:10.014215    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:36:10.014366 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:10.014216    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:36:10.019578 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:10.019555    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"]
Jul 17 15:36:10.098718 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:10.098690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3f66c6a-7b46-4ae7-bba6-4e69d449b870-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9\" (UID: \"f3f66c6a-7b46-4ae7-bba6-4e69d449b870\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"
Jul 17 15:36:10.199785 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:10.199757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3f66c6a-7b46-4ae7-bba6-4e69d449b870-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9\" (UID: \"f3f66c6a-7b46-4ae7-bba6-4e69d449b870\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"
Jul 17 15:36:10.200362 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:10.200342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3f66c6a-7b46-4ae7-bba6-4e69d449b870-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9\" (UID: \"f3f66c6a-7b46-4ae7-bba6-4e69d449b870\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"
Jul 17 15:36:10.322249 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:10.322171    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"
Jul 17 15:36:10.452922 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:10.452894    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"]
Jul 17 15:36:10.455032 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:36:10.455007    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f66c6a_7b46_4ae7_bba6_4e69d449b870.slice/crio-66e9606b76b43af4637bbb2416aa16cc6e2d6ab7086030306e76fca56570cd9b WatchSource:0}: Error finding container 66e9606b76b43af4637bbb2416aa16cc6e2d6ab7086030306e76fca56570cd9b: Status 404 returned error can't find the container with id 66e9606b76b43af4637bbb2416aa16cc6e2d6ab7086030306e76fca56570cd9b
Jul 17 15:36:10.802764 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:10.802727    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:36:11.431186 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:11.431106    2582 generic.go:356] "Generic (PLEG): container finished" podID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerID="3dea36736e5edffafa4a6ab0c5e3341e8892d862b72e8d6e1a64ed3a1fe6e76d" exitCode=7
Jul 17 15:36:11.431522 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:11.431189    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9" event={"ID":"f3f66c6a-7b46-4ae7-bba6-4e69d449b870","Type":"ContainerDied","Data":"3dea36736e5edffafa4a6ab0c5e3341e8892d862b72e8d6e1a64ed3a1fe6e76d"}
Jul 17 15:36:11.431522 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:11.431241    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9" event={"ID":"f3f66c6a-7b46-4ae7-bba6-4e69d449b870","Type":"ContainerStarted","Data":"66e9606b76b43af4637bbb2416aa16cc6e2d6ab7086030306e76fca56570cd9b"}
Jul 17 15:36:11.431522 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:11.431337    2582 scope.go:117] "RemoveContainer" containerID="3dea36736e5edffafa4a6ab0c5e3341e8892d862b72e8d6e1a64ed3a1fe6e76d"
Jul 17 15:36:12.437420 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:12.437322    2582 generic.go:356] "Generic (PLEG): container finished" podID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerID="227df6c6c9160dad1068edcf371ea3b9c1958f25e134f4515848ffdb64161521" exitCode=7
Jul 17 15:36:12.437420 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:12.437385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9" event={"ID":"f3f66c6a-7b46-4ae7-bba6-4e69d449b870","Type":"ContainerDied","Data":"227df6c6c9160dad1068edcf371ea3b9c1958f25e134f4515848ffdb64161521"}
Jul 17 15:36:12.437952 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:12.437432    2582 scope.go:117] "RemoveContainer" containerID="3dea36736e5edffafa4a6ab0c5e3341e8892d862b72e8d6e1a64ed3a1fe6e76d"
Jul 17 15:36:12.437952 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:12.437647    2582 scope.go:117] "RemoveContainer" containerID="227df6c6c9160dad1068edcf371ea3b9c1958f25e134f4515848ffdb64161521"
Jul 17 15:36:12.437952 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:36:12.437882    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9_odh-ai-gateway-infra(f3f66c6a-7b46-4ae7-bba6-4e69d449b870)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870"
Jul 17 15:36:13.442755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:13.442724    2582 scope.go:117] "RemoveContainer" containerID="227df6c6c9160dad1068edcf371ea3b9c1958f25e134f4515848ffdb64161521"
Jul 17 15:36:13.443180 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:36:13.442941    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9_odh-ai-gateway-infra(f3f66c6a-7b46-4ae7-bba6-4e69d449b870)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870"
Jul 17 15:36:16.703021 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:16.702986    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:36:24.898718 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:24.898689    2582 scope.go:117] "RemoveContainer" containerID="227df6c6c9160dad1068edcf371ea3b9c1958f25e134f4515848ffdb64161521"
Jul 17 15:36:25.493773 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:25.493742    2582 generic.go:356] "Generic (PLEG): container finished" podID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerID="21e643149b95ad92866827a5e6aecb00430ddbf236ecf1fb4213c1b7a676592c" exitCode=7
Jul 17 15:36:25.493920 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:25.493785    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9" event={"ID":"f3f66c6a-7b46-4ae7-bba6-4e69d449b870","Type":"ContainerDied","Data":"21e643149b95ad92866827a5e6aecb00430ddbf236ecf1fb4213c1b7a676592c"}
Jul 17 15:36:25.493920 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:25.493835    2582 scope.go:117] "RemoveContainer" containerID="227df6c6c9160dad1068edcf371ea3b9c1958f25e134f4515848ffdb64161521"
Jul 17 15:36:25.494119 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:25.494092    2582 scope.go:117] "RemoveContainer" containerID="21e643149b95ad92866827a5e6aecb00430ddbf236ecf1fb4213c1b7a676592c"
Jul 17 15:36:25.494308 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:36:25.494286    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9_odh-ai-gateway-infra(f3f66c6a-7b46-4ae7-bba6-4e69d449b870)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870"
Jul 17 15:36:26.524561 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:26.524524    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"]
Jul 17 15:36:26.651758 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:26.651734    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"
Jul 17 15:36:26.729039 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:26.729014    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3f66c6a-7b46-4ae7-bba6-4e69d449b870-maas-api-service-ca\") pod \"f3f66c6a-7b46-4ae7-bba6-4e69d449b870\" (UID: \"f3f66c6a-7b46-4ae7-bba6-4e69d449b870\") "
Jul 17 15:36:26.729313 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:26.729292    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3f66c6a-7b46-4ae7-bba6-4e69d449b870-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f3f66c6a-7b46-4ae7-bba6-4e69d449b870" (UID: "f3f66c6a-7b46-4ae7-bba6-4e69d449b870"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:36:26.830006 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:26.829952    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3f66c6a-7b46-4ae7-bba6-4e69d449b870-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:36:27.505581 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:27.505549    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"
Jul 17 15:36:27.505581 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:27.505563    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9" event={"ID":"f3f66c6a-7b46-4ae7-bba6-4e69d449b870","Type":"ContainerDied","Data":"66e9606b76b43af4637bbb2416aa16cc6e2d6ab7086030306e76fca56570cd9b"}
Jul 17 15:36:27.505793 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:27.505654    2582 scope.go:117] "RemoveContainer" containerID="21e643149b95ad92866827a5e6aecb00430ddbf236ecf1fb4213c1b7a676592c"
Jul 17 15:36:27.524829 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:27.524801    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"]
Jul 17 15:36:27.529839 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:27.529818    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-mxhz9"]
Jul 17 15:36:28.905613 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:36:28.905561    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" path="/var/lib/kubelet/pods/f3f66c6a-7b46-4ae7-bba6-4e69d449b870/volumes"
Jul 17 15:37:00.072615 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.072576    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"]
Jul 17 15:37:00.073166 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.072959    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerName="revoke-keys"
Jul 17 15:37:00.073166 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.072972    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerName="revoke-keys"
Jul 17 15:37:00.073166 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.072990    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerName="revoke-keys"
Jul 17 15:37:00.073166 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.072995    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerName="revoke-keys"
Jul 17 15:37:00.073166 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.073040    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerName="revoke-keys"
Jul 17 15:37:00.073166 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.073049    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerName="revoke-keys"
Jul 17 15:37:00.076045 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.076026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"
Jul 17 15:37:00.078940 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.078917    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:37:00.079036 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.078988    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:37:00.084595 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.084573    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"]
Jul 17 15:37:00.201034 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.200998    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ec8b19-a3da-4186-93ff-4aaaa11653b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf\" (UID: \"56ec8b19-a3da-4186-93ff-4aaaa11653b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"
Jul 17 15:37:00.302372 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.302330    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ec8b19-a3da-4186-93ff-4aaaa11653b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf\" (UID: \"56ec8b19-a3da-4186-93ff-4aaaa11653b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"
Jul 17 15:37:00.302957 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.302936    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ec8b19-a3da-4186-93ff-4aaaa11653b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf\" (UID: \"56ec8b19-a3da-4186-93ff-4aaaa11653b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"
Jul 17 15:37:00.386420 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.386350    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"
Jul 17 15:37:00.727330 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:00.727273    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"]
Jul 17 15:37:00.729501 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:37:00.729473    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ec8b19_a3da_4186_93ff_4aaaa11653b6.slice/crio-0a8375d0d4854962fccb4b6d7e71901ae8e00301395a0d1ec5b7e5f3a8a5a344 WatchSource:0}: Error finding container 0a8375d0d4854962fccb4b6d7e71901ae8e00301395a0d1ec5b7e5f3a8a5a344: Status 404 returned error can't find the container with id 0a8375d0d4854962fccb4b6d7e71901ae8e00301395a0d1ec5b7e5f3a8a5a344
Jul 17 15:37:01.658894 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:01.658784    2582 generic.go:356] "Generic (PLEG): container finished" podID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerID="64ea5e0786e18e6f115fdf2c510ebfd2d379f9cc6b33bd5262d5c727d883c778" exitCode=7
Jul 17 15:37:01.658894 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:01.658836    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf" event={"ID":"56ec8b19-a3da-4186-93ff-4aaaa11653b6","Type":"ContainerDied","Data":"64ea5e0786e18e6f115fdf2c510ebfd2d379f9cc6b33bd5262d5c727d883c778"}
Jul 17 15:37:01.659416 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:01.658907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf" event={"ID":"56ec8b19-a3da-4186-93ff-4aaaa11653b6","Type":"ContainerStarted","Data":"0a8375d0d4854962fccb4b6d7e71901ae8e00301395a0d1ec5b7e5f3a8a5a344"}
Jul 17 15:37:01.659416 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:01.659130    2582 scope.go:117] "RemoveContainer" containerID="64ea5e0786e18e6f115fdf2c510ebfd2d379f9cc6b33bd5262d5c727d883c778"
Jul 17 15:37:02.664896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:02.664793    2582 generic.go:356] "Generic (PLEG): container finished" podID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerID="7d3e27ce791942f75be21547118268e2e2df0500641c835a6e48223cd3f25402" exitCode=7
Jul 17 15:37:02.664896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:02.664867    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf" event={"ID":"56ec8b19-a3da-4186-93ff-4aaaa11653b6","Type":"ContainerDied","Data":"7d3e27ce791942f75be21547118268e2e2df0500641c835a6e48223cd3f25402"}
Jul 17 15:37:02.665357 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:02.664937    2582 scope.go:117] "RemoveContainer" containerID="64ea5e0786e18e6f115fdf2c510ebfd2d379f9cc6b33bd5262d5c727d883c778"
Jul 17 15:37:02.665357 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:02.665128    2582 scope.go:117] "RemoveContainer" containerID="7d3e27ce791942f75be21547118268e2e2df0500641c835a6e48223cd3f25402"
Jul 17 15:37:02.665357 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:37:02.665338    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf_odh-ai-gateway-infra(56ec8b19-a3da-4186-93ff-4aaaa11653b6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6"
Jul 17 15:37:03.670724 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:03.670691    2582 scope.go:117] "RemoveContainer" containerID="7d3e27ce791942f75be21547118268e2e2df0500641c835a6e48223cd3f25402"
Jul 17 15:37:03.671123 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:37:03.670875    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf_odh-ai-gateway-infra(56ec8b19-a3da-4186-93ff-4aaaa11653b6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6"
Jul 17 15:37:18.900422 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:18.900394    2582 scope.go:117] "RemoveContainer" containerID="7d3e27ce791942f75be21547118268e2e2df0500641c835a6e48223cd3f25402"
Jul 17 15:37:19.741183 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:19.741095    2582 generic.go:356] "Generic (PLEG): container finished" podID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerID="b85a9f50dc6245121896344edd4348492659c0fbb1056b7e82a678f7e4927c18" exitCode=7
Jul 17 15:37:19.741183 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:19.741132    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf" event={"ID":"56ec8b19-a3da-4186-93ff-4aaaa11653b6","Type":"ContainerDied","Data":"b85a9f50dc6245121896344edd4348492659c0fbb1056b7e82a678f7e4927c18"}
Jul 17 15:37:19.741183 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:19.741180    2582 scope.go:117] "RemoveContainer" containerID="7d3e27ce791942f75be21547118268e2e2df0500641c835a6e48223cd3f25402"
Jul 17 15:37:19.741489 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:19.741471    2582 scope.go:117] "RemoveContainer" containerID="b85a9f50dc6245121896344edd4348492659c0fbb1056b7e82a678f7e4927c18"
Jul 17 15:37:19.741716 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:37:19.741695    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf_odh-ai-gateway-infra(56ec8b19-a3da-4186-93ff-4aaaa11653b6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6"
Jul 17 15:37:20.770608 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:20.770559    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"]
Jul 17 15:37:20.899759 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:20.899727    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"
Jul 17 15:37:20.972581 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:20.972553    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ec8b19-a3da-4186-93ff-4aaaa11653b6-maas-api-service-ca\") pod \"56ec8b19-a3da-4186-93ff-4aaaa11653b6\" (UID: \"56ec8b19-a3da-4186-93ff-4aaaa11653b6\") "
Jul 17 15:37:20.972914 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:20.972892    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56ec8b19-a3da-4186-93ff-4aaaa11653b6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "56ec8b19-a3da-4186-93ff-4aaaa11653b6" (UID: "56ec8b19-a3da-4186-93ff-4aaaa11653b6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:37:21.073644 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:21.073565    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56ec8b19-a3da-4186-93ff-4aaaa11653b6-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:37:21.753222 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:21.753196    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"
Jul 17 15:37:21.753382 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:21.753228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf" event={"ID":"56ec8b19-a3da-4186-93ff-4aaaa11653b6","Type":"ContainerDied","Data":"0a8375d0d4854962fccb4b6d7e71901ae8e00301395a0d1ec5b7e5f3a8a5a344"}
Jul 17 15:37:21.753382 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:21.753285    2582 scope.go:117] "RemoveContainer" containerID="b85a9f50dc6245121896344edd4348492659c0fbb1056b7e82a678f7e4927c18"
Jul 17 15:37:21.775769 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:21.775737    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"]
Jul 17 15:37:21.781712 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:21.781691    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-hwjjf"]
Jul 17 15:37:22.903290 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:22.903257    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" path="/var/lib/kubelet/pods/56ec8b19-a3da-4186-93ff-4aaaa11653b6/volumes"
Jul 17 15:37:44.962547 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:44.962448    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:45.021196 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:45.021167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:55.513784 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:55.513746    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:37:55.614680 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:37:55.614645    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:00.131219 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131189    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"]
Jul 17 15:38:00.131591 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131499    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerName="revoke-keys"
Jul 17 15:38:00.131591 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131508    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerName="revoke-keys"
Jul 17 15:38:00.131591 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131521    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerName="revoke-keys"
Jul 17 15:38:00.131591 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131527    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerName="revoke-keys"
Jul 17 15:38:00.131591 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131533    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerName="revoke-keys"
Jul 17 15:38:00.131591 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131538    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerName="revoke-keys"
Jul 17 15:38:00.131591 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131544    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerName="revoke-keys"
Jul 17 15:38:00.131591 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131549    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerName="revoke-keys"
Jul 17 15:38:00.131828 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131597    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerName="revoke-keys"
Jul 17 15:38:00.131828 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131604    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f66c6a-7b46-4ae7-bba6-4e69d449b870" containerName="revoke-keys"
Jul 17 15:38:00.131828 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131611    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerName="revoke-keys"
Jul 17 15:38:00.131828 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.131617    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="56ec8b19-a3da-4186-93ff-4aaaa11653b6" containerName="revoke-keys"
Jul 17 15:38:00.134420 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.134401    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"
Jul 17 15:38:00.136992 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.136968    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:38:00.137096 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.137042    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:38:00.143239 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.143217    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"]
Jul 17 15:38:00.185075 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.185031    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba7fee8-3c28-4f3b-9237-6b71fc6c7584-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7c78199-2hb94\" (UID: \"aba7fee8-3c28-4f3b-9237-6b71fc6c7584\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"
Jul 17 15:38:00.286070 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.286040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba7fee8-3c28-4f3b-9237-6b71fc6c7584-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7c78199-2hb94\" (UID: \"aba7fee8-3c28-4f3b-9237-6b71fc6c7584\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"
Jul 17 15:38:00.286640 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.286618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba7fee8-3c28-4f3b-9237-6b71fc6c7584-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e7c78199-2hb94\" (UID: \"aba7fee8-3c28-4f3b-9237-6b71fc6c7584\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"
Jul 17 15:38:00.444992 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.444910    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"
Jul 17 15:38:00.565880 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.565824    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"]
Jul 17 15:38:00.567945 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:38:00.567919    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba7fee8_3c28_4f3b_9237_6b71fc6c7584.slice/crio-273c45cfaaab4d57eca5cf6b1dc0ca2ca745ea7b68ed1a9f9fbaf7329cccd22f WatchSource:0}: Error finding container 273c45cfaaab4d57eca5cf6b1dc0ca2ca745ea7b68ed1a9f9fbaf7329cccd22f: Status 404 returned error can't find the container with id 273c45cfaaab4d57eca5cf6b1dc0ca2ca745ea7b68ed1a9f9fbaf7329cccd22f
Jul 17 15:38:00.915061 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.915029    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94" event={"ID":"aba7fee8-3c28-4f3b-9237-6b71fc6c7584","Type":"ContainerStarted","Data":"e451c38526b4a70af2784cc98081110a0d77824cbd250d4b6b6d16cdb8d4ced3"}
Jul 17 15:38:00.915161 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.915077    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94" event={"ID":"aba7fee8-3c28-4f3b-9237-6b71fc6c7584","Type":"ContainerStarted","Data":"273c45cfaaab4d57eca5cf6b1dc0ca2ca745ea7b68ed1a9f9fbaf7329cccd22f"}
Jul 17 15:38:00.932626 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:00.932586    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94" podStartSLOduration=0.932570324 podStartE2EDuration="932.570324ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:38:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:38:00.931441247 +0000 UTC m=+1732.595891351" watchObservedRunningTime="2026-07-17 15:38:00.932570324 +0000 UTC m=+1732.597020427"
Jul 17 15:38:01.920903 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:01.920863    2582 generic.go:356] "Generic (PLEG): container finished" podID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerID="e451c38526b4a70af2784cc98081110a0d77824cbd250d4b6b6d16cdb8d4ced3" exitCode=7
Jul 17 15:38:01.921292 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:01.920944    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94" event={"ID":"aba7fee8-3c28-4f3b-9237-6b71fc6c7584","Type":"ContainerDied","Data":"e451c38526b4a70af2784cc98081110a0d77824cbd250d4b6b6d16cdb8d4ced3"}
Jul 17 15:38:01.921292 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:01.921112    2582 scope.go:117] "RemoveContainer" containerID="e451c38526b4a70af2784cc98081110a0d77824cbd250d4b6b6d16cdb8d4ced3"
Jul 17 15:38:02.927813 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:02.927729    2582 generic.go:356] "Generic (PLEG): container finished" podID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerID="cceac3b0ca6c22d479432f9017321b384612c5913972719b53a941c993f612de" exitCode=7
Jul 17 15:38:02.928230 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:02.927823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94" event={"ID":"aba7fee8-3c28-4f3b-9237-6b71fc6c7584","Type":"ContainerDied","Data":"cceac3b0ca6c22d479432f9017321b384612c5913972719b53a941c993f612de"}
Jul 17 15:38:02.928230 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:02.927912    2582 scope.go:117] "RemoveContainer" containerID="e451c38526b4a70af2784cc98081110a0d77824cbd250d4b6b6d16cdb8d4ced3"
Jul 17 15:38:02.928230 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:02.928118    2582 scope.go:117] "RemoveContainer" containerID="cceac3b0ca6c22d479432f9017321b384612c5913972719b53a941c993f612de"
Jul 17 15:38:02.928382 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:38:02.928318    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-e7c78199-2hb94_odh-ai-gateway-infra(aba7fee8-3c28-4f3b-9237-6b71fc6c7584)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584"
Jul 17 15:38:03.933465 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:03.933439    2582 scope.go:117] "RemoveContainer" containerID="cceac3b0ca6c22d479432f9017321b384612c5913972719b53a941c993f612de"
Jul 17 15:38:03.933831 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:38:03.933602    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-e7c78199-2hb94_odh-ai-gateway-infra(aba7fee8-3c28-4f3b-9237-6b71fc6c7584)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584"
Jul 17 15:38:15.898539 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:15.898508    2582 scope.go:117] "RemoveContainer" containerID="cceac3b0ca6c22d479432f9017321b384612c5913972719b53a941c993f612de"
Jul 17 15:38:16.989751 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:16.989718    2582 generic.go:356] "Generic (PLEG): container finished" podID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerID="65e391f8210ac0d71a5e5f101ec6049005971d1ff7106b28c4bd6671204f5599" exitCode=7
Jul 17 15:38:16.990198 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:16.989756    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94" event={"ID":"aba7fee8-3c28-4f3b-9237-6b71fc6c7584","Type":"ContainerDied","Data":"65e391f8210ac0d71a5e5f101ec6049005971d1ff7106b28c4bd6671204f5599"}
Jul 17 15:38:16.990198 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:16.989803    2582 scope.go:117] "RemoveContainer" containerID="cceac3b0ca6c22d479432f9017321b384612c5913972719b53a941c993f612de"
Jul 17 15:38:16.990198 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:16.990095    2582 scope.go:117] "RemoveContainer" containerID="65e391f8210ac0d71a5e5f101ec6049005971d1ff7106b28c4bd6671204f5599"
Jul 17 15:38:16.990324 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:38:16.990261    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-e7c78199-2hb94_odh-ai-gateway-infra(aba7fee8-3c28-4f3b-9237-6b71fc6c7584)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584"
Jul 17 15:38:18.021908 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:18.021878    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"]
Jul 17 15:38:18.147044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:18.147021    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"
Jul 17 15:38:18.235413 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:18.235379    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba7fee8-3c28-4f3b-9237-6b71fc6c7584-maas-api-service-ca\") pod \"aba7fee8-3c28-4f3b-9237-6b71fc6c7584\" (UID: \"aba7fee8-3c28-4f3b-9237-6b71fc6c7584\") "
Jul 17 15:38:18.235737 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:18.235714    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aba7fee8-3c28-4f3b-9237-6b71fc6c7584-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aba7fee8-3c28-4f3b-9237-6b71fc6c7584" (UID: "aba7fee8-3c28-4f3b-9237-6b71fc6c7584"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:38:18.336807 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:18.336736    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba7fee8-3c28-4f3b-9237-6b71fc6c7584-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:38:19.002127 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:19.002100    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"
Jul 17 15:38:19.002303 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:19.002122    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94" event={"ID":"aba7fee8-3c28-4f3b-9237-6b71fc6c7584","Type":"ContainerDied","Data":"273c45cfaaab4d57eca5cf6b1dc0ca2ca745ea7b68ed1a9f9fbaf7329cccd22f"}
Jul 17 15:38:19.002303 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:19.002185    2582 scope.go:117] "RemoveContainer" containerID="65e391f8210ac0d71a5e5f101ec6049005971d1ff7106b28c4bd6671204f5599"
Jul 17 15:38:19.022211 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:19.022184    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"]
Jul 17 15:38:19.029789 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:19.029766    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e7c78199-2hb94"]
Jul 17 15:38:20.189930 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:20.189891    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:20.772529 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:20.772498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:20.904256 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:20.904218    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" path="/var/lib/kubelet/pods/aba7fee8-3c28-4f3b-9237-6b71fc6c7584/volumes"
Jul 17 15:38:23.707719 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:23.707685    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:38:25.484026 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:25.483994    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:31.960817 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:31.960785    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:32.023099 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:32.023057    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:35.637092 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:35.637056    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:36.016242 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:36.016200    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:36.118666 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:36.118630    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:36.252001 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:36.251951    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:37.460723 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:37.460677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:37.575021 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:37.574989    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:37.858467 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:37.858432    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:38.076114 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:38.076082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:38.173901 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:38.173801    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:42.007434 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.007400    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"]
Jul 17 15:38:42.007784 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.007697    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerName="revoke-keys"
Jul 17 15:38:42.007784 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.007708    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerName="revoke-keys"
Jul 17 15:38:42.007784 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.007718    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerName="revoke-keys"
Jul 17 15:38:42.007784 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.007723    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerName="revoke-keys"
Jul 17 15:38:42.007784 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.007730    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerName="revoke-keys"
Jul 17 15:38:42.007784 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.007735    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerName="revoke-keys"
Jul 17 15:38:42.007976 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.007795    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerName="revoke-keys"
Jul 17 15:38:42.007976 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.007802    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerName="revoke-keys"
Jul 17 15:38:42.007976 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.007809    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba7fee8-3c28-4f3b-9237-6b71fc6c7584" containerName="revoke-keys"
Jul 17 15:38:42.010898 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.010879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"
Jul 17 15:38:42.013702 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.013671    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:38:42.013825 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.013804    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:38:42.019240 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.019214    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"]
Jul 17 15:38:42.126623 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.126586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b004d4-1246-4d8e-98df-2f989177cce1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7\" (UID: \"54b004d4-1246-4d8e-98df-2f989177cce1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"
Jul 17 15:38:42.227040 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.227005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b004d4-1246-4d8e-98df-2f989177cce1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7\" (UID: \"54b004d4-1246-4d8e-98df-2f989177cce1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"
Jul 17 15:38:42.227563 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.227545    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b004d4-1246-4d8e-98df-2f989177cce1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7\" (UID: \"54b004d4-1246-4d8e-98df-2f989177cce1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"
Jul 17 15:38:42.321777 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.321698    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"
Jul 17 15:38:42.410009 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.409974    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:38:42.448734 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:42.448679    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"]
Jul 17 15:38:42.454832 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:38:42.454803    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b004d4_1246_4d8e_98df_2f989177cce1.slice/crio-18d462880373a9e424c05e117b749c4c3a639a99c0de2401d5dd82f5d0146d43 WatchSource:0}: Error finding container 18d462880373a9e424c05e117b749c4c3a639a99c0de2401d5dd82f5d0146d43: Status 404 returned error can't find the container with id 18d462880373a9e424c05e117b749c4c3a639a99c0de2401d5dd82f5d0146d43
Jul 17 15:38:43.106051 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:43.106017    2582 generic.go:356] "Generic (PLEG): container finished" podID="54b004d4-1246-4d8e-98df-2f989177cce1" containerID="81c9953d4a221dbd7e5415cb3c7783de3ec1fd296ecfd20d0540e3874433fc05" exitCode=7
Jul 17 15:38:43.106373 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:43.106101    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7" event={"ID":"54b004d4-1246-4d8e-98df-2f989177cce1","Type":"ContainerDied","Data":"81c9953d4a221dbd7e5415cb3c7783de3ec1fd296ecfd20d0540e3874433fc05"}
Jul 17 15:38:43.106373 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:43.106151    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7" event={"ID":"54b004d4-1246-4d8e-98df-2f989177cce1","Type":"ContainerStarted","Data":"18d462880373a9e424c05e117b749c4c3a639a99c0de2401d5dd82f5d0146d43"}
Jul 17 15:38:43.106373 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:43.106252    2582 scope.go:117] "RemoveContainer" containerID="81c9953d4a221dbd7e5415cb3c7783de3ec1fd296ecfd20d0540e3874433fc05"
Jul 17 15:38:44.112467 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:44.112434    2582 generic.go:356] "Generic (PLEG): container finished" podID="54b004d4-1246-4d8e-98df-2f989177cce1" containerID="52b29c5dbe947ee49b125bbf1b0d05e3a126ae4b6279928ab26eba7187e87c23" exitCode=7
Jul 17 15:38:44.112958 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:44.112500    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7" event={"ID":"54b004d4-1246-4d8e-98df-2f989177cce1","Type":"ContainerDied","Data":"52b29c5dbe947ee49b125bbf1b0d05e3a126ae4b6279928ab26eba7187e87c23"}
Jul 17 15:38:44.112958 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:44.112576    2582 scope.go:117] "RemoveContainer" containerID="81c9953d4a221dbd7e5415cb3c7783de3ec1fd296ecfd20d0540e3874433fc05"
Jul 17 15:38:44.112958 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:44.112818    2582 scope.go:117] "RemoveContainer" containerID="52b29c5dbe947ee49b125bbf1b0d05e3a126ae4b6279928ab26eba7187e87c23"
Jul 17 15:38:44.113084 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:38:44.113066    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7_odh-ai-gateway-infra(54b004d4-1246-4d8e-98df-2f989177cce1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7" podUID="54b004d4-1246-4d8e-98df-2f989177cce1"
Jul 17 15:38:45.118497 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:45.118474    2582 scope.go:117] "RemoveContainer" containerID="52b29c5dbe947ee49b125bbf1b0d05e3a126ae4b6279928ab26eba7187e87c23"
Jul 17 15:38:45.118943 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:38:45.118639    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7_odh-ai-gateway-infra(54b004d4-1246-4d8e-98df-2f989177cce1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7" podUID="54b004d4-1246-4d8e-98df-2f989177cce1"
Jul 17 15:38:57.154575 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:57.154537    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:57.215451 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:57.215422    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:38:58.900588 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:58.900563    2582 scope.go:117] "RemoveContainer" containerID="52b29c5dbe947ee49b125bbf1b0d05e3a126ae4b6279928ab26eba7187e87c23"
Jul 17 15:38:59.181104 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:59.181021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7" event={"ID":"54b004d4-1246-4d8e-98df-2f989177cce1","Type":"ContainerStarted","Data":"895e53cfac87a8a8afb9461dcd460fafa7eaa87f6dd010dc9bc89c67737075b1"}
Jul 17 15:38:59.201125 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:38:59.201077    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7" podStartSLOduration=18.20106247 podStartE2EDuration="18.20106247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:38:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:38:59.19917497 +0000 UTC m=+1790.863625074" watchObservedRunningTime="2026-07-17 15:38:59.20106247 +0000 UTC m=+1790.865512575"
Jul 17 15:39:00.186895 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:00.186839    2582 generic.go:356] "Generic (PLEG): container finished" podID="54b004d4-1246-4d8e-98df-2f989177cce1" containerID="895e53cfac87a8a8afb9461dcd460fafa7eaa87f6dd010dc9bc89c67737075b1" exitCode=7
Jul 17 15:39:00.187313 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:00.186913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7" event={"ID":"54b004d4-1246-4d8e-98df-2f989177cce1","Type":"ContainerDied","Data":"895e53cfac87a8a8afb9461dcd460fafa7eaa87f6dd010dc9bc89c67737075b1"}
Jul 17 15:39:00.187313 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:00.186999    2582 scope.go:117] "RemoveContainer" containerID="52b29c5dbe947ee49b125bbf1b0d05e3a126ae4b6279928ab26eba7187e87c23"
Jul 17 15:39:00.187313 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:00.187253    2582 scope.go:117] "RemoveContainer" containerID="895e53cfac87a8a8afb9461dcd460fafa7eaa87f6dd010dc9bc89c67737075b1"
Jul 17 15:39:00.187455 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:39:00.187437    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7_odh-ai-gateway-infra(54b004d4-1246-4d8e-98df-2f989177cce1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7" podUID="54b004d4-1246-4d8e-98df-2f989177cce1"
Jul 17 15:39:00.211097 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:00.211072    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"]
Jul 17 15:39:00.495794 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:00.495768    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:01.313894 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:01.313866    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"
Jul 17 15:39:01.370759 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:01.370731    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b004d4-1246-4d8e-98df-2f989177cce1-maas-api-service-ca\") pod \"54b004d4-1246-4d8e-98df-2f989177cce1\" (UID: \"54b004d4-1246-4d8e-98df-2f989177cce1\") "
Jul 17 15:39:01.371099 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:01.371077    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b004d4-1246-4d8e-98df-2f989177cce1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "54b004d4-1246-4d8e-98df-2f989177cce1" (UID: "54b004d4-1246-4d8e-98df-2f989177cce1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:39:01.471554 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:01.471477    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b004d4-1246-4d8e-98df-2f989177cce1-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:39:02.197968 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:02.197931    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7" event={"ID":"54b004d4-1246-4d8e-98df-2f989177cce1","Type":"ContainerDied","Data":"18d462880373a9e424c05e117b749c4c3a639a99c0de2401d5dd82f5d0146d43"}
Jul 17 15:39:02.197968 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:02.197958    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"
Jul 17 15:39:02.198226 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:02.198002    2582 scope.go:117] "RemoveContainer" containerID="895e53cfac87a8a8afb9461dcd460fafa7eaa87f6dd010dc9bc89c67737075b1"
Jul 17 15:39:02.220811 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:02.220786    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"]
Jul 17 15:39:02.229135 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:02.229113    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-7jlw7"]
Jul 17 15:39:02.904359 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:02.904326    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54b004d4-1246-4d8e-98df-2f989177cce1" path="/var/lib/kubelet/pods/54b004d4-1246-4d8e-98df-2f989177cce1/volumes"
Jul 17 15:39:41.480489 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:41.480455    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:41.577802 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:41.577769    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:42.091768 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.091728    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"]
Jul 17 15:39:42.092147 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.092129    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b004d4-1246-4d8e-98df-2f989177cce1" containerName="revoke-keys"
Jul 17 15:39:42.092229 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.092150    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b004d4-1246-4d8e-98df-2f989177cce1" containerName="revoke-keys"
Jul 17 15:39:42.092229 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.092166    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b004d4-1246-4d8e-98df-2f989177cce1" containerName="revoke-keys"
Jul 17 15:39:42.092229 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.092173    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b004d4-1246-4d8e-98df-2f989177cce1" containerName="revoke-keys"
Jul 17 15:39:42.092370 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.092256    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="54b004d4-1246-4d8e-98df-2f989177cce1" containerName="revoke-keys"
Jul 17 15:39:42.092370 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.092270    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="54b004d4-1246-4d8e-98df-2f989177cce1" containerName="revoke-keys"
Jul 17 15:39:42.092370 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.092284    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="54b004d4-1246-4d8e-98df-2f989177cce1" containerName="revoke-keys"
Jul 17 15:39:42.095117 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.095097    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"
Jul 17 15:39:42.097892 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.097871    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:39:42.097892 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.097890    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:39:42.106139 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.106114    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"]
Jul 17 15:39:42.172764 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.172736    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:42.216547 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.216517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cac5649d-8a17-445f-80ad-5e4737383774-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr\" (UID: \"cac5649d-8a17-445f-80ad-5e4737383774\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"
Jul 17 15:39:42.252071 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.252046    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:42.317394 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.317357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cac5649d-8a17-445f-80ad-5e4737383774-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr\" (UID: \"cac5649d-8a17-445f-80ad-5e4737383774\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"
Jul 17 15:39:42.318010 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.317993    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cac5649d-8a17-445f-80ad-5e4737383774-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr\" (UID: \"cac5649d-8a17-445f-80ad-5e4737383774\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"
Jul 17 15:39:42.405573 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.405492    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"
Jul 17 15:39:42.537071 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.537040    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"]
Jul 17 15:39:42.540345 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:39:42.540319    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac5649d_8a17_445f_80ad_5e4737383774.slice/crio-fd7da4dbe779a984bee0ddf5c726a471b77cedac4c25c095b94a4e5cbc80709e WatchSource:0}: Error finding container fd7da4dbe779a984bee0ddf5c726a471b77cedac4c25c095b94a4e5cbc80709e: Status 404 returned error can't find the container with id fd7da4dbe779a984bee0ddf5c726a471b77cedac4c25c095b94a4e5cbc80709e
Jul 17 15:39:42.648308 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.648267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:42.738193 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:42.738085    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:43.369636 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:43.369600    2582 generic.go:356] "Generic (PLEG): container finished" podID="cac5649d-8a17-445f-80ad-5e4737383774" containerID="99dc11f7b427c8d75d6ca561f77a14792d5334450b59f92f9558b70f1e4fc421" exitCode=7
Jul 17 15:39:43.369835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:43.369661    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr" event={"ID":"cac5649d-8a17-445f-80ad-5e4737383774","Type":"ContainerDied","Data":"99dc11f7b427c8d75d6ca561f77a14792d5334450b59f92f9558b70f1e4fc421"}
Jul 17 15:39:43.369835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:43.369725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr" event={"ID":"cac5649d-8a17-445f-80ad-5e4737383774","Type":"ContainerStarted","Data":"fd7da4dbe779a984bee0ddf5c726a471b77cedac4c25c095b94a4e5cbc80709e"}
Jul 17 15:39:43.369975 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:43.369946    2582 scope.go:117] "RemoveContainer" containerID="99dc11f7b427c8d75d6ca561f77a14792d5334450b59f92f9558b70f1e4fc421"
Jul 17 15:39:44.376109 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:44.376078    2582 generic.go:356] "Generic (PLEG): container finished" podID="cac5649d-8a17-445f-80ad-5e4737383774" containerID="112a553b38525034a8500a63e0794776012f4002eba9d372858d3983d1c38aaa" exitCode=7
Jul 17 15:39:44.376571 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:44.376131    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr" event={"ID":"cac5649d-8a17-445f-80ad-5e4737383774","Type":"ContainerDied","Data":"112a553b38525034a8500a63e0794776012f4002eba9d372858d3983d1c38aaa"}
Jul 17 15:39:44.376571 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:44.376180    2582 scope.go:117] "RemoveContainer" containerID="99dc11f7b427c8d75d6ca561f77a14792d5334450b59f92f9558b70f1e4fc421"
Jul 17 15:39:44.376571 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:44.376345    2582 scope.go:117] "RemoveContainer" containerID="112a553b38525034a8500a63e0794776012f4002eba9d372858d3983d1c38aaa"
Jul 17 15:39:44.376737 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:39:44.376566    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr_odh-ai-gateway-infra(cac5649d-8a17-445f-80ad-5e4737383774)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr" podUID="cac5649d-8a17-445f-80ad-5e4737383774"
Jul 17 15:39:45.110066 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:45.110027    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:39:45.381863 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:45.381779    2582 scope.go:117] "RemoveContainer" containerID="112a553b38525034a8500a63e0794776012f4002eba9d372858d3983d1c38aaa"
Jul 17 15:39:45.382226 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:39:45.381968    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr_odh-ai-gateway-infra(cac5649d-8a17-445f-80ad-5e4737383774)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr" podUID="cac5649d-8a17-445f-80ad-5e4737383774"
Jul 17 15:39:48.522924 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:48.522895    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:48.626242 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:48.626203    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:49.394534 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:49.394504    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:55.584007 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:55.583973    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:55.643822 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:55.643782    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:55.810503 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:55.810463    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:55.911687 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:55.911589    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:56.905801 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:56.905760    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:57.014666 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:57.014634    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:57.139598 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:57.139562    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:57.728544 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:57.728499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:57.829044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:57.829008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:58.137256 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:58.137228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:58.859311 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:58.859277    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:39:59.318070 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:59.318033    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:39:59.898736 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:39:59.898706    2582 scope.go:117] "RemoveContainer" containerID="112a553b38525034a8500a63e0794776012f4002eba9d372858d3983d1c38aaa"
Jul 17 15:40:00.456308 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:00.456227    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr" event={"ID":"cac5649d-8a17-445f-80ad-5e4737383774","Type":"ContainerStarted","Data":"6259bfca0d70f97bb7df076f0a89e4ae67317fb655c57f93ebe7e213772e750c"}
Jul 17 15:40:00.474865 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:00.474792    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr" podStartSLOduration=18.474774263 podStartE2EDuration="18.474774263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:39:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:40:00.474249001 +0000 UTC m=+1852.138699106" watchObservedRunningTime="2026-07-17 15:40:00.474774263 +0000 UTC m=+1852.139224368"
Jul 17 15:40:01.462328 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:01.462297    2582 generic.go:356] "Generic (PLEG): container finished" podID="cac5649d-8a17-445f-80ad-5e4737383774" containerID="6259bfca0d70f97bb7df076f0a89e4ae67317fb655c57f93ebe7e213772e750c" exitCode=6
Jul 17 15:40:01.462771 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:01.462375    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr" event={"ID":"cac5649d-8a17-445f-80ad-5e4737383774","Type":"ContainerDied","Data":"6259bfca0d70f97bb7df076f0a89e4ae67317fb655c57f93ebe7e213772e750c"}
Jul 17 15:40:01.462771 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:01.462452    2582 scope.go:117] "RemoveContainer" containerID="112a553b38525034a8500a63e0794776012f4002eba9d372858d3983d1c38aaa"
Jul 17 15:40:01.462771 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:01.462743    2582 scope.go:117] "RemoveContainer" containerID="6259bfca0d70f97bb7df076f0a89e4ae67317fb655c57f93ebe7e213772e750c"
Jul 17 15:40:01.462976 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:40:01.462959    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr_odh-ai-gateway-infra(cac5649d-8a17-445f-80ad-5e4737383774)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr" podUID="cac5649d-8a17-445f-80ad-5e4737383774"
Jul 17 15:40:01.490470 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:01.490451    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"]
Jul 17 15:40:01.961684 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:01.961649    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"]
Jul 17 15:40:01.962023 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:01.962009    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b004d4-1246-4d8e-98df-2f989177cce1" containerName="revoke-keys"
Jul 17 15:40:01.962071 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:01.962025    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b004d4-1246-4d8e-98df-2f989177cce1" containerName="revoke-keys"
Jul 17 15:40:01.965975 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:01.965958    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"
Jul 17 15:40:01.972715 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:01.972684    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"]
Jul 17 15:40:02.076580 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:02.076544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8628ded-48f2-4a58-be26-3195e72dd720-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-969af631-z7bgs\" (UID: \"f8628ded-48f2-4a58-be26-3195e72dd720\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"
Jul 17 15:40:02.177995 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:02.177953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8628ded-48f2-4a58-be26-3195e72dd720-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-969af631-z7bgs\" (UID: \"f8628ded-48f2-4a58-be26-3195e72dd720\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"
Jul 17 15:40:02.178568 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:02.178547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8628ded-48f2-4a58-be26-3195e72dd720-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-969af631-z7bgs\" (UID: \"f8628ded-48f2-4a58-be26-3195e72dd720\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"
Jul 17 15:40:02.277670 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:02.277632    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"
Jul 17 15:40:02.612128 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:02.612104    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"
Jul 17 15:40:02.613693 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:02.613673    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"]
Jul 17 15:40:02.615085 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:40:02.615059    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8628ded_48f2_4a58_be26_3195e72dd720.slice/crio-cf84d8519025d592e49b769851c9caa27173f8bbdf570b9eae876372a77c6c78 WatchSource:0}: Error finding container cf84d8519025d592e49b769851c9caa27173f8bbdf570b9eae876372a77c6c78: Status 404 returned error can't find the container with id cf84d8519025d592e49b769851c9caa27173f8bbdf570b9eae876372a77c6c78
Jul 17 15:40:02.682047 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:02.682020    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cac5649d-8a17-445f-80ad-5e4737383774-maas-api-service-ca\") pod \"cac5649d-8a17-445f-80ad-5e4737383774\" (UID: \"cac5649d-8a17-445f-80ad-5e4737383774\") "
Jul 17 15:40:02.682351 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:02.682329    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cac5649d-8a17-445f-80ad-5e4737383774-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cac5649d-8a17-445f-80ad-5e4737383774" (UID: "cac5649d-8a17-445f-80ad-5e4737383774"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:40:02.783232 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:02.783205    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cac5649d-8a17-445f-80ad-5e4737383774-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:40:03.472978 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:03.472943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr" event={"ID":"cac5649d-8a17-445f-80ad-5e4737383774","Type":"ContainerDied","Data":"fd7da4dbe779a984bee0ddf5c726a471b77cedac4c25c095b94a4e5cbc80709e"}
Jul 17 15:40:03.473143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:03.473006    2582 scope.go:117] "RemoveContainer" containerID="6259bfca0d70f97bb7df076f0a89e4ae67317fb655c57f93ebe7e213772e750c"
Jul 17 15:40:03.473143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:03.472949    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"
Jul 17 15:40:03.474491 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:03.474468    2582 generic.go:356] "Generic (PLEG): container finished" podID="f8628ded-48f2-4a58-be26-3195e72dd720" containerID="a8053e55edcdffc6e54688ce8746efb5d9d51ac48bb37fe7d4db808c6f5b1515" exitCode=7
Jul 17 15:40:03.474593 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:03.474552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs" event={"ID":"f8628ded-48f2-4a58-be26-3195e72dd720","Type":"ContainerDied","Data":"a8053e55edcdffc6e54688ce8746efb5d9d51ac48bb37fe7d4db808c6f5b1515"}
Jul 17 15:40:03.474650 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:03.474606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs" event={"ID":"f8628ded-48f2-4a58-be26-3195e72dd720","Type":"ContainerStarted","Data":"cf84d8519025d592e49b769851c9caa27173f8bbdf570b9eae876372a77c6c78"}
Jul 17 15:40:03.474703 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:03.474670    2582 scope.go:117] "RemoveContainer" containerID="a8053e55edcdffc6e54688ce8746efb5d9d51ac48bb37fe7d4db808c6f5b1515"
Jul 17 15:40:03.515787 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:03.515766    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"]
Jul 17 15:40:03.521546 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:03.521525    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-mrptr"]
Jul 17 15:40:04.481600 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:04.481519    2582 generic.go:356] "Generic (PLEG): container finished" podID="f8628ded-48f2-4a58-be26-3195e72dd720" containerID="d7693b51fb8dbbaba075ca2391f03699ddc8c5e662e8d88e817914fb08ab6fef" exitCode=7
Jul 17 15:40:04.482021 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:04.481602    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs" event={"ID":"f8628ded-48f2-4a58-be26-3195e72dd720","Type":"ContainerDied","Data":"d7693b51fb8dbbaba075ca2391f03699ddc8c5e662e8d88e817914fb08ab6fef"}
Jul 17 15:40:04.482021 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:04.481660    2582 scope.go:117] "RemoveContainer" containerID="a8053e55edcdffc6e54688ce8746efb5d9d51ac48bb37fe7d4db808c6f5b1515"
Jul 17 15:40:04.482021 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:04.481866    2582 scope.go:117] "RemoveContainer" containerID="d7693b51fb8dbbaba075ca2391f03699ddc8c5e662e8d88e817914fb08ab6fef"
Jul 17 15:40:04.482176 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:40:04.482064    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-969af631-z7bgs_odh-ai-gateway-infra(f8628ded-48f2-4a58-be26-3195e72dd720)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs" podUID="f8628ded-48f2-4a58-be26-3195e72dd720"
Jul 17 15:40:04.904083 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:04.904042    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cac5649d-8a17-445f-80ad-5e4737383774" path="/var/lib/kubelet/pods/cac5649d-8a17-445f-80ad-5e4737383774/volumes"
Jul 17 15:40:05.487692 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:05.487664    2582 scope.go:117] "RemoveContainer" containerID="d7693b51fb8dbbaba075ca2391f03699ddc8c5e662e8d88e817914fb08ab6fef"
Jul 17 15:40:05.488156 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:40:05.487859    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-969af631-z7bgs_odh-ai-gateway-infra(f8628ded-48f2-4a58-be26-3195e72dd720)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs" podUID="f8628ded-48f2-4a58-be26-3195e72dd720"
Jul 17 15:40:20.899088 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:20.899055    2582 scope.go:117] "RemoveContainer" containerID="d7693b51fb8dbbaba075ca2391f03699ddc8c5e662e8d88e817914fb08ab6fef"
Jul 17 15:40:21.556894 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:21.556859    2582 generic.go:356] "Generic (PLEG): container finished" podID="f8628ded-48f2-4a58-be26-3195e72dd720" containerID="c32c3c9c792756adce975135e87e679230bb0dc79c273e1838bce256763867a4" exitCode=7
Jul 17 15:40:21.557030 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:21.556915    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs" event={"ID":"f8628ded-48f2-4a58-be26-3195e72dd720","Type":"ContainerDied","Data":"c32c3c9c792756adce975135e87e679230bb0dc79c273e1838bce256763867a4"}
Jul 17 15:40:21.557030 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:21.556972    2582 scope.go:117] "RemoveContainer" containerID="d7693b51fb8dbbaba075ca2391f03699ddc8c5e662e8d88e817914fb08ab6fef"
Jul 17 15:40:21.557255 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:21.557238    2582 scope.go:117] "RemoveContainer" containerID="c32c3c9c792756adce975135e87e679230bb0dc79c273e1838bce256763867a4"
Jul 17 15:40:21.557478 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:40:21.557453    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-969af631-z7bgs_odh-ai-gateway-infra(f8628ded-48f2-4a58-be26-3195e72dd720)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs" podUID="f8628ded-48f2-4a58-be26-3195e72dd720"
Jul 17 15:40:22.585647 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:22.585609    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"]
Jul 17 15:40:22.710439 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:22.710415    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"
Jul 17 15:40:22.853388 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:22.853306    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8628ded-48f2-4a58-be26-3195e72dd720-maas-api-service-ca\") pod \"f8628ded-48f2-4a58-be26-3195e72dd720\" (UID: \"f8628ded-48f2-4a58-be26-3195e72dd720\") "
Jul 17 15:40:22.853672 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:22.853648    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8628ded-48f2-4a58-be26-3195e72dd720-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f8628ded-48f2-4a58-be26-3195e72dd720" (UID: "f8628ded-48f2-4a58-be26-3195e72dd720"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:40:22.954115 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:22.954078    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8628ded-48f2-4a58-be26-3195e72dd720-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:40:23.568043 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:23.568008    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs" event={"ID":"f8628ded-48f2-4a58-be26-3195e72dd720","Type":"ContainerDied","Data":"cf84d8519025d592e49b769851c9caa27173f8bbdf570b9eae876372a77c6c78"}
Jul 17 15:40:23.568043 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:23.568044    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"
Jul 17 15:40:23.568288 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:23.568076    2582 scope.go:117] "RemoveContainer" containerID="c32c3c9c792756adce975135e87e679230bb0dc79c273e1838bce256763867a4"
Jul 17 15:40:23.587302 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:23.587276    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"]
Jul 17 15:40:23.596066 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:23.596043    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-z7bgs"]
Jul 17 15:40:24.903567 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:24.903537    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8628ded-48f2-4a58-be26-3195e72dd720" path="/var/lib/kubelet/pods/f8628ded-48f2-4a58-be26-3195e72dd720/volumes"
Jul 17 15:40:42.146458 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146381    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"]
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146708    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8628ded-48f2-4a58-be26-3195e72dd720" containerName="revoke-keys"
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146718    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8628ded-48f2-4a58-be26-3195e72dd720" containerName="revoke-keys"
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146732    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cac5649d-8a17-445f-80ad-5e4737383774" containerName="revoke-keys"
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146737    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cac5649d-8a17-445f-80ad-5e4737383774" containerName="revoke-keys"
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146747    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cac5649d-8a17-445f-80ad-5e4737383774" containerName="revoke-keys"
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146753    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cac5649d-8a17-445f-80ad-5e4737383774" containerName="revoke-keys"
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146759    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8628ded-48f2-4a58-be26-3195e72dd720" containerName="revoke-keys"
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146764    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8628ded-48f2-4a58-be26-3195e72dd720" containerName="revoke-keys"
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146831    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cac5649d-8a17-445f-80ad-5e4737383774" containerName="revoke-keys"
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146838    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8628ded-48f2-4a58-be26-3195e72dd720" containerName="revoke-keys"
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146860    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8628ded-48f2-4a58-be26-3195e72dd720" containerName="revoke-keys"
Jul 17 15:40:42.146896 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.146870    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cac5649d-8a17-445f-80ad-5e4737383774" containerName="revoke-keys"
Jul 17 15:40:42.149724 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.149707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"
Jul 17 15:40:42.152540 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.152513    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:40:42.152540 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.152527    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:40:42.159192 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.159160    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"]
Jul 17 15:40:42.313524 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.313487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c41a10f-70c6-4750-be02-4e223835cb1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj\" (UID: \"9c41a10f-70c6-4750-be02-4e223835cb1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"
Jul 17 15:40:42.414902 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.414806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c41a10f-70c6-4750-be02-4e223835cb1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj\" (UID: \"9c41a10f-70c6-4750-be02-4e223835cb1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"
Jul 17 15:40:42.415419 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.415400    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c41a10f-70c6-4750-be02-4e223835cb1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj\" (UID: \"9c41a10f-70c6-4750-be02-4e223835cb1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"
Jul 17 15:40:42.459886 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.459867    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"
Jul 17 15:40:42.584053 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.584022    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"]
Jul 17 15:40:42.585459 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:40:42.585438    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c41a10f_70c6_4750_be02_4e223835cb1a.slice/crio-d4bc056c5b8181a0902179035261cccda3301e723cbbf536913ce4edabef4dd5 WatchSource:0}: Error finding container d4bc056c5b8181a0902179035261cccda3301e723cbbf536913ce4edabef4dd5: Status 404 returned error can't find the container with id d4bc056c5b8181a0902179035261cccda3301e723cbbf536913ce4edabef4dd5
Jul 17 15:40:42.667829 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:42.667760    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj" event={"ID":"9c41a10f-70c6-4750-be02-4e223835cb1a","Type":"ContainerStarted","Data":"d4bc056c5b8181a0902179035261cccda3301e723cbbf536913ce4edabef4dd5"}
Jul 17 15:40:43.673219 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:43.673185    2582 generic.go:356] "Generic (PLEG): container finished" podID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerID="5b3949279cc46bf02ebb2b6ea8f724828f348a699429f0932dd017ec8c7758e2" exitCode=6
Jul 17 15:40:43.673697 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:43.673245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj" event={"ID":"9c41a10f-70c6-4750-be02-4e223835cb1a","Type":"ContainerDied","Data":"5b3949279cc46bf02ebb2b6ea8f724828f348a699429f0932dd017ec8c7758e2"}
Jul 17 15:40:43.673697 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:43.673461    2582 scope.go:117] "RemoveContainer" containerID="5b3949279cc46bf02ebb2b6ea8f724828f348a699429f0932dd017ec8c7758e2"
Jul 17 15:40:44.682012 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:44.681926    2582 generic.go:356] "Generic (PLEG): container finished" podID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerID="2dbc9723b7cc7228e90ea0e39aed7d2a4bae6b115cc55e94e3eac625ed662b2c" exitCode=6
Jul 17 15:40:44.682012 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:44.681969    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj" event={"ID":"9c41a10f-70c6-4750-be02-4e223835cb1a","Type":"ContainerDied","Data":"2dbc9723b7cc7228e90ea0e39aed7d2a4bae6b115cc55e94e3eac625ed662b2c"}
Jul 17 15:40:44.682455 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:44.682025    2582 scope.go:117] "RemoveContainer" containerID="5b3949279cc46bf02ebb2b6ea8f724828f348a699429f0932dd017ec8c7758e2"
Jul 17 15:40:44.682455 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:44.682166    2582 scope.go:117] "RemoveContainer" containerID="2dbc9723b7cc7228e90ea0e39aed7d2a4bae6b115cc55e94e3eac625ed662b2c"
Jul 17 15:40:44.682455 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:40:44.682375    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj_odh-ai-gateway-infra(9c41a10f-70c6-4750-be02-4e223835cb1a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a"
Jul 17 15:40:45.688271 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:45.688244    2582 scope.go:117] "RemoveContainer" containerID="2dbc9723b7cc7228e90ea0e39aed7d2a4bae6b115cc55e94e3eac625ed662b2c"
Jul 17 15:40:45.688648 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:40:45.688413    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj_odh-ai-gateway-infra(9c41a10f-70c6-4750-be02-4e223835cb1a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a"
Jul 17 15:40:58.904738 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:58.904691    2582 scope.go:117] "RemoveContainer" containerID="2dbc9723b7cc7228e90ea0e39aed7d2a4bae6b115cc55e94e3eac625ed662b2c"
Jul 17 15:40:59.750582 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:59.750553    2582 generic.go:356] "Generic (PLEG): container finished" podID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerID="e43430fd3d0418313c68a7e62af3b9b007f09f754227d431edf502d9e9d5c092" exitCode=6
Jul 17 15:40:59.750747 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:59.750594    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj" event={"ID":"9c41a10f-70c6-4750-be02-4e223835cb1a","Type":"ContainerDied","Data":"e43430fd3d0418313c68a7e62af3b9b007f09f754227d431edf502d9e9d5c092"}
Jul 17 15:40:59.750747 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:59.750644    2582 scope.go:117] "RemoveContainer" containerID="2dbc9723b7cc7228e90ea0e39aed7d2a4bae6b115cc55e94e3eac625ed662b2c"
Jul 17 15:40:59.750967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:40:59.750949    2582 scope.go:117] "RemoveContainer" containerID="e43430fd3d0418313c68a7e62af3b9b007f09f754227d431edf502d9e9d5c092"
Jul 17 15:40:59.751173 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:40:59.751152    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj_odh-ai-gateway-infra(9c41a10f-70c6-4750-be02-4e223835cb1a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a"
Jul 17 15:41:00.778951 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:00.778918    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"]
Jul 17 15:41:00.905037 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:00.905011    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"
Jul 17 15:41:00.949283 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:00.949254    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c41a10f-70c6-4750-be02-4e223835cb1a-maas-api-service-ca\") pod \"9c41a10f-70c6-4750-be02-4e223835cb1a\" (UID: \"9c41a10f-70c6-4750-be02-4e223835cb1a\") "
Jul 17 15:41:00.949637 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:00.949607    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c41a10f-70c6-4750-be02-4e223835cb1a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9c41a10f-70c6-4750-be02-4e223835cb1a" (UID: "9c41a10f-70c6-4750-be02-4e223835cb1a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:41:01.050717 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:01.050633    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c41a10f-70c6-4750-be02-4e223835cb1a-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:41:01.761123 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:01.761088    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj" event={"ID":"9c41a10f-70c6-4750-be02-4e223835cb1a","Type":"ContainerDied","Data":"d4bc056c5b8181a0902179035261cccda3301e723cbbf536913ce4edabef4dd5"}
Jul 17 15:41:01.761123 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:01.761111    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"
Jul 17 15:41:01.761345 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:01.761150    2582 scope.go:117] "RemoveContainer" containerID="e43430fd3d0418313c68a7e62af3b9b007f09f754227d431edf502d9e9d5c092"
Jul 17 15:41:01.783134 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:01.783109    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"]
Jul 17 15:41:01.789497 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:01.789476    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c8e11152-nxnlj"]
Jul 17 15:41:02.063751 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.063670    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"]
Jul 17 15:41:02.064003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.063990    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cac5649d-8a17-445f-80ad-5e4737383774" containerName="revoke-keys"
Jul 17 15:41:02.064054 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.064005    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cac5649d-8a17-445f-80ad-5e4737383774" containerName="revoke-keys"
Jul 17 15:41:02.064054 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.064017    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerName="revoke-keys"
Jul 17 15:41:02.064054 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.064022    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerName="revoke-keys"
Jul 17 15:41:02.064054 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.064031    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8628ded-48f2-4a58-be26-3195e72dd720" containerName="revoke-keys"
Jul 17 15:41:02.064054 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.064037    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8628ded-48f2-4a58-be26-3195e72dd720" containerName="revoke-keys"
Jul 17 15:41:02.064054 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.064048    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerName="revoke-keys"
Jul 17 15:41:02.064054 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.064052    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerName="revoke-keys"
Jul 17 15:41:02.064321 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.064105    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cac5649d-8a17-445f-80ad-5e4737383774" containerName="revoke-keys"
Jul 17 15:41:02.064321 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.064114    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8628ded-48f2-4a58-be26-3195e72dd720" containerName="revoke-keys"
Jul 17 15:41:02.064321 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.064119    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerName="revoke-keys"
Jul 17 15:41:02.064321 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.064124    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerName="revoke-keys"
Jul 17 15:41:02.068602 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.068579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"
Jul 17 15:41:02.076239 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.076218    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:41:02.076352 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.076221    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:41:02.093924 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.093898    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"]
Jul 17 15:41:02.159027 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.158989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29bc33cf-ff62-4880-a82b-090125519e84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-969af631-7shlz\" (UID: \"29bc33cf-ff62-4880-a82b-090125519e84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"
Jul 17 15:41:02.259729 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.259690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29bc33cf-ff62-4880-a82b-090125519e84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-969af631-7shlz\" (UID: \"29bc33cf-ff62-4880-a82b-090125519e84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"
Jul 17 15:41:02.260320 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.260298    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29bc33cf-ff62-4880-a82b-090125519e84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-969af631-7shlz\" (UID: \"29bc33cf-ff62-4880-a82b-090125519e84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"
Jul 17 15:41:02.377870 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.377737    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"
Jul 17 15:41:02.502667 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.502645    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"]
Jul 17 15:41:02.504387 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:41:02.504352    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bc33cf_ff62_4880_a82b_090125519e84.slice/crio-cf5a4bac6f7d1f450de86a557457d472a84fc7f152ecb6478b80b6d3c1c8b841 WatchSource:0}: Error finding container cf5a4bac6f7d1f450de86a557457d472a84fc7f152ecb6478b80b6d3c1c8b841: Status 404 returned error can't find the container with id cf5a4bac6f7d1f450de86a557457d472a84fc7f152ecb6478b80b6d3c1c8b841
Jul 17 15:41:02.768678 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.768648    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz" event={"ID":"29bc33cf-ff62-4880-a82b-090125519e84","Type":"ContainerStarted","Data":"a7bf848a813f18572ab97a44c9b4f20b54fbdaf3c8ff30c45959d4d789461147"}
Jul 17 15:41:02.768946 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.768704    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz" event={"ID":"29bc33cf-ff62-4880-a82b-090125519e84","Type":"ContainerStarted","Data":"cf5a4bac6f7d1f450de86a557457d472a84fc7f152ecb6478b80b6d3c1c8b841"}
Jul 17 15:41:02.786822 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.786779    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz" podStartSLOduration=0.786764643 podStartE2EDuration="786.764643ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:41:02.78520086 +0000 UTC m=+1914.449650983" watchObservedRunningTime="2026-07-17 15:41:02.786764643 +0000 UTC m=+1914.451214746"
Jul 17 15:41:02.904155 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:02.904118    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a" path="/var/lib/kubelet/pods/9c41a10f-70c6-4750-be02-4e223835cb1a/volumes"
Jul 17 15:41:03.774452 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:03.774418    2582 generic.go:356] "Generic (PLEG): container finished" podID="29bc33cf-ff62-4880-a82b-090125519e84" containerID="a7bf848a813f18572ab97a44c9b4f20b54fbdaf3c8ff30c45959d4d789461147" exitCode=7
Jul 17 15:41:03.774593 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:03.774499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz" event={"ID":"29bc33cf-ff62-4880-a82b-090125519e84","Type":"ContainerDied","Data":"a7bf848a813f18572ab97a44c9b4f20b54fbdaf3c8ff30c45959d4d789461147"}
Jul 17 15:41:03.774670 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:03.774657    2582 scope.go:117] "RemoveContainer" containerID="a7bf848a813f18572ab97a44c9b4f20b54fbdaf3c8ff30c45959d4d789461147"
Jul 17 15:41:04.782270 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:04.782239    2582 generic.go:356] "Generic (PLEG): container finished" podID="29bc33cf-ff62-4880-a82b-090125519e84" containerID="24086c84716e8ac303d335222aeea6655b6c470ce8ec97f3fae0a0f7dfb2a347" exitCode=7
Jul 17 15:41:04.782737 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:04.782292    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz" event={"ID":"29bc33cf-ff62-4880-a82b-090125519e84","Type":"ContainerDied","Data":"24086c84716e8ac303d335222aeea6655b6c470ce8ec97f3fae0a0f7dfb2a347"}
Jul 17 15:41:04.782737 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:04.782340    2582 scope.go:117] "RemoveContainer" containerID="a7bf848a813f18572ab97a44c9b4f20b54fbdaf3c8ff30c45959d4d789461147"
Jul 17 15:41:04.782737 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:04.782485    2582 scope.go:117] "RemoveContainer" containerID="24086c84716e8ac303d335222aeea6655b6c470ce8ec97f3fae0a0f7dfb2a347"
Jul 17 15:41:04.782737 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:41:04.782684    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-969af631-7shlz_odh-ai-gateway-infra(29bc33cf-ff62-4880-a82b-090125519e84)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz" podUID="29bc33cf-ff62-4880-a82b-090125519e84"
Jul 17 15:41:05.788481 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:05.788454    2582 scope.go:117] "RemoveContainer" containerID="24086c84716e8ac303d335222aeea6655b6c470ce8ec97f3fae0a0f7dfb2a347"
Jul 17 15:41:05.788893 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:41:05.788662    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-969af631-7shlz_odh-ai-gateway-infra(29bc33cf-ff62-4880-a82b-090125519e84)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz" podUID="29bc33cf-ff62-4880-a82b-090125519e84"
Jul 17 15:41:16.898930 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:16.898899    2582 scope.go:117] "RemoveContainer" containerID="24086c84716e8ac303d335222aeea6655b6c470ce8ec97f3fae0a0f7dfb2a347"
Jul 17 15:41:17.840773 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:17.840739    2582 generic.go:356] "Generic (PLEG): container finished" podID="29bc33cf-ff62-4880-a82b-090125519e84" containerID="23384aea840c5f8f26a5c8231e4036b79f5062087187a5312ada9dec5484c05a" exitCode=7
Jul 17 15:41:17.840972 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:17.840821    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz" event={"ID":"29bc33cf-ff62-4880-a82b-090125519e84","Type":"ContainerDied","Data":"23384aea840c5f8f26a5c8231e4036b79f5062087187a5312ada9dec5484c05a"}
Jul 17 15:41:17.840972 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:17.840904    2582 scope.go:117] "RemoveContainer" containerID="24086c84716e8ac303d335222aeea6655b6c470ce8ec97f3fae0a0f7dfb2a347"
Jul 17 15:41:17.841214 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:17.841195    2582 scope.go:117] "RemoveContainer" containerID="23384aea840c5f8f26a5c8231e4036b79f5062087187a5312ada9dec5484c05a"
Jul 17 15:41:17.841406 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:41:17.841381    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-969af631-7shlz_odh-ai-gateway-infra(29bc33cf-ff62-4880-a82b-090125519e84)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz" podUID="29bc33cf-ff62-4880-a82b-090125519e84"
Jul 17 15:41:18.868293 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:18.868256    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"]
Jul 17 15:41:19.002522 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:19.002499    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"
Jul 17 15:41:19.096603 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:19.096575    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29bc33cf-ff62-4880-a82b-090125519e84-maas-api-service-ca\") pod \"29bc33cf-ff62-4880-a82b-090125519e84\" (UID: \"29bc33cf-ff62-4880-a82b-090125519e84\") "
Jul 17 15:41:19.096995 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:19.096971    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29bc33cf-ff62-4880-a82b-090125519e84-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "29bc33cf-ff62-4880-a82b-090125519e84" (UID: "29bc33cf-ff62-4880-a82b-090125519e84"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:41:19.197325 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:19.197247    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29bc33cf-ff62-4880-a82b-090125519e84-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:41:19.852518 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:19.852485    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz" event={"ID":"29bc33cf-ff62-4880-a82b-090125519e84","Type":"ContainerDied","Data":"cf5a4bac6f7d1f450de86a557457d472a84fc7f152ecb6478b80b6d3c1c8b841"}
Jul 17 15:41:19.852694 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:19.852542    2582 scope.go:117] "RemoveContainer" containerID="23384aea840c5f8f26a5c8231e4036b79f5062087187a5312ada9dec5484c05a"
Jul 17 15:41:19.852694 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:19.852491    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"
Jul 17 15:41:19.888375 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:19.888346    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"]
Jul 17 15:41:19.892810 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:19.892788    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-7shlz"]
Jul 17 15:41:20.903722 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:20.903687    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29bc33cf-ff62-4880-a82b-090125519e84" path="/var/lib/kubelet/pods/29bc33cf-ff62-4880-a82b-090125519e84/volumes"
Jul 17 15:41:52.112353 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112313    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"]
Jul 17 15:41:52.112835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112626    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29bc33cf-ff62-4880-a82b-090125519e84" containerName="revoke-keys"
Jul 17 15:41:52.112835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112637    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="29bc33cf-ff62-4880-a82b-090125519e84" containerName="revoke-keys"
Jul 17 15:41:52.112835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112655    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29bc33cf-ff62-4880-a82b-090125519e84" containerName="revoke-keys"
Jul 17 15:41:52.112835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112660    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="29bc33cf-ff62-4880-a82b-090125519e84" containerName="revoke-keys"
Jul 17 15:41:52.112835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112669    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerName="revoke-keys"
Jul 17 15:41:52.112835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112674    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerName="revoke-keys"
Jul 17 15:41:52.112835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112681    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29bc33cf-ff62-4880-a82b-090125519e84" containerName="revoke-keys"
Jul 17 15:41:52.112835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112686    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="29bc33cf-ff62-4880-a82b-090125519e84" containerName="revoke-keys"
Jul 17 15:41:52.112835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112745    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c41a10f-70c6-4750-be02-4e223835cb1a" containerName="revoke-keys"
Jul 17 15:41:52.112835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112753    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="29bc33cf-ff62-4880-a82b-090125519e84" containerName="revoke-keys"
Jul 17 15:41:52.112835 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.112759    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="29bc33cf-ff62-4880-a82b-090125519e84" containerName="revoke-keys"
Jul 17 15:41:52.115782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.115766    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"
Jul 17 15:41:52.118390 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.118369    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:41:52.118522 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.118424    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:41:52.126557 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.126529    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"]
Jul 17 15:41:52.128092 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.128068    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:41:52.268914 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.268870    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec65e616-e118-4748-8e3c-71076bc1777b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-969af631-qs4vs\" (UID: \"ec65e616-e118-4748-8e3c-71076bc1777b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"
Jul 17 15:41:52.369366 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.369289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec65e616-e118-4748-8e3c-71076bc1777b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-969af631-qs4vs\" (UID: \"ec65e616-e118-4748-8e3c-71076bc1777b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"
Jul 17 15:41:52.369932 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.369912    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec65e616-e118-4748-8e3c-71076bc1777b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-969af631-qs4vs\" (UID: \"ec65e616-e118-4748-8e3c-71076bc1777b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"
Jul 17 15:41:52.425798 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.425759    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"
Jul 17 15:41:52.551084 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.551061    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"]
Jul 17 15:41:52.553157 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:41:52.553130    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec65e616_e118_4748_8e3c_71076bc1777b.slice/crio-5c0575082b09ff4ef0587a1b20668986f9225a1ea0955c03c46786d989a345aa WatchSource:0}: Error finding container 5c0575082b09ff4ef0587a1b20668986f9225a1ea0955c03c46786d989a345aa: Status 404 returned error can't find the container with id 5c0575082b09ff4ef0587a1b20668986f9225a1ea0955c03c46786d989a345aa
Jul 17 15:41:52.994855 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.994804    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs" event={"ID":"ec65e616-e118-4748-8e3c-71076bc1777b","Type":"ContainerStarted","Data":"f87729795907bf968ee22012a877fd3f0337d79c6e7eaceb73cc5b515c50fb61"}
Jul 17 15:41:52.995031 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:52.994873    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs" event={"ID":"ec65e616-e118-4748-8e3c-71076bc1777b","Type":"ContainerStarted","Data":"5c0575082b09ff4ef0587a1b20668986f9225a1ea0955c03c46786d989a345aa"}
Jul 17 15:41:53.013760 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:53.013668    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs" podStartSLOduration=1.013653412 podStartE2EDuration="1.013653412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:41:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:41:53.012812215 +0000 UTC m=+1964.677262320" watchObservedRunningTime="2026-07-17 15:41:53.013653412 +0000 UTC m=+1964.678103516"
Jul 17 15:41:54.000496 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:54.000460    2582 generic.go:356] "Generic (PLEG): container finished" podID="ec65e616-e118-4748-8e3c-71076bc1777b" containerID="f87729795907bf968ee22012a877fd3f0337d79c6e7eaceb73cc5b515c50fb61" exitCode=7
Jul 17 15:41:54.000951 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:54.000551    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs" event={"ID":"ec65e616-e118-4748-8e3c-71076bc1777b","Type":"ContainerDied","Data":"f87729795907bf968ee22012a877fd3f0337d79c6e7eaceb73cc5b515c50fb61"}
Jul 17 15:41:54.000951 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:54.000662    2582 scope.go:117] "RemoveContainer" containerID="f87729795907bf968ee22012a877fd3f0337d79c6e7eaceb73cc5b515c50fb61"
Jul 17 15:41:55.006826 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:55.006796    2582 generic.go:356] "Generic (PLEG): container finished" podID="ec65e616-e118-4748-8e3c-71076bc1777b" containerID="5b1d129151c167d4350fc778cc1e1e6b729258375b762b5e1468d1025dfdcab8" exitCode=7
Jul 17 15:41:55.007287 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:55.006883    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs" event={"ID":"ec65e616-e118-4748-8e3c-71076bc1777b","Type":"ContainerDied","Data":"5b1d129151c167d4350fc778cc1e1e6b729258375b762b5e1468d1025dfdcab8"}
Jul 17 15:41:55.007287 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:55.006942    2582 scope.go:117] "RemoveContainer" containerID="f87729795907bf968ee22012a877fd3f0337d79c6e7eaceb73cc5b515c50fb61"
Jul 17 15:41:55.007287 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:55.007156    2582 scope.go:117] "RemoveContainer" containerID="5b1d129151c167d4350fc778cc1e1e6b729258375b762b5e1468d1025dfdcab8"
Jul 17 15:41:55.007451 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:41:55.007379    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-969af631-qs4vs_odh-ai-gateway-infra(ec65e616-e118-4748-8e3c-71076bc1777b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs" podUID="ec65e616-e118-4748-8e3c-71076bc1777b"
Jul 17 15:41:56.015377 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:41:56.015345    2582 scope.go:117] "RemoveContainer" containerID="5b1d129151c167d4350fc778cc1e1e6b729258375b762b5e1468d1025dfdcab8"
Jul 17 15:41:56.015762 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:41:56.015569    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-969af631-qs4vs_odh-ai-gateway-infra(ec65e616-e118-4748-8e3c-71076bc1777b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs" podUID="ec65e616-e118-4748-8e3c-71076bc1777b"
Jul 17 15:42:07.899282 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:07.899202    2582 scope.go:117] "RemoveContainer" containerID="5b1d129151c167d4350fc778cc1e1e6b729258375b762b5e1468d1025dfdcab8"
Jul 17 15:42:09.070703 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:09.070671    2582 generic.go:356] "Generic (PLEG): container finished" podID="ec65e616-e118-4748-8e3c-71076bc1777b" containerID="c5ad7e4cdab91be12003e6035e5705d02b8769a7478fa2da6124731f8faafeff" exitCode=7
Jul 17 15:42:09.071155 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:09.070745    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs" event={"ID":"ec65e616-e118-4748-8e3c-71076bc1777b","Type":"ContainerDied","Data":"c5ad7e4cdab91be12003e6035e5705d02b8769a7478fa2da6124731f8faafeff"}
Jul 17 15:42:09.071155 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:09.070809    2582 scope.go:117] "RemoveContainer" containerID="5b1d129151c167d4350fc778cc1e1e6b729258375b762b5e1468d1025dfdcab8"
Jul 17 15:42:09.071155 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:09.071122    2582 scope.go:117] "RemoveContainer" containerID="c5ad7e4cdab91be12003e6035e5705d02b8769a7478fa2da6124731f8faafeff"
Jul 17 15:42:09.071367 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:42:09.071346    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-969af631-qs4vs_odh-ai-gateway-infra(ec65e616-e118-4748-8e3c-71076bc1777b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs" podUID="ec65e616-e118-4748-8e3c-71076bc1777b"
Jul 17 15:42:10.099961 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:10.099931    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"]
Jul 17 15:42:10.226257 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:10.226230    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"
Jul 17 15:42:10.310409 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:10.310370    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec65e616-e118-4748-8e3c-71076bc1777b-maas-api-service-ca\") pod \"ec65e616-e118-4748-8e3c-71076bc1777b\" (UID: \"ec65e616-e118-4748-8e3c-71076bc1777b\") "
Jul 17 15:42:10.310723 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:10.310700    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec65e616-e118-4748-8e3c-71076bc1777b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ec65e616-e118-4748-8e3c-71076bc1777b" (UID: "ec65e616-e118-4748-8e3c-71076bc1777b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:42:10.411134 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:10.411032    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec65e616-e118-4748-8e3c-71076bc1777b-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:42:11.081120 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:11.081093    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"
Jul 17 15:42:11.081120 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:11.081095    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs" event={"ID":"ec65e616-e118-4748-8e3c-71076bc1777b","Type":"ContainerDied","Data":"5c0575082b09ff4ef0587a1b20668986f9225a1ea0955c03c46786d989a345aa"}
Jul 17 15:42:11.081332 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:11.081156    2582 scope.go:117] "RemoveContainer" containerID="c5ad7e4cdab91be12003e6035e5705d02b8769a7478fa2da6124731f8faafeff"
Jul 17 15:42:11.100243 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:11.100221    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"]
Jul 17 15:42:11.104794 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:11.104774    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-969af631-qs4vs"]
Jul 17 15:42:12.171097 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:12.171060    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:12.758903 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:12.758866    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:12.904559 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:12.904528    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec65e616-e118-4748-8e3c-71076bc1777b" path="/var/lib/kubelet/pods/ec65e616-e118-4748-8e3c-71076bc1777b/volumes"
Jul 17 15:42:15.308528 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:15.308489    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:42:17.349185 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:17.349152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:23.931101 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:23.931069    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:23.991074 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:23.991044    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:28.341124 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:28.341090    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:28.647786 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:28.647734    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:29.750224 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:29.750180    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:29.836567 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:29.836512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:29.906097 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:29.906024    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:30.282177 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:30.282146    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:30.414954 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:30.414924    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:30.515732 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:30.515702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:32.308195 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:32.308158    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:42:34.136200 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.136165    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"]
Jul 17 15:42:34.136573 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.136557    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec65e616-e118-4748-8e3c-71076bc1777b" containerName="revoke-keys"
Jul 17 15:42:34.136633 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.136574    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec65e616-e118-4748-8e3c-71076bc1777b" containerName="revoke-keys"
Jul 17 15:42:34.136633 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.136587    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec65e616-e118-4748-8e3c-71076bc1777b" containerName="revoke-keys"
Jul 17 15:42:34.136633 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.136593    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec65e616-e118-4748-8e3c-71076bc1777b" containerName="revoke-keys"
Jul 17 15:42:34.136633 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.136600    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec65e616-e118-4748-8e3c-71076bc1777b" containerName="revoke-keys"
Jul 17 15:42:34.136633 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.136605    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec65e616-e118-4748-8e3c-71076bc1777b" containerName="revoke-keys"
Jul 17 15:42:34.136794 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.136664    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec65e616-e118-4748-8e3c-71076bc1777b" containerName="revoke-keys"
Jul 17 15:42:34.136794 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.136672    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="29bc33cf-ff62-4880-a82b-090125519e84" containerName="revoke-keys"
Jul 17 15:42:34.136794 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.136680    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec65e616-e118-4748-8e3c-71076bc1777b" containerName="revoke-keys"
Jul 17 15:42:34.136794 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.136686    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec65e616-e118-4748-8e3c-71076bc1777b" containerName="revoke-keys"
Jul 17 15:42:34.139922 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.139906    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"
Jul 17 15:42:34.142723 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.142700    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:42:34.142822 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.142785    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:42:34.148338 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.148312    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"]
Jul 17 15:42:34.205946 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.205921    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ac8111-1483-4ee2-9099-56f847cc69cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7726776b-c2826\" (UID: \"28ac8111-1483-4ee2-9099-56f847cc69cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"
Jul 17 15:42:34.306731 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.306693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ac8111-1483-4ee2-9099-56f847cc69cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7726776b-c2826\" (UID: \"28ac8111-1483-4ee2-9099-56f847cc69cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"
Jul 17 15:42:34.307363 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.307338    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ac8111-1483-4ee2-9099-56f847cc69cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7726776b-c2826\" (UID: \"28ac8111-1483-4ee2-9099-56f847cc69cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"
Jul 17 15:42:34.452181 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.452102    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"
Jul 17 15:42:34.583120 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:34.583084    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"]
Jul 17 15:42:34.585325 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:42:34.585286    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ac8111_1483_4ee2_9099_56f847cc69cd.slice/crio-edad171973efc86ecd151315368086956b6de99810d047705232ad2844953085 WatchSource:0}: Error finding container edad171973efc86ecd151315368086956b6de99810d047705232ad2844953085: Status 404 returned error can't find the container with id edad171973efc86ecd151315368086956b6de99810d047705232ad2844953085
Jul 17 15:42:35.185688 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:35.185653    2582 generic.go:356] "Generic (PLEG): container finished" podID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerID="15183d05dbf1d01f3d5892699cdd64f9b7e4d91a92012e79e69a6f8339ee90af" exitCode=7
Jul 17 15:42:35.186040 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:35.185717    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826" event={"ID":"28ac8111-1483-4ee2-9099-56f847cc69cd","Type":"ContainerDied","Data":"15183d05dbf1d01f3d5892699cdd64f9b7e4d91a92012e79e69a6f8339ee90af"}
Jul 17 15:42:35.186040 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:35.185769    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826" event={"ID":"28ac8111-1483-4ee2-9099-56f847cc69cd","Type":"ContainerStarted","Data":"edad171973efc86ecd151315368086956b6de99810d047705232ad2844953085"}
Jul 17 15:42:35.186040 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:35.185985    2582 scope.go:117] "RemoveContainer" containerID="15183d05dbf1d01f3d5892699cdd64f9b7e4d91a92012e79e69a6f8339ee90af"
Jul 17 15:42:36.191009 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:36.190980    2582 generic.go:356] "Generic (PLEG): container finished" podID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerID="be7b453ee5abc7e34c1f93a8f33ccc8be82e0aa66dd0107508040475c5172661" exitCode=7
Jul 17 15:42:36.191483 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:36.191032    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826" event={"ID":"28ac8111-1483-4ee2-9099-56f847cc69cd","Type":"ContainerDied","Data":"be7b453ee5abc7e34c1f93a8f33ccc8be82e0aa66dd0107508040475c5172661"}
Jul 17 15:42:36.191483 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:36.191080    2582 scope.go:117] "RemoveContainer" containerID="15183d05dbf1d01f3d5892699cdd64f9b7e4d91a92012e79e69a6f8339ee90af"
Jul 17 15:42:36.191483 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:36.191262    2582 scope.go:117] "RemoveContainer" containerID="be7b453ee5abc7e34c1f93a8f33ccc8be82e0aa66dd0107508040475c5172661"
Jul 17 15:42:36.191639 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:42:36.191517    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7726776b-c2826_odh-ai-gateway-infra(28ac8111-1483-4ee2-9099-56f847cc69cd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd"
Jul 17 15:42:37.197414 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:37.197386    2582 scope.go:117] "RemoveContainer" containerID="be7b453ee5abc7e34c1f93a8f33ccc8be82e0aa66dd0107508040475c5172661"
Jul 17 15:42:37.197766 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:42:37.197587    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7726776b-c2826_odh-ai-gateway-infra(28ac8111-1483-4ee2-9099-56f847cc69cd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd"
Jul 17 15:42:50.899246 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:50.899214    2582 scope.go:117] "RemoveContainer" containerID="be7b453ee5abc7e34c1f93a8f33ccc8be82e0aa66dd0107508040475c5172661"
Jul 17 15:42:51.257842 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:51.257809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826" event={"ID":"28ac8111-1483-4ee2-9099-56f847cc69cd","Type":"ContainerStarted","Data":"8247cdb0536daba5ce6b76d49bb36ab30444dad4da6cdeeefbec752ce9d135f2"}
Jul 17 15:42:51.277424 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:51.277365    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826" podStartSLOduration=17.277346173 podStartE2EDuration="17.277346173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:42:51.276905909 +0000 UTC m=+2022.941356012" watchObservedRunningTime="2026-07-17 15:42:51.277346173 +0000 UTC m=+2022.941796278"
Jul 17 15:42:52.263370 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:52.263334    2582 generic.go:356] "Generic (PLEG): container finished" podID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerID="8247cdb0536daba5ce6b76d49bb36ab30444dad4da6cdeeefbec752ce9d135f2" exitCode=7
Jul 17 15:42:52.263757 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:52.263408    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826" event={"ID":"28ac8111-1483-4ee2-9099-56f847cc69cd","Type":"ContainerDied","Data":"8247cdb0536daba5ce6b76d49bb36ab30444dad4da6cdeeefbec752ce9d135f2"}
Jul 17 15:42:52.263757 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:52.263468    2582 scope.go:117] "RemoveContainer" containerID="be7b453ee5abc7e34c1f93a8f33ccc8be82e0aa66dd0107508040475c5172661"
Jul 17 15:42:52.263757 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:52.263699    2582 scope.go:117] "RemoveContainer" containerID="8247cdb0536daba5ce6b76d49bb36ab30444dad4da6cdeeefbec752ce9d135f2"
Jul 17 15:42:52.263918 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:42:52.263901    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7726776b-c2826_odh-ai-gateway-infra(28ac8111-1483-4ee2-9099-56f847cc69cd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd"
Jul 17 15:42:52.292423 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:52.287934    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"]
Jul 17 15:42:53.390910 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:53.390887    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"
Jul 17 15:42:53.561458 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:53.561381    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ac8111-1483-4ee2-9099-56f847cc69cd-maas-api-service-ca\") pod \"28ac8111-1483-4ee2-9099-56f847cc69cd\" (UID: \"28ac8111-1483-4ee2-9099-56f847cc69cd\") "
Jul 17 15:42:53.561751 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:53.561725    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28ac8111-1483-4ee2-9099-56f847cc69cd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "28ac8111-1483-4ee2-9099-56f847cc69cd" (UID: "28ac8111-1483-4ee2-9099-56f847cc69cd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:42:53.662017 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:53.661984    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28ac8111-1483-4ee2-9099-56f847cc69cd-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:42:54.273564 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:54.273527    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826" event={"ID":"28ac8111-1483-4ee2-9099-56f847cc69cd","Type":"ContainerDied","Data":"edad171973efc86ecd151315368086956b6de99810d047705232ad2844953085"}
Jul 17 15:42:54.273564 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:54.273562    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"
Jul 17 15:42:54.273952 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:54.273599    2582 scope.go:117] "RemoveContainer" containerID="8247cdb0536daba5ce6b76d49bb36ab30444dad4da6cdeeefbec752ce9d135f2"
Jul 17 15:42:54.296235 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:54.296211    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"]
Jul 17 15:42:54.302801 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:54.302777    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-c2826"]
Jul 17 15:42:54.756229 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:54.756188    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:54.813926 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:54.813894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:42:54.904247 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:54.904212    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd" path="/var/lib/kubelet/pods/28ac8111-1483-4ee2-9099-56f847cc69cd/volumes"
Jul 17 15:42:58.650375 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:42:58.650349    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:34.197910 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.197817    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"]
Jul 17 15:43:34.198364 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.198156    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerName="revoke-keys"
Jul 17 15:43:34.198364 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.198171    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerName="revoke-keys"
Jul 17 15:43:34.198364 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.198197    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerName="revoke-keys"
Jul 17 15:43:34.198364 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.198202    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerName="revoke-keys"
Jul 17 15:43:34.198364 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.198266    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerName="revoke-keys"
Jul 17 15:43:34.198364 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.198275    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerName="revoke-keys"
Jul 17 15:43:34.201543 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.201525    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"
Jul 17 15:43:34.204062 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.204045    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:43:34.204167 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.204073    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:43:34.209206 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.209187    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"]
Jul 17 15:43:34.285821 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.285787    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6181e937-3dcd-4447-bfe5-87668d79060a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7726776b-tqjss\" (UID: \"6181e937-3dcd-4447-bfe5-87668d79060a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"
Jul 17 15:43:34.387232 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.387199    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6181e937-3dcd-4447-bfe5-87668d79060a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7726776b-tqjss\" (UID: \"6181e937-3dcd-4447-bfe5-87668d79060a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"
Jul 17 15:43:34.387881 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.387834    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6181e937-3dcd-4447-bfe5-87668d79060a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7726776b-tqjss\" (UID: \"6181e937-3dcd-4447-bfe5-87668d79060a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"
Jul 17 15:43:34.513402 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.513363    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"
Jul 17 15:43:34.842317 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:34.842293    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"]
Jul 17 15:43:34.844727 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:43:34.844698    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6181e937_3dcd_4447_bfe5_87668d79060a.slice/crio-ac132588aa5f5b0e03c2b9c15f59f43686790adf7f2680751ae8b29a65b94b0a WatchSource:0}: Error finding container ac132588aa5f5b0e03c2b9c15f59f43686790adf7f2680751ae8b29a65b94b0a: Status 404 returned error can't find the container with id ac132588aa5f5b0e03c2b9c15f59f43686790adf7f2680751ae8b29a65b94b0a
Jul 17 15:43:35.447649 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:35.447563    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss" event={"ID":"6181e937-3dcd-4447-bfe5-87668d79060a","Type":"ContainerStarted","Data":"003ebd0a4a15ec0ddbe91612f55bac1741ba6c59a44f12e919a5d49d91774caa"}
Jul 17 15:43:35.447649 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:35.447615    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss" event={"ID":"6181e937-3dcd-4447-bfe5-87668d79060a","Type":"ContainerStarted","Data":"ac132588aa5f5b0e03c2b9c15f59f43686790adf7f2680751ae8b29a65b94b0a"}
Jul 17 15:43:35.465643 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:35.465603    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss" podStartSLOduration=1.465589274 podStartE2EDuration="1.465589274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:43:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:43:35.464478314 +0000 UTC m=+2067.128928430" watchObservedRunningTime="2026-07-17 15:43:35.465589274 +0000 UTC m=+2067.130039378"
Jul 17 15:43:36.452907 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:36.452869    2582 generic.go:356] "Generic (PLEG): container finished" podID="6181e937-3dcd-4447-bfe5-87668d79060a" containerID="003ebd0a4a15ec0ddbe91612f55bac1741ba6c59a44f12e919a5d49d91774caa" exitCode=7
Jul 17 15:43:36.453294 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:36.452944    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss" event={"ID":"6181e937-3dcd-4447-bfe5-87668d79060a","Type":"ContainerDied","Data":"003ebd0a4a15ec0ddbe91612f55bac1741ba6c59a44f12e919a5d49d91774caa"}
Jul 17 15:43:36.453294 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:36.453168    2582 scope.go:117] "RemoveContainer" containerID="003ebd0a4a15ec0ddbe91612f55bac1741ba6c59a44f12e919a5d49d91774caa"
Jul 17 15:43:37.461595 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:37.461502    2582 generic.go:356] "Generic (PLEG): container finished" podID="6181e937-3dcd-4447-bfe5-87668d79060a" containerID="f5f992ab61fe3b1647c8408da060de1f9ac974ea9422f4f5763f6c8852a7cc1f" exitCode=7
Jul 17 15:43:37.461595 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:37.461553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss" event={"ID":"6181e937-3dcd-4447-bfe5-87668d79060a","Type":"ContainerDied","Data":"f5f992ab61fe3b1647c8408da060de1f9ac974ea9422f4f5763f6c8852a7cc1f"}
Jul 17 15:43:37.461595 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:37.461598    2582 scope.go:117] "RemoveContainer" containerID="003ebd0a4a15ec0ddbe91612f55bac1741ba6c59a44f12e919a5d49d91774caa"
Jul 17 15:43:37.462167 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:37.461812    2582 scope.go:117] "RemoveContainer" containerID="f5f992ab61fe3b1647c8408da060de1f9ac974ea9422f4f5763f6c8852a7cc1f"
Jul 17 15:43:37.462167 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:43:37.462063    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7726776b-tqjss_odh-ai-gateway-infra(6181e937-3dcd-4447-bfe5-87668d79060a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss" podUID="6181e937-3dcd-4447-bfe5-87668d79060a"
Jul 17 15:43:38.467544 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:38.467518    2582 scope.go:117] "RemoveContainer" containerID="f5f992ab61fe3b1647c8408da060de1f9ac974ea9422f4f5763f6c8852a7cc1f"
Jul 17 15:43:38.467944 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:43:38.467673    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7726776b-tqjss_odh-ai-gateway-infra(6181e937-3dcd-4447-bfe5-87668d79060a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss" podUID="6181e937-3dcd-4447-bfe5-87668d79060a"
Jul 17 15:43:51.899048 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:51.899017    2582 scope.go:117] "RemoveContainer" containerID="f5f992ab61fe3b1647c8408da060de1f9ac974ea9422f4f5763f6c8852a7cc1f"
Jul 17 15:43:52.390840 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:52.390807    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:52.453308 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:52.453271    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:43:52.526194 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:52.526169    2582 generic.go:356] "Generic (PLEG): container finished" podID="6181e937-3dcd-4447-bfe5-87668d79060a" containerID="0a77477021e2bf374a5ebb141c9293ee3521d4c9d31899926153302a1f4f34f9" exitCode=7
Jul 17 15:43:52.526316 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:52.526217    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss" event={"ID":"6181e937-3dcd-4447-bfe5-87668d79060a","Type":"ContainerDied","Data":"0a77477021e2bf374a5ebb141c9293ee3521d4c9d31899926153302a1f4f34f9"}
Jul 17 15:43:52.526316 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:52.526265    2582 scope.go:117] "RemoveContainer" containerID="f5f992ab61fe3b1647c8408da060de1f9ac974ea9422f4f5763f6c8852a7cc1f"
Jul 17 15:43:52.526573 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:52.526554    2582 scope.go:117] "RemoveContainer" containerID="0a77477021e2bf374a5ebb141c9293ee3521d4c9d31899926153302a1f4f34f9"
Jul 17 15:43:52.526760 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:43:52.526741    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7726776b-tqjss_odh-ai-gateway-infra(6181e937-3dcd-4447-bfe5-87668d79060a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss" podUID="6181e937-3dcd-4447-bfe5-87668d79060a"
Jul 17 15:43:53.556554 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:53.556523    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"]
Jul 17 15:43:53.685750 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:53.685726    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"
Jul 17 15:43:53.849620 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:53.849527    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6181e937-3dcd-4447-bfe5-87668d79060a-maas-api-service-ca\") pod \"6181e937-3dcd-4447-bfe5-87668d79060a\" (UID: \"6181e937-3dcd-4447-bfe5-87668d79060a\") "
Jul 17 15:43:53.849904 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:53.849882    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6181e937-3dcd-4447-bfe5-87668d79060a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6181e937-3dcd-4447-bfe5-87668d79060a" (UID: "6181e937-3dcd-4447-bfe5-87668d79060a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:43:53.950352 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:53.950321    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6181e937-3dcd-4447-bfe5-87668d79060a-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:43:54.536869 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:54.536819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss" event={"ID":"6181e937-3dcd-4447-bfe5-87668d79060a","Type":"ContainerDied","Data":"ac132588aa5f5b0e03c2b9c15f59f43686790adf7f2680751ae8b29a65b94b0a"}
Jul 17 15:43:54.536869 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:54.536858    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"
Jul 17 15:43:54.537127 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:54.536898    2582 scope.go:117] "RemoveContainer" containerID="0a77477021e2bf374a5ebb141c9293ee3521d4c9d31899926153302a1f4f34f9"
Jul 17 15:43:54.559131 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:54.559103    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"]
Jul 17 15:43:54.561862 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:54.561830    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-tqjss"]
Jul 17 15:43:54.904123 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:43:54.904043    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6181e937-3dcd-4447-bfe5-87668d79060a" path="/var/lib/kubelet/pods/6181e937-3dcd-4447-bfe5-87668d79060a/volumes"
Jul 17 15:44:09.341249 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:09.341214    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:44:09.407637 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:09.407604    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:44:34.257166 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257129    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"]
Jul 17 15:44:34.257536 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257435    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6181e937-3dcd-4447-bfe5-87668d79060a" containerName="revoke-keys"
Jul 17 15:44:34.257536 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257445    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6181e937-3dcd-4447-bfe5-87668d79060a" containerName="revoke-keys"
Jul 17 15:44:34.257536 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257456    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6181e937-3dcd-4447-bfe5-87668d79060a" containerName="revoke-keys"
Jul 17 15:44:34.257536 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257461    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6181e937-3dcd-4447-bfe5-87668d79060a" containerName="revoke-keys"
Jul 17 15:44:34.257536 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257468    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6181e937-3dcd-4447-bfe5-87668d79060a" containerName="revoke-keys"
Jul 17 15:44:34.257536 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257474    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6181e937-3dcd-4447-bfe5-87668d79060a" containerName="revoke-keys"
Jul 17 15:44:34.257536 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257490    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerName="revoke-keys"
Jul 17 15:44:34.257536 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257495    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerName="revoke-keys"
Jul 17 15:44:34.257536 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257541    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6181e937-3dcd-4447-bfe5-87668d79060a" containerName="revoke-keys"
Jul 17 15:44:34.257805 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257547    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6181e937-3dcd-4447-bfe5-87668d79060a" containerName="revoke-keys"
Jul 17 15:44:34.257805 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.257555    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="28ac8111-1483-4ee2-9099-56f847cc69cd" containerName="revoke-keys"
Jul 17 15:44:34.260192 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.260178    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"
Jul 17 15:44:34.262711 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.262690    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:44:34.262828 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.262687    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:44:34.267999 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.267979    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"]
Jul 17 15:44:34.348299 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.348267    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd42036d-f10e-4f9f-87f9-246c17bb7210-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7726776b-hxdn5\" (UID: \"dd42036d-f10e-4f9f-87f9-246c17bb7210\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"
Jul 17 15:44:34.449671 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.449632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd42036d-f10e-4f9f-87f9-246c17bb7210-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7726776b-hxdn5\" (UID: \"dd42036d-f10e-4f9f-87f9-246c17bb7210\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"
Jul 17 15:44:34.450247 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.450226    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd42036d-f10e-4f9f-87f9-246c17bb7210-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7726776b-hxdn5\" (UID: \"dd42036d-f10e-4f9f-87f9-246c17bb7210\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"
Jul 17 15:44:34.571481 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.571391    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"
Jul 17 15:44:34.908673 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:44:34.908640    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd42036d_f10e_4f9f_87f9_246c17bb7210.slice/crio-ff9c50f48354290aec9ca3794824375ae5ec66c4816e6bdde5bc667fc21f590f WatchSource:0}: Error finding container ff9c50f48354290aec9ca3794824375ae5ec66c4816e6bdde5bc667fc21f590f: Status 404 returned error can't find the container with id ff9c50f48354290aec9ca3794824375ae5ec66c4816e6bdde5bc667fc21f590f
Jul 17 15:44:34.909531 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:34.909505    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"]
Jul 17 15:44:35.713470 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:35.713387    2582 generic.go:356] "Generic (PLEG): container finished" podID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerID="f42ee156c3a2a642b161bcc12a756b45c56cdefda68bb9c952407be7dd004641" exitCode=7
Jul 17 15:44:35.713470 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:35.713441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5" event={"ID":"dd42036d-f10e-4f9f-87f9-246c17bb7210","Type":"ContainerDied","Data":"f42ee156c3a2a642b161bcc12a756b45c56cdefda68bb9c952407be7dd004641"}
Jul 17 15:44:35.713872 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:35.713481    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5" event={"ID":"dd42036d-f10e-4f9f-87f9-246c17bb7210","Type":"ContainerStarted","Data":"ff9c50f48354290aec9ca3794824375ae5ec66c4816e6bdde5bc667fc21f590f"}
Jul 17 15:44:35.713872 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:35.713633    2582 scope.go:117] "RemoveContainer" containerID="f42ee156c3a2a642b161bcc12a756b45c56cdefda68bb9c952407be7dd004641"
Jul 17 15:44:36.719725 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:36.719637    2582 generic.go:356] "Generic (PLEG): container finished" podID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerID="76f1ef576d6816fa10247907ecea93d171c334653ac851d86dcf325ef1e58002" exitCode=7
Jul 17 15:44:36.719725 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:36.719686    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5" event={"ID":"dd42036d-f10e-4f9f-87f9-246c17bb7210","Type":"ContainerDied","Data":"76f1ef576d6816fa10247907ecea93d171c334653ac851d86dcf325ef1e58002"}
Jul 17 15:44:36.720196 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:36.719736    2582 scope.go:117] "RemoveContainer" containerID="f42ee156c3a2a642b161bcc12a756b45c56cdefda68bb9c952407be7dd004641"
Jul 17 15:44:36.720196 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:36.719898    2582 scope.go:117] "RemoveContainer" containerID="76f1ef576d6816fa10247907ecea93d171c334653ac851d86dcf325ef1e58002"
Jul 17 15:44:36.720196 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:44:36.720109    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7726776b-hxdn5_odh-ai-gateway-infra(dd42036d-f10e-4f9f-87f9-246c17bb7210)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210"
Jul 17 15:44:37.727118 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:37.727092    2582 scope.go:117] "RemoveContainer" containerID="76f1ef576d6816fa10247907ecea93d171c334653ac851d86dcf325ef1e58002"
Jul 17 15:44:37.727492 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:44:37.727265    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7726776b-hxdn5_odh-ai-gateway-infra(dd42036d-f10e-4f9f-87f9-246c17bb7210)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210"
Jul 17 15:44:42.368209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:42.368172    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:44:42.474141 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:42.474106    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:44:48.902178 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:48.902148    2582 scope.go:117] "RemoveContainer" containerID="76f1ef576d6816fa10247907ecea93d171c334653ac851d86dcf325ef1e58002"
Jul 17 15:44:49.779005 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:49.778971    2582 generic.go:356] "Generic (PLEG): container finished" podID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerID="d63aeb3602b8babc931c293da6aa406097117f66c98b0c0c6203dddbd03d1c8a" exitCode=7
Jul 17 15:44:49.779188 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:49.779040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5" event={"ID":"dd42036d-f10e-4f9f-87f9-246c17bb7210","Type":"ContainerDied","Data":"d63aeb3602b8babc931c293da6aa406097117f66c98b0c0c6203dddbd03d1c8a"}
Jul 17 15:44:49.779188 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:49.779100    2582 scope.go:117] "RemoveContainer" containerID="76f1ef576d6816fa10247907ecea93d171c334653ac851d86dcf325ef1e58002"
Jul 17 15:44:49.779412 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:49.779397    2582 scope.go:117] "RemoveContainer" containerID="d63aeb3602b8babc931c293da6aa406097117f66c98b0c0c6203dddbd03d1c8a"
Jul 17 15:44:49.779611 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:44:49.779591    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7726776b-hxdn5_odh-ai-gateway-infra(dd42036d-f10e-4f9f-87f9-246c17bb7210)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210"
Jul 17 15:44:50.815904 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:50.815868    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"]
Jul 17 15:44:50.945687 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:50.945666    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"
Jul 17 15:44:51.086216 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:51.086128    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd42036d-f10e-4f9f-87f9-246c17bb7210-maas-api-service-ca\") pod \"dd42036d-f10e-4f9f-87f9-246c17bb7210\" (UID: \"dd42036d-f10e-4f9f-87f9-246c17bb7210\") "
Jul 17 15:44:51.086487 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:51.086467    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd42036d-f10e-4f9f-87f9-246c17bb7210-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dd42036d-f10e-4f9f-87f9-246c17bb7210" (UID: "dd42036d-f10e-4f9f-87f9-246c17bb7210"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:44:51.186753 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:51.186720    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd42036d-f10e-4f9f-87f9-246c17bb7210-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:44:51.790459 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:51.790430    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"
Jul 17 15:44:51.790634 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:51.790433    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5" event={"ID":"dd42036d-f10e-4f9f-87f9-246c17bb7210","Type":"ContainerDied","Data":"ff9c50f48354290aec9ca3794824375ae5ec66c4816e6bdde5bc667fc21f590f"}
Jul 17 15:44:51.790634 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:51.790564    2582 scope.go:117] "RemoveContainer" containerID="d63aeb3602b8babc931c293da6aa406097117f66c98b0c0c6203dddbd03d1c8a"
Jul 17 15:44:51.815834 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:51.815809    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"]
Jul 17 15:44:51.820928 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:51.820900    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7726776b-hxdn5"]
Jul 17 15:44:52.904897 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:52.904838    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210" path="/var/lib/kubelet/pods/dd42036d-f10e-4f9f-87f9-246c17bb7210/volumes"
Jul 17 15:44:53.900772 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:53.900738    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:44:54.000152 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:54.000122    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:44:54.316544 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:54.316491    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:44:54.713657 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:54.713578    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:44:57.302125 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:57.302087    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:44:59.448147 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:44:59.448111    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:00.135917 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.135883    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2"]
Jul 17 15:45:00.136236 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.136222    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerName="revoke-keys"
Jul 17 15:45:00.136280 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.136238    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerName="revoke-keys"
Jul 17 15:45:00.136280 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.136254    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerName="revoke-keys"
Jul 17 15:45:00.136280 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.136259    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerName="revoke-keys"
Jul 17 15:45:00.136368 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.136314    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6181e937-3dcd-4447-bfe5-87668d79060a" containerName="revoke-keys"
Jul 17 15:45:00.136368 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.136323    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerName="revoke-keys"
Jul 17 15:45:00.136368 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.136331    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerName="revoke-keys"
Jul 17 15:45:00.140768 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.140752    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2"
Jul 17 15:45:00.143374 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.143352    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:45:00.146538 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.146512    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2"]
Jul 17 15:45:00.151361 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.151339    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2"
Jul 17 15:45:00.281716 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.281665    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2"]
Jul 17 15:45:00.287283 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:45:00.287257    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b2ddea8_bbf1_4ec9_82af_ddf01b967705.slice/crio-b668531021da9f5433c92e305b97f9c54c663e4cb774c6dfbe08a4aaee84c513 WatchSource:0}: Error finding container b668531021da9f5433c92e305b97f9c54c663e4cb774c6dfbe08a4aaee84c513: Status 404 returned error can't find the container with id b668531021da9f5433c92e305b97f9c54c663e4cb774c6dfbe08a4aaee84c513
Jul 17 15:45:00.831350 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.831315    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2" event={"ID":"7b2ddea8-bbf1-4ec9-82af-ddf01b967705","Type":"ContainerStarted","Data":"ef87af40e878a624348fa60a5c4816aff45f4253dd22d246a7baae9152961996"}
Jul 17 15:45:00.831718 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.831365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2" event={"ID":"7b2ddea8-bbf1-4ec9-82af-ddf01b967705","Type":"ContainerStarted","Data":"b668531021da9f5433c92e305b97f9c54c663e4cb774c6dfbe08a4aaee84c513"}
Jul 17 15:45:00.855466 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:00.855412    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2" podStartSLOduration=0.85539902 podStartE2EDuration="855.39902ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:45:00.853487563 +0000 UTC m=+2152.517937668" watchObservedRunningTime="2026-07-17 15:45:00.85539902 +0000 UTC m=+2152.519849123"
Jul 17 15:45:01.838003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:01.837964    2582 generic.go:356] "Generic (PLEG): container finished" podID="7b2ddea8-bbf1-4ec9-82af-ddf01b967705" containerID="ef87af40e878a624348fa60a5c4816aff45f4253dd22d246a7baae9152961996" exitCode=0
Jul 17 15:45:01.838398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:01.838027    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2" event={"ID":"7b2ddea8-bbf1-4ec9-82af-ddf01b967705","Type":"ContainerDied","Data":"ef87af40e878a624348fa60a5c4816aff45f4253dd22d246a7baae9152961996"}
Jul 17 15:45:02.968256 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:02.968232    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2"
Jul 17 15:45:03.848424 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:03.848388    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2" event={"ID":"7b2ddea8-bbf1-4ec9-82af-ddf01b967705","Type":"ContainerDied","Data":"b668531021da9f5433c92e305b97f9c54c663e4cb774c6dfbe08a4aaee84c513"}
Jul 17 15:45:03.848424 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:03.848409    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738385-7xjm2"
Jul 17 15:45:03.848644 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:03.848443    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b668531021da9f5433c92e305b97f9c54c663e4cb774c6dfbe08a4aaee84c513"
Jul 17 15:45:05.729826 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:05.729791    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:05.788194 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:05.788138    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:09.643548 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:09.643510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:10.246485 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:10.246452    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:10.346582 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:10.346547    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:10.445759 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:10.445723    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:11.844814 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:11.844778    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:18.218332 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:18.218290    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:18.282690 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:18.282653    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:18.367535 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:18.367498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:18.467927 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:18.467892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:18.565858 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:18.565814    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:18.897439 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:18.897364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:25.971194 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:25.971167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:44.829462 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:44.829423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:51.117522 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:51.117486    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:51.218215 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:51.218179    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:45:51.319702 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:45:51.319667    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:07.192753 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:07.192711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:14.082981 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:14.082948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:14.184972 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:14.184887    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:14.316712 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:14.316678    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:24.881332 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:24.881295    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:25.674539 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:25.674507    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:29.042764 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:29.042731    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:32.577319 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:32.577233    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:32.679994 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:32.679961    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:32.780603 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:32.780571    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:32.879528 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:32.879444    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:33.688121 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:33.688087    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:33.786400 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:33.786369    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:33.894048 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:33.894016    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:34.941461 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:34.941427    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:46:35.631615 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:35.631579    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:42.230288 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:42.230256    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:46:43.043291 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:43.043255    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:43.116020 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:43.115989    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:43.738224 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:43.738189    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:49.941229 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:49.941195    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:46:51.536580 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:51.536545    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:51.659104 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:51.659070    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:51.924965 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:51.924877    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:52.258375 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:52.258347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:52.350390 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:52.350361    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:55.868569 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:55.868531    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:46:57.337001 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:46:57.336962    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:00.009650 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:00.009612    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:47:00.340454 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:00.340380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:00.964807 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:00.964774    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:01.055514 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:01.055485    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:01.397422 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:01.397387    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:08.066744 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.066709    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:08.170134 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.170099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:08.420212 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.420132    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm"]
Jul 17 15:47:08.420520 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.420503    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b2ddea8-bbf1-4ec9-82af-ddf01b967705" containerName="cleanup"
Jul 17 15:47:08.420601 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.420523    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b2ddea8-bbf1-4ec9-82af-ddf01b967705" containerName="cleanup"
Jul 17 15:47:08.420601 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.420543    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerName="revoke-keys"
Jul 17 15:47:08.420601 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.420552    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerName="revoke-keys"
Jul 17 15:47:08.420792 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.420630    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b2ddea8-bbf1-4ec9-82af-ddf01b967705" containerName="cleanup"
Jul 17 15:47:08.420792 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.420643    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd42036d-f10e-4f9f-87f9-246c17bb7210" containerName="revoke-keys"
Jul 17 15:47:08.423660 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.423639    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm"
Jul 17 15:47:08.427989 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.427972    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:47:08.428383 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.428364    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:47:08.435603 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.435583    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm"]
Jul 17 15:47:08.521736 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.521710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e92e8924-3513-4a46-b14a-40aa86a8ba93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm\" (UID: \"e92e8924-3513-4a46-b14a-40aa86a8ba93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm"
Jul 17 15:47:08.622453 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.622427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e92e8924-3513-4a46-b14a-40aa86a8ba93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm\" (UID: \"e92e8924-3513-4a46-b14a-40aa86a8ba93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm"
Jul 17 15:47:08.623071 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.623049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e92e8924-3513-4a46-b14a-40aa86a8ba93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm\" (UID: \"e92e8924-3513-4a46-b14a-40aa86a8ba93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm"
Jul 17 15:47:08.736124 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.736046    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:47:08.743717 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:08.743696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm"
Jul 17 15:47:09.077834 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:09.077749    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm"]
Jul 17 15:47:09.080220 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:47:09.080194    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92e8924_3513_4a46_b14a_40aa86a8ba93.slice/crio-69e96214e2e0376b81d5b7d5315418ef5785fe6a16abeab96c22656f94aa96a6 WatchSource:0}: Error finding container 69e96214e2e0376b81d5b7d5315418ef5785fe6a16abeab96c22656f94aa96a6: Status 404 returned error can't find the container with id 69e96214e2e0376b81d5b7d5315418ef5785fe6a16abeab96c22656f94aa96a6
Jul 17 15:47:09.403727 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:09.403693    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm" event={"ID":"e92e8924-3513-4a46-b14a-40aa86a8ba93","Type":"ContainerStarted","Data":"dc99fb1c36e8baad9f60e4629fb9ed3b83c3ff5b41f9678e6e83273a1f5d21df"}
Jul 17 15:47:09.403893 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:09.403753    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm" event={"ID":"e92e8924-3513-4a46-b14a-40aa86a8ba93","Type":"ContainerStarted","Data":"69e96214e2e0376b81d5b7d5315418ef5785fe6a16abeab96c22656f94aa96a6"}
Jul 17 15:47:09.421379 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:09.421341    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm" podStartSLOduration=1.421325892 podStartE2EDuration="1.421325892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:47:09.420629187 +0000 UTC m=+2281.085079290" watchObservedRunningTime="2026-07-17 15:47:09.421325892 +0000 UTC m=+2281.085776037"
Jul 17 15:47:10.409475 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:10.409439    2582 generic.go:356] "Generic (PLEG): container finished" podID="e92e8924-3513-4a46-b14a-40aa86a8ba93" containerID="dc99fb1c36e8baad9f60e4629fb9ed3b83c3ff5b41f9678e6e83273a1f5d21df" exitCode=0
Jul 17 15:47:10.409872 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:10.409524    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm" event={"ID":"e92e8924-3513-4a46-b14a-40aa86a8ba93","Type":"ContainerDied","Data":"dc99fb1c36e8baad9f60e4629fb9ed3b83c3ff5b41f9678e6e83273a1f5d21df"}
Jul 17 15:47:11.539413 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:11.539389    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm"
Jul 17 15:47:11.647923 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:11.647890    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e92e8924-3513-4a46-b14a-40aa86a8ba93-maas-api-service-ca\") pod \"e92e8924-3513-4a46-b14a-40aa86a8ba93\" (UID: \"e92e8924-3513-4a46-b14a-40aa86a8ba93\") "
Jul 17 15:47:11.648238 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:11.648217    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92e8924-3513-4a46-b14a-40aa86a8ba93-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e92e8924-3513-4a46-b14a-40aa86a8ba93" (UID: "e92e8924-3513-4a46-b14a-40aa86a8ba93"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:47:11.749181 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:11.749152    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e92e8924-3513-4a46-b14a-40aa86a8ba93-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:47:12.418791 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:12.418758    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm"
Jul 17 15:47:12.418791 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:12.418770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm" event={"ID":"e92e8924-3513-4a46-b14a-40aa86a8ba93","Type":"ContainerDied","Data":"69e96214e2e0376b81d5b7d5315418ef5785fe6a16abeab96c22656f94aa96a6"}
Jul 17 15:47:12.419027 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:12.418864    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69e96214e2e0376b81d5b7d5315418ef5785fe6a16abeab96c22656f94aa96a6"
Jul 17 15:47:18.971603 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:18.971569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:22.006782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:22.006745    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:47:23.519205 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:23.519174    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:30.075692 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:30.075655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:30.175661 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:30.175630    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:34.246376 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:34.246348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:34.509078 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:34.508986    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:34.628020 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:34.627991    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:34.736031 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:34.735988    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:34.877238 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:34.877130    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:39.651834 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:39.651793    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:39.713565 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:39.713534    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:41.302145 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:41.302110    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:41.404745 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:41.404711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:41.502306 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:41.502264    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:51.666647 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:51.666608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:51.760398 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:51.760363    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:55.118760 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:55.118722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:55.450063 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:55.449977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:55.707921 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:55.707821    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:57.996156 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:57.996107    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:58.103656 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:58.103624    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:58.246002 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:58.245972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:58.474065 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:58.473975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:58.805062 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:58.805032    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:47:58.908142 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:47:58.908108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:48:02.485473 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:02.485371    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:48:05.804294 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:05.804260    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:48:06.040566 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:06.040534    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:48:14.905171 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:14.905140    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:48:22.821278 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:22.821235    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:48:25.262606 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.262565    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z"]
Jul 17 15:48:25.263091 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.263046    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92e8924-3513-4a46-b14a-40aa86a8ba93" containerName="revoke-keys"
Jul 17 15:48:25.263091 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.263064    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92e8924-3513-4a46-b14a-40aa86a8ba93" containerName="revoke-keys"
Jul 17 15:48:25.263209 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.263145    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92e8924-3513-4a46-b14a-40aa86a8ba93" containerName="revoke-keys"
Jul 17 15:48:25.266154 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.266134    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z"
Jul 17 15:48:25.269336 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.269311    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:48:25.269447 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.269337    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:48:25.285657 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.285635    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z"]
Jul 17 15:48:25.354722 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.354688    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79c37883-87ce-4e90-8f20-11404dec0dcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z\" (UID: \"79c37883-87ce-4e90-8f20-11404dec0dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z"
Jul 17 15:48:25.455343 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.455313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79c37883-87ce-4e90-8f20-11404dec0dcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z\" (UID: \"79c37883-87ce-4e90-8f20-11404dec0dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z"
Jul 17 15:48:25.455938 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.455920    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79c37883-87ce-4e90-8f20-11404dec0dcf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z\" (UID: \"79c37883-87ce-4e90-8f20-11404dec0dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z"
Jul 17 15:48:25.576264 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.576186    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z"
Jul 17 15:48:25.701733 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.701710    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z"]
Jul 17 15:48:25.703553 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:48:25.703525    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c37883_87ce_4e90_8f20_11404dec0dcf.slice/crio-93c60df937dc86571a7cbd50804c50af793311fc67866b7d140cf27c4c349be0 WatchSource:0}: Error finding container 93c60df937dc86571a7cbd50804c50af793311fc67866b7d140cf27c4c349be0: Status 404 returned error can't find the container with id 93c60df937dc86571a7cbd50804c50af793311fc67866b7d140cf27c4c349be0
Jul 17 15:48:25.737978 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:25.737953    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z" event={"ID":"79c37883-87ce-4e90-8f20-11404dec0dcf","Type":"ContainerStarted","Data":"93c60df937dc86571a7cbd50804c50af793311fc67866b7d140cf27c4c349be0"}
Jul 17 15:48:26.743884 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:26.743807    2582 generic.go:356] "Generic (PLEG): container finished" podID="79c37883-87ce-4e90-8f20-11404dec0dcf" containerID="387f87b5d01beae04a7b3946d850e56340176736dd3a37dd8477fd85481241fd" exitCode=0
Jul 17 15:48:26.744256 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:26.743895    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z" event={"ID":"79c37883-87ce-4e90-8f20-11404dec0dcf","Type":"ContainerDied","Data":"387f87b5d01beae04a7b3946d850e56340176736dd3a37dd8477fd85481241fd"}
Jul 17 15:48:27.873608 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:27.873583    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z"
Jul 17 15:48:27.974824 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:27.974791    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79c37883-87ce-4e90-8f20-11404dec0dcf-maas-api-service-ca\") pod \"79c37883-87ce-4e90-8f20-11404dec0dcf\" (UID: \"79c37883-87ce-4e90-8f20-11404dec0dcf\") "
Jul 17 15:48:27.975165 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:27.975140    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c37883-87ce-4e90-8f20-11404dec0dcf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79c37883-87ce-4e90-8f20-11404dec0dcf" (UID: "79c37883-87ce-4e90-8f20-11404dec0dcf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:48:28.076144 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:28.076067    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79c37883-87ce-4e90-8f20-11404dec0dcf-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:48:28.755725 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:28.755691    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z"
Jul 17 15:48:28.755925 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:28.755743    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z" event={"ID":"79c37883-87ce-4e90-8f20-11404dec0dcf","Type":"ContainerDied","Data":"93c60df937dc86571a7cbd50804c50af793311fc67866b7d140cf27c4c349be0"}
Jul 17 15:48:28.755925 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:28.755788    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93c60df937dc86571a7cbd50804c50af793311fc67866b7d140cf27c4c349be0"
Jul 17 15:48:35.886649 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:35.886610    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:48:39.514622 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:39.514587    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:48:40.345233 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:40.345200    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:48:45.423802 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:48:45.423763    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:21.834634 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:21.834599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:23.271482 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:23.271436    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:29.465680 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:29.465647    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:29.531683 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:29.531649    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:32.578742 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:32.578661    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:32.803129 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:32.803097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:33.842521 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:33.842490    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:33.938227 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:33.938195    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:34.039261 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:34.039215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:34.712732 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:34.712684    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:34.807337 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:34.807299    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:34.883305 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:34.883269    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:35.919360 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:35.919323    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:49:36.354247 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:36.354196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:43.121397 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:43.121364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:43.221285 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:43.221253    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:43.384294 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:43.384214    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:43.485669 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:43.485636    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:43.811302 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:43.811269    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:47.800379 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:47.800344    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:49:50.365977 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:50.365943    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:50.431080 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:50.431045    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:49:50.550724 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:49:50.550686    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:01.118145 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:01.118108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:01.463030 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:01.462956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:22.398666 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:22.398633    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:28.614310 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:28.614275    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:28.674919 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:28.674890    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:28.977375 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:28.977295    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:29.328690 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:29.328649    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:29.585039 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:29.584964    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:32.855769 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:32.855727    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:32.945769 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:32.945735    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:33.037203 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:33.037158    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:33.336324 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:33.336295    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:33.688659 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:33.688574    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:33.786495 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:33.786459    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:37.255032 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:37.254997    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:37.589972 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:37.589894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:37.935181 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:37.935099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:38.130314 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:38.130276    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:40.516077 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:40.516038    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:50:40.784040 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:40.783950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:40.871063 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:40.871031    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:40.947781 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:40.947743    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:41.048711 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:41.048629    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:41.472414 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:41.472317    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:41.571771 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:41.571742    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:45.263579 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:45.263538    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:51.104655 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:51.104620    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:50:54.428325 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:54.428275    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:54.528840 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:54.528807    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:50:57.327423 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:50:57.327390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:51:02.276128 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:02.276045    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:51:02.376313 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:02.376280    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:51:02.401331 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:02.401303    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:51:13.314242 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:13.314207    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:51:17.390047 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:17.390013    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:51:36.412981 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.412949    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"]
Jul 17 15:51:36.413345 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.413255    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c37883-87ce-4e90-8f20-11404dec0dcf" containerName="revoke-keys"
Jul 17 15:51:36.413345 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.413265    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c37883-87ce-4e90-8f20-11404dec0dcf" containerName="revoke-keys"
Jul 17 15:51:36.413345 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.413315    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c37883-87ce-4e90-8f20-11404dec0dcf" containerName="revoke-keys"
Jul 17 15:51:36.416172 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.416156    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.419128 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.419106    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1e887c\"/\"test-model-1e887c-kserve-self-signed-certs\""
Jul 17 15:51:36.420327 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.420311    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1e887c\"/\"default-dockercfg-rtp78\""
Jul 17 15:51:36.420437 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.420310    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1e887c\"/\"kube-root-ca.crt\""
Jul 17 15:51:36.420437 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.420366    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1e887c\"/\"openshift-service-ca.crt\""
Jul 17 15:51:36.427236 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.427214    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"]
Jul 17 15:51:36.446671 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.446647    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:51:36.497322 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.497298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tls-certs\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.497446 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.497356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tmp-dir\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.497446 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.497408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7wqs\" (UniqueName: \"kubernetes.io/projected/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-kube-api-access-p7wqs\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.497543 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.497454    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-home\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.497543 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.497474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-dshm\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.497543 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.497505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-model-cache\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.598165 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.598139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tmp-dir\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.598335 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.598170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7wqs\" (UniqueName: \"kubernetes.io/projected/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-kube-api-access-p7wqs\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.598335 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.598191    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-home\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.598335 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.598205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-dshm\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.598335 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.598233    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-model-cache\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.598335 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.598255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tls-certs\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.598634 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.598612    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tmp-dir\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.598671 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.598648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-home\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.598718 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.598699    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-model-cache\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.600419 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.600398    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-dshm\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.600704 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.600675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tls-certs\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.616138 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.616117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7wqs\" (UniqueName: \"kubernetes.io/projected/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-kube-api-access-p7wqs\") pod \"test-model-1e887c-kserve-dc8c76897-5jmq6\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") " pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.724775 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.724696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:36.858744 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:36.858719    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"]
Jul 17 15:51:36.860839 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:51:36.860816    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b8d7370_5a5d_4e8f_b1cd_b4c04a7e9fef.slice/crio-b2ccd55603bd2544f849460278e18d876c77349391e34f99c3fff242266e43de WatchSource:0}: Error finding container b2ccd55603bd2544f849460278e18d876c77349391e34f99c3fff242266e43de: Status 404 returned error can't find the container with id b2ccd55603bd2544f849460278e18d876c77349391e34f99c3fff242266e43de
Jul 17 15:51:37.575002 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:37.574972    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6" event={"ID":"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef","Type":"ContainerStarted","Data":"93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b"}
Jul 17 15:51:37.575373 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:37.575012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6" event={"ID":"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef","Type":"ContainerStarted","Data":"b2ccd55603bd2544f849460278e18d876c77349391e34f99c3fff242266e43de"}
Jul 17 15:51:37.594041 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:37.593996    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6" podStartSLOduration=1.5939812880000002 podStartE2EDuration="1.593981288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:51:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:51:37.593660436 +0000 UTC m=+2549.258110551" watchObservedRunningTime="2026-07-17 15:51:37.593981288 +0000 UTC m=+2549.258431422"
Jul 17 15:51:41.618466 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:41.618433    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:51:46.725083 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:46.725045    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:46.725570 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:46.725096    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:46.737213 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:46.737190    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:51:47.631216 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:51:47.631190    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:52:04.155906 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:04.155868    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:05.018481 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.018422    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"]
Jul 17 15:52:05.219312 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.219278    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6"]
Jul 17 15:52:05.222676 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.222659    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6"
Jul 17 15:52:05.230803 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.230785    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:52:05.230933 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.230814    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:52:05.238406 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.238371    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6"]
Jul 17 15:52:05.339604 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.339523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/173dbef7-25c4-49c7-af4e-b6d7f48a0177-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f93829-227v6\" (UID: \"173dbef7-25c4-49c7-af4e-b6d7f48a0177\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6"
Jul 17 15:52:05.440919 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.440885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/173dbef7-25c4-49c7-af4e-b6d7f48a0177-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f93829-227v6\" (UID: \"173dbef7-25c4-49c7-af4e-b6d7f48a0177\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6"
Jul 17 15:52:05.441495 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.441477    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/173dbef7-25c4-49c7-af4e-b6d7f48a0177-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f93829-227v6\" (UID: \"173dbef7-25c4-49c7-af4e-b6d7f48a0177\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6"
Jul 17 15:52:05.532403 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.532371    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6"
Jul 17 15:52:05.666790 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.666763    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6"]
Jul 17 15:52:05.669456 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:52:05.669431    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice/crio-63c97e3696a4bec113e850211d826245ea450df1ca70660d4261d119adf76548 WatchSource:0}: Error finding container 63c97e3696a4bec113e850211d826245ea450df1ca70660d4261d119adf76548: Status 404 returned error can't find the container with id 63c97e3696a4bec113e850211d826245ea450df1ca70660d4261d119adf76548
Jul 17 15:52:05.702796 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.702770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6" event={"ID":"173dbef7-25c4-49c7-af4e-b6d7f48a0177","Type":"ContainerStarted","Data":"63c97e3696a4bec113e850211d826245ea450df1ca70660d4261d119adf76548"}
Jul 17 15:52:05.799121 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.799081    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:05.921123 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:05.921048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:06.713777 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:06.713685    2582 generic.go:356] "Generic (PLEG): container finished" podID="173dbef7-25c4-49c7-af4e-b6d7f48a0177" containerID="4be5da10ce9e12b35418fae7cfc14dc3fa4b135e3edba94281e2f59f556e2f55" exitCode=0
Jul 17 15:52:06.713777 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:06.713729    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6" event={"ID":"173dbef7-25c4-49c7-af4e-b6d7f48a0177","Type":"ContainerDied","Data":"4be5da10ce9e12b35418fae7cfc14dc3fa4b135e3edba94281e2f59f556e2f55"}
Jul 17 15:52:07.845302 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:07.845279    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6"
Jul 17 15:52:07.966044 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:07.966018    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/173dbef7-25c4-49c7-af4e-b6d7f48a0177-maas-api-service-ca\") pod \"173dbef7-25c4-49c7-af4e-b6d7f48a0177\" (UID: \"173dbef7-25c4-49c7-af4e-b6d7f48a0177\") "
Jul 17 15:52:07.966387 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:07.966364    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/173dbef7-25c4-49c7-af4e-b6d7f48a0177-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "173dbef7-25c4-49c7-af4e-b6d7f48a0177" (UID: "173dbef7-25c4-49c7-af4e-b6d7f48a0177"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:52:08.066799 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:08.066768    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/173dbef7-25c4-49c7-af4e-b6d7f48a0177-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:52:08.723760 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:08.723727    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6" event={"ID":"173dbef7-25c4-49c7-af4e-b6d7f48a0177","Type":"ContainerDied","Data":"63c97e3696a4bec113e850211d826245ea450df1ca70660d4261d119adf76548"}
Jul 17 15:52:08.723760 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:08.723747    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f93829-227v6"
Jul 17 15:52:08.723975 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:08.723775    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63c97e3696a4bec113e850211d826245ea450df1ca70660d4261d119adf76548"
Jul 17 15:52:09.302574 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:09.302542    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:52:14.581655 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:52:14.581625    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:52:15.691017 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:15.690984    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:17.565479 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:52:17.565402    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:52:20.037893 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.037834    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6" podUID="9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" containerName="main" containerID="cri-o://93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b" gracePeriod=45
Jul 17 15:52:20.285370 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.285346    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:52:20.314366 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.314302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:20.361836 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.361811    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-home\") pod \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") "
Jul 17 15:52:20.362015 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.361870    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-model-cache\") pod \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") "
Jul 17 15:52:20.362015 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.361893    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7wqs\" (UniqueName: \"kubernetes.io/projected/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-kube-api-access-p7wqs\") pod \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") "
Jul 17 15:52:20.362015 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.361932    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tls-certs\") pod \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") "
Jul 17 15:52:20.362015 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.361946    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tmp-dir\") pod \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") "
Jul 17 15:52:20.362015 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.361979    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-dshm\") pod \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\" (UID: \"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef\") "
Jul 17 15:52:20.362252 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.362066    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-home" (OuterVolumeSpecName: "home") pod "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" (UID: "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:52:20.362512 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.362456    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-model-cache" (OuterVolumeSpecName: "model-cache") pod "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" (UID: "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:52:20.362512 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.362452    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" (UID: "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:52:20.362701 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.362605    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-home\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:52:20.369252 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.369190    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" (UID: "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 15:52:20.369252 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.369214    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-kube-api-access-p7wqs" (OuterVolumeSpecName: "kube-api-access-p7wqs") pod "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" (UID: "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef"). InnerVolumeSpecName "kube-api-access-p7wqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:52:20.369393 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.369256    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-dshm" (OuterVolumeSpecName: "dshm") pod "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" (UID: "9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:52:20.463519 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.463491    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tls-certs\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:52:20.463519 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.463516    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-tmp-dir\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:52:20.463519 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.463524    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-dshm\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:52:20.463722 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.463532    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-model-cache\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:52:20.463722 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.463541    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7wqs\" (UniqueName: \"kubernetes.io/projected/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef-kube-api-access-p7wqs\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:52:20.779128 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.779096    2582 generic.go:356] "Generic (PLEG): container finished" podID="9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" containerID="93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b" exitCode=0
Jul 17 15:52:20.779296 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.779155    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"
Jul 17 15:52:20.779296 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.779182    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6" event={"ID":"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef","Type":"ContainerDied","Data":"93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b"}
Jul 17 15:52:20.779296 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.779225    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6" event={"ID":"9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef","Type":"ContainerDied","Data":"b2ccd55603bd2544f849460278e18d876c77349391e34f99c3fff242266e43de"}
Jul 17 15:52:20.779296 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.779242    2582 scope.go:117] "RemoveContainer" containerID="93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b"
Jul 17 15:52:20.787694 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.787678    2582 scope.go:117] "RemoveContainer" containerID="93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b"
Jul 17 15:52:20.787945 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:52:20.787927    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b\": container with ID starting with 93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b not found: ID does not exist" containerID="93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b"
Jul 17 15:52:20.787997 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.787954    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b"} err="failed to get container status \"93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b\": rpc error: code = NotFound desc = could not find container \"93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b\": container with ID starting with 93ab2798ca50fbf571ba8af5fe4df0bb9d041c907c29fc96fbf89322a587128b not found: ID does not exist"
Jul 17 15:52:20.801854 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.801817    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"]
Jul 17 15:52:20.806231 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.806212    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-1e887c/test-model-1e887c-kserve-dc8c76897-5jmq6"]
Jul 17 15:52:20.904424 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:20.904393    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" path="/var/lib/kubelet/pods/9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef/volumes"
Jul 17 15:52:24.624614 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:52:24.624582    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:52:25.518341 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:25.518306    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:52:25.888290 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:25.888213    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:26.919299 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:26.919262    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:26.981703 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:26.981672    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:31.086678 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.086603    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:31.216245 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.216212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:31.325567 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.325529    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm"]
Jul 17 15:52:31.325866 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.325841    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" containerName="main"
Jul 17 15:52:31.325908 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.325867    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" containerName="main"
Jul 17 15:52:31.325908 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.325878    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173dbef7-25c4-49c7-af4e-b6d7f48a0177" containerName="revoke-keys"
Jul 17 15:52:31.325908 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.325884    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="173dbef7-25c4-49c7-af4e-b6d7f48a0177" containerName="revoke-keys"
Jul 17 15:52:31.326007 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.325936    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="173dbef7-25c4-49c7-af4e-b6d7f48a0177" containerName="revoke-keys"
Jul 17 15:52:31.326007 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.325943    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b8d7370-5a5d-4e8f-b1cd-b4c04a7e9fef" containerName="main"
Jul 17 15:52:31.330311 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.330290    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm"
Jul 17 15:52:31.333046 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.333017    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:52:31.333172 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.333136    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:52:31.336363 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.336334    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm"]
Jul 17 15:52:31.350400 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.350374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0baaa22c-869e-464d-a64d-a83025a6ab1d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm\" (UID: \"0baaa22c-869e-464d-a64d-a83025a6ab1d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm"
Jul 17 15:52:31.451086 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.451057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0baaa22c-869e-464d-a64d-a83025a6ab1d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm\" (UID: \"0baaa22c-869e-464d-a64d-a83025a6ab1d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm"
Jul 17 15:52:31.451621 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.451602    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0baaa22c-869e-464d-a64d-a83025a6ab1d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm\" (UID: \"0baaa22c-869e-464d-a64d-a83025a6ab1d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm"
Jul 17 15:52:31.642371 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.642286    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm"
Jul 17 15:52:31.774468 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.774445    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm"]
Jul 17 15:52:31.776496 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:52:31.776461    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0baaa22c_869e_464d_a64d_a83025a6ab1d.slice/crio-4db9e140157a1d78a6a861bcdbb655d94073357a13ec3d93adad15436919580f WatchSource:0}: Error finding container 4db9e140157a1d78a6a861bcdbb655d94073357a13ec3d93adad15436919580f: Status 404 returned error can't find the container with id 4db9e140157a1d78a6a861bcdbb655d94073357a13ec3d93adad15436919580f
Jul 17 15:52:31.831292 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.831262    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm" event={"ID":"0baaa22c-869e-464d-a64d-a83025a6ab1d","Type":"ContainerStarted","Data":"4db9e140157a1d78a6a861bcdbb655d94073357a13ec3d93adad15436919580f"}
Jul 17 15:52:31.873824 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.873800    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:31.974298 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:31.974257    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:32.585069 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:52:32.585034    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:52:32.837431 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:32.837399    2582 generic.go:356] "Generic (PLEG): container finished" podID="0baaa22c-869e-464d-a64d-a83025a6ab1d" containerID="bd0c6ff8cf586d407cae362fcb0defe09c9f4499cf5f1f9593ae638d45abeccd" exitCode=0
Jul 17 15:52:32.837630 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:32.837487    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm" event={"ID":"0baaa22c-869e-464d-a64d-a83025a6ab1d","Type":"ContainerDied","Data":"bd0c6ff8cf586d407cae362fcb0defe09c9f4499cf5f1f9593ae638d45abeccd"}
Jul 17 15:52:33.964687 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:33.964662    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm"
Jul 17 15:52:34.073591 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:34.073558    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0baaa22c-869e-464d-a64d-a83025a6ab1d-maas-api-service-ca\") pod \"0baaa22c-869e-464d-a64d-a83025a6ab1d\" (UID: \"0baaa22c-869e-464d-a64d-a83025a6ab1d\") "
Jul 17 15:52:34.073919 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:34.073897    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0baaa22c-869e-464d-a64d-a83025a6ab1d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0baaa22c-869e-464d-a64d-a83025a6ab1d" (UID: "0baaa22c-869e-464d-a64d-a83025a6ab1d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:52:34.175129 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:34.175049    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0baaa22c-869e-464d-a64d-a83025a6ab1d-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:52:34.632965 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:52:34.632933    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:52:34.846840 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:34.846812    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm"
Jul 17 15:52:34.847075 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:34.846802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm" event={"ID":"0baaa22c-869e-464d-a64d-a83025a6ab1d","Type":"ContainerDied","Data":"4db9e140157a1d78a6a861bcdbb655d94073357a13ec3d93adad15436919580f"}
Jul 17 15:52:34.847075 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:34.846960    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4db9e140157a1d78a6a861bcdbb655d94073357a13ec3d93adad15436919580f"
Jul 17 15:52:42.043622 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:42.043588    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:44.671165 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:52:44.671131    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:52:44.718320 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:44.718279    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:52:46.429617 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:46.429579    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:47.545875 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:52:47.545808    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:52:52.987392 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:52.987354    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:53.051768 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:53.051738    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:54.709593 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:52:54.709554    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:52:57.137215 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:57.137181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:57.372033 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:57.371997    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:57.700022 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:57.699992    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:58.036970 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:58.036939    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:52:58.377018 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:52:58.376925    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:00.624358 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:00.624325    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:00.716706 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:00.716646    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:00.950241 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:00.950123    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:01.100914 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:01.100885    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:01.528761 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:01.528728    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:01.629620 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:01.629589    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:02.575129 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:53:02.575095    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:53:04.718236 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:53:04.718200    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:53:05.014596 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:05.014564    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:05.304440 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:05.304363    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:53:05.467831 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:05.467796    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:05.777080 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:05.777048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:05.913610 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:05.913581    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:05.966262 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:53:05.966226    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:53:05.966618 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:53:05.966590    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173dbef7_25c4_49c7_af4e_b6d7f48a0177.slice\": RecentStats: unable to find data in memory cache]"
Jul 17 15:53:08.630947 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:08.630915    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:08.725158 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:08.725125    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:15.941371 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:15.941339    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:53:18.793420 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:18.793386    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:18.858703 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:18.858666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:21.006175 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.006139    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7"]
Jul 17 15:53:21.006648 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.006449    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0baaa22c-869e-464d-a64d-a83025a6ab1d" containerName="revoke-keys"
Jul 17 15:53:21.006648 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.006460    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0baaa22c-869e-464d-a64d-a83025a6ab1d" containerName="revoke-keys"
Jul 17 15:53:21.006648 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.006528    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0baaa22c-869e-464d-a64d-a83025a6ab1d" containerName="revoke-keys"
Jul 17 15:53:21.009477 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.009456    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7"
Jul 17 15:53:21.012906 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.012881    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:53:21.020359 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.020334    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:53:21.020905 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.020882    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7"]
Jul 17 15:53:21.068409 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.068373    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8817d769-4a9a-4718-999c-7027d2b8ed97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f54d84-x92k7\" (UID: \"8817d769-4a9a-4718-999c-7027d2b8ed97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7"
Jul 17 15:53:21.169542 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.169502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8817d769-4a9a-4718-999c-7027d2b8ed97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f54d84-x92k7\" (UID: \"8817d769-4a9a-4718-999c-7027d2b8ed97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7"
Jul 17 15:53:21.170222 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.170201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8817d769-4a9a-4718-999c-7027d2b8ed97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f54d84-x92k7\" (UID: \"8817d769-4a9a-4718-999c-7027d2b8ed97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7"
Jul 17 15:53:21.319142 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.319036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7"
Jul 17 15:53:21.452073 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.452038    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7"]
Jul 17 15:53:21.453654 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:53:21.453628    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8817d769_4a9a_4718_999c_7027d2b8ed97.slice/crio-34c3c3e4639b4f01a4458b88cc6f135047d113f226177e088cd11545da6dcd2e WatchSource:0}: Error finding container 34c3c3e4639b4f01a4458b88cc6f135047d113f226177e088cd11545da6dcd2e: Status 404 returned error can't find the container with id 34c3c3e4639b4f01a4458b88cc6f135047d113f226177e088cd11545da6dcd2e
Jul 17 15:53:21.704713 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.704677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:21.805231 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:21.805190    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:22.059545 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:22.059505    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7" event={"ID":"8817d769-4a9a-4718-999c-7027d2b8ed97","Type":"ContainerStarted","Data":"74248275ae64655f7f266bdd672960bb80a3485e60ba189bec760c5f3000342d"}
Jul 17 15:53:22.060028 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:22.059593    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7" event={"ID":"8817d769-4a9a-4718-999c-7027d2b8ed97","Type":"ContainerStarted","Data":"34c3c3e4639b4f01a4458b88cc6f135047d113f226177e088cd11545da6dcd2e"}
Jul 17 15:53:22.080051 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:22.080003    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7" podStartSLOduration=2.079989008 podStartE2EDuration="2.079989008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:53:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:53:22.078486259 +0000 UTC m=+2653.742936363" watchObservedRunningTime="2026-07-17 15:53:22.079989008 +0000 UTC m=+2653.744439109"
Jul 17 15:53:23.066501 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:23.066465    2582 generic.go:356] "Generic (PLEG): container finished" podID="8817d769-4a9a-4718-999c-7027d2b8ed97" containerID="74248275ae64655f7f266bdd672960bb80a3485e60ba189bec760c5f3000342d" exitCode=0
Jul 17 15:53:23.066911 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:23.066551    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7" event={"ID":"8817d769-4a9a-4718-999c-7027d2b8ed97","Type":"ContainerDied","Data":"74248275ae64655f7f266bdd672960bb80a3485e60ba189bec760c5f3000342d"}
Jul 17 15:53:24.223188 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:24.223162    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7"
Jul 17 15:53:24.289776 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:24.289745    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8817d769-4a9a-4718-999c-7027d2b8ed97-maas-api-service-ca\") pod \"8817d769-4a9a-4718-999c-7027d2b8ed97\" (UID: \"8817d769-4a9a-4718-999c-7027d2b8ed97\") "
Jul 17 15:53:24.290142 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:24.290120    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8817d769-4a9a-4718-999c-7027d2b8ed97-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8817d769-4a9a-4718-999c-7027d2b8ed97" (UID: "8817d769-4a9a-4718-999c-7027d2b8ed97"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:53:24.391040 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:24.390951    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8817d769-4a9a-4718-999c-7027d2b8ed97-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:53:25.077123 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:25.077098    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7"
Jul 17 15:53:25.077123 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:25.077104    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f54d84-x92k7" event={"ID":"8817d769-4a9a-4718-999c-7027d2b8ed97","Type":"ContainerDied","Data":"34c3c3e4639b4f01a4458b88cc6f135047d113f226177e088cd11545da6dcd2e"}
Jul 17 15:53:25.077367 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:25.077148    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34c3c3e4639b4f01a4458b88cc6f135047d113f226177e088cd11545da6dcd2e"
Jul 17 15:53:30.311428 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:30.311388    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:30.409379 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:30.409341    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:31.190454 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:31.190423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:34.812937 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:34.812905    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:53:36.112282 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:36.112230    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:42.961797 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:42.961745    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:43.068993 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:43.068962    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:46.777309 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:46.777274    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:46.993184 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:46.993147    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:53:47.132903 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.132775    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q"]
Jul 17 15:53:47.133168 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.133155    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8817d769-4a9a-4718-999c-7027d2b8ed97" containerName="revoke-keys"
Jul 17 15:53:47.133221 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.133169    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8817d769-4a9a-4718-999c-7027d2b8ed97" containerName="revoke-keys"
Jul 17 15:53:47.133221 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.133219    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8817d769-4a9a-4718-999c-7027d2b8ed97" containerName="revoke-keys"
Jul 17 15:53:47.135684 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.135668    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q"
Jul 17 15:53:47.138574 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.138554    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 15:53:47.139607 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:53:47.139580    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q\" is forbidden: User \"system:node:ip-10-0-138-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-138-239.ec2.internal' and this object" podUID="e0dc2338-e0c3-4436-b818-070813e13e13" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q"
Jul 17 15:53:47.139699 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.139605    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 15:53:47.155710 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.155686    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q"]
Jul 17 15:53:47.179498 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.179471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0dc2338-e0c3-4436-b818-070813e13e13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q\" (UID: \"e0dc2338-e0c3-4436-b818-070813e13e13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q"
Jul 17 15:53:47.280952 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.280920    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0dc2338-e0c3-4436-b818-070813e13e13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q\" (UID: \"e0dc2338-e0c3-4436-b818-070813e13e13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q"
Jul 17 15:53:47.281486 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.281468    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0dc2338-e0c3-4436-b818-070813e13e13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q\" (UID: \"e0dc2338-e0c3-4436-b818-070813e13e13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q"
Jul 17 15:53:47.445826 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.445733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q"
Jul 17 15:53:47.583815 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:47.583782    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q"]
Jul 17 15:53:47.585555 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:53:47.585523    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0dc2338_e0c3_4436_b818_070813e13e13.slice/crio-819bbfd7c009411d32dcbbc5ad3db3e2aee609d2ecfb4d13a10397b9674f3942 WatchSource:0}: Error finding container 819bbfd7c009411d32dcbbc5ad3db3e2aee609d2ecfb4d13a10397b9674f3942: Status 404 returned error can't find the container with id 819bbfd7c009411d32dcbbc5ad3db3e2aee609d2ecfb4d13a10397b9674f3942
Jul 17 15:53:48.185757 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:48.185659    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q" event={"ID":"e0dc2338-e0c3-4436-b818-070813e13e13","Type":"ContainerStarted","Data":"17514b8963dfdc47cc6e289a1838854a790cc7add97b2471920d8f4354c7abdd"}
Jul 17 15:53:48.185757 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:48.185750    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q" event={"ID":"e0dc2338-e0c3-4436-b818-070813e13e13","Type":"ContainerStarted","Data":"819bbfd7c009411d32dcbbc5ad3db3e2aee609d2ecfb4d13a10397b9674f3942"}
Jul 17 15:53:48.206268 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:48.206223    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q" podStartSLOduration=1.2062081390000001 podStartE2EDuration="1.206208139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:53:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:53:48.204228914 +0000 UTC m=+2679.868679019" watchObservedRunningTime="2026-07-17 15:53:48.206208139 +0000 UTC m=+2679.870658281"
Jul 17 15:53:49.191782 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:49.191745    2582 generic.go:356] "Generic (PLEG): container finished" podID="e0dc2338-e0c3-4436-b818-070813e13e13" containerID="17514b8963dfdc47cc6e289a1838854a790cc7add97b2471920d8f4354c7abdd" exitCode=0
Jul 17 15:53:49.192242 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:49.191792    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q" event={"ID":"e0dc2338-e0c3-4436-b818-070813e13e13","Type":"ContainerDied","Data":"17514b8963dfdc47cc6e289a1838854a790cc7add97b2471920d8f4354c7abdd"}
Jul 17 15:53:50.322928 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:50.322903    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q"
Jul 17 15:53:50.405740 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:50.405711    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0dc2338-e0c3-4436-b818-070813e13e13-maas-api-service-ca\") pod \"e0dc2338-e0c3-4436-b818-070813e13e13\" (UID: \"e0dc2338-e0c3-4436-b818-070813e13e13\") "
Jul 17 15:53:50.406093 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:50.406075    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0dc2338-e0c3-4436-b818-070813e13e13-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e0dc2338-e0c3-4436-b818-070813e13e13" (UID: "e0dc2338-e0c3-4436-b818-070813e13e13"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 15:53:50.506631 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:50.506599    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0dc2338-e0c3-4436-b818-070813e13e13-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:53:51.201502 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:51.201421    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q" event={"ID":"e0dc2338-e0c3-4436-b818-070813e13e13","Type":"ContainerDied","Data":"819bbfd7c009411d32dcbbc5ad3db3e2aee609d2ecfb4d13a10397b9674f3942"}
Jul 17 15:53:51.201502 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:51.201458    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q"
Jul 17 15:53:51.201502 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:51.201471    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="819bbfd7c009411d32dcbbc5ad3db3e2aee609d2ecfb4d13a10397b9674f3942"
Jul 17 15:53:57.839531 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:53:57.839496    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:00.917861 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:00.917763    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:54:02.229511 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:02.229470    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:09.763511 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:09.763474    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:09.867301 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:09.867251    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:12.972861 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:12.972797    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:13.188753 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:13.188721    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:13.581527 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:13.581494    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:14.014126 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:14.014084    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:14.140656 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:14.140570    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:17.111663 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:17.111633    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:17.264198 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:17.264156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:17.362576 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:17.362478    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:17.764353 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:17.764321    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:18.186651 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:18.186551    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:18.265288 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:18.265247    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:21.521696 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:21.521658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:21.874741 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:21.874641    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:22.289612 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:22.289584    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:22.537785 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:22.537754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:22.611958 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:22.611868    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:54:25.172420 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:25.172388    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:25.259091 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:25.259057    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:25.403533 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:25.403484    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:25.702583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:25.702551    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:26.447543 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:26.447499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:26.561430 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:26.561396    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:29.577338 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:29.577309    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:30.159498 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:30.159466    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:35.651025 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:35.650985    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:54:41.060461 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:41.060424    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:41.162285 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:41.162253    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:42.598215 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.598180    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"]
Jul 17 15:54:42.598662 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.598649    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0dc2338-e0c3-4436-b818-070813e13e13" containerName="revoke-keys"
Jul 17 15:54:42.598734 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.598668    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0dc2338-e0c3-4436-b818-070813e13e13" containerName="revoke-keys"
Jul 17 15:54:42.598783 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.598750    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0dc2338-e0c3-4436-b818-070813e13e13" containerName="revoke-keys"
Jul 17 15:54:42.602160 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.602138    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.605024 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.605005    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-291633\"/\"kube-root-ca.crt\""
Jul 17 15:54:42.606216 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.606191    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-291633\"/\"openshift-service-ca.crt\""
Jul 17 15:54:42.606568 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.606253    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-291633\"/\"default-dockercfg-pp9x2\""
Jul 17 15:54:42.606670 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.606278    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-291633\"/\"auth-test-model-291633-kserve-self-signed-certs\""
Jul 17 15:54:42.612382 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.612361    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"]
Jul 17 15:54:42.635387 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.635360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-dshm\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.635387 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.635387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-home\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.635545 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.635408    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-model-cache\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.635545 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.635425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tmp-dir\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.635545 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.635476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tls-certs\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.635545 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.635514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42zzk\" (UniqueName: \"kubernetes.io/projected/9b1d54a8-db5f-4ca0-809c-ced3c000467b-kube-api-access-42zzk\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.638157 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.638134    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:42.736893 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.736805    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-dshm\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.736893 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.736882    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-home\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.737143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.736918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-model-cache\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.737143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.736940    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tmp-dir\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.737143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.736963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tls-certs\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.737143 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.737040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42zzk\" (UniqueName: \"kubernetes.io/projected/9b1d54a8-db5f-4ca0-809c-ced3c000467b-kube-api-access-42zzk\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.737414 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.737383    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tmp-dir\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.737543 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.737523    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-model-cache\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.737653 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.737632    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-home\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.739266 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.739248    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-dshm\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.739648 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.739633    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tls-certs\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.749202 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.749179    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42zzk\" (UniqueName: \"kubernetes.io/projected/9b1d54a8-db5f-4ca0-809c-ced3c000467b-kube-api-access-42zzk\") pod \"auth-test-model-291633-kserve-86f6f7f5ff-htk8b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") " pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:42.913268 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:42.913180    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:43.046634 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:43.046601    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"]
Jul 17 15:54:43.047964 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:54:43.047937    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b1d54a8_db5f_4ca0_809c_ced3c000467b.slice/crio-81c3ba0a47c67cb3cc16c256483972d8dc753a019ae37b5339a93a980470956c WatchSource:0}: Error finding container 81c3ba0a47c67cb3cc16c256483972d8dc753a019ae37b5339a93a980470956c: Status 404 returned error can't find the container with id 81c3ba0a47c67cb3cc16c256483972d8dc753a019ae37b5339a93a980470956c
Jul 17 15:54:43.443445 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:43.443404    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b" event={"ID":"9b1d54a8-db5f-4ca0-809c-ced3c000467b","Type":"ContainerStarted","Data":"a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301"}
Jul 17 15:54:43.445484 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:43.443453    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b" event={"ID":"9b1d54a8-db5f-4ca0-809c-ced3c000467b","Type":"ContainerStarted","Data":"81c3ba0a47c67cb3cc16c256483972d8dc753a019ae37b5339a93a980470956c"}
Jul 17 15:54:43.467723 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:43.467672    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b" podStartSLOduration=1.467657745 podStartE2EDuration="1.467657745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:54:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:54:43.46540872 +0000 UTC m=+2735.129858826" watchObservedRunningTime="2026-07-17 15:54:43.467657745 +0000 UTC m=+2735.132107915"
Jul 17 15:54:44.455468 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:44.455427    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:44.558652 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:44.558620    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:45.737887 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:45.737840    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:54:47.786037 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:47.785992    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:47.914182 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:47.914148    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:54:52.913295 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:52.913266    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:52.913756 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:52.913307    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:52.925762 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:52.925738    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:54:53.501825 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:54:53.501797    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:55:04.307980 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:55:04.307945    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:55:07.816302 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:55:07.816270    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:55:16.565297 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:55:16.565259    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:55:16.628026 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:55:16.627995    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:55:22.905972 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:55:22.905934    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:55:40.970628 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:55:40.970541    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:55:59.005383 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:55:59.005349    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:56:12.310777 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:56:12.310735    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:56:27.213220 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:56:27.213181    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:56:45.107373 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:56:45.107337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:57:02.509658 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:02.509578    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:57:06.194892 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:06.194858    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"]
Jul 17 15:57:06.239707 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:06.239676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:57:07.469529 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:07.469489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:57:17.128633 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.128599    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"]
Jul 17 15:57:17.131992 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.131968    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.136492 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.136467    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-291633\"/\"sub-test-model-291633-kserve-self-signed-certs\""
Jul 17 15:57:17.147073 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.146372    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"]
Jul 17 15:57:17.151129 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.151092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:57:17.233243 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.233211    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-dshm\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.233415 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.233256    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-home\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.233415 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.233280    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-tmp-dir\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.233415 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.233311    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-model-cache\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.233415 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.233395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4ec205-1a92-4bdc-acf7-111c487c041b-tls-certs\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.233557 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.233436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjmwk\" (UniqueName: \"kubernetes.io/projected/2e4ec205-1a92-4bdc-acf7-111c487c041b-kube-api-access-cjmwk\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.334490 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.334448    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4ec205-1a92-4bdc-acf7-111c487c041b-tls-certs\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.334490 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.334493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjmwk\" (UniqueName: \"kubernetes.io/projected/2e4ec205-1a92-4bdc-acf7-111c487c041b-kube-api-access-cjmwk\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.334758 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.334620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-dshm\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.334758 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.334660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-home\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.334758 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.334687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-tmp-dir\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.334758 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.334745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-model-cache\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.335160 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.335134    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-home\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.335160 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.335154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-tmp-dir\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.335302 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.335173    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-model-cache\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.336974 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.336946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-dshm\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.337066 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.337038    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4ec205-1a92-4bdc-acf7-111c487c041b-tls-certs\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.348678 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.348652    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjmwk\" (UniqueName: \"kubernetes.io/projected/2e4ec205-1a92-4bdc-acf7-111c487c041b-kube-api-access-cjmwk\") pod \"sub-test-model-291633-kserve-5d9b47cf4c-64bkh\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") " pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.441381 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.441295    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:17.585047 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:17.585016    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"]
Jul 17 15:57:17.586338 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:57:17.586312    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e4ec205_1a92_4bdc_acf7_111c487c041b.slice/crio-f69932def7f1aa44a0535ded972089dcef5cdd18e6001cf63e26f0eb9ea89e92 WatchSource:0}: Error finding container f69932def7f1aa44a0535ded972089dcef5cdd18e6001cf63e26f0eb9ea89e92: Status 404 returned error can't find the container with id f69932def7f1aa44a0535ded972089dcef5cdd18e6001cf63e26f0eb9ea89e92
Jul 17 15:57:18.180605 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:18.180567    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh" event={"ID":"2e4ec205-1a92-4bdc-acf7-111c487c041b","Type":"ContainerStarted","Data":"a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6"}
Jul 17 15:57:18.181035 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:18.180614    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh" event={"ID":"2e4ec205-1a92-4bdc-acf7-111c487c041b","Type":"ContainerStarted","Data":"f69932def7f1aa44a0535ded972089dcef5cdd18e6001cf63e26f0eb9ea89e92"}
Jul 17 15:57:18.202627 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:18.202579    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh" podStartSLOduration=1.202563389 podStartE2EDuration="1.202563389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:57:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:57:18.199994223 +0000 UTC m=+2889.864444327" watchObservedRunningTime="2026-07-17 15:57:18.202563389 +0000 UTC m=+2889.867013493"
Jul 17 15:57:21.214485 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.214447    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b" podUID="9b1d54a8-db5f-4ca0-809c-ced3c000467b" containerName="main" containerID="cri-o://a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301" gracePeriod=45
Jul 17 15:57:21.466576 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.466513    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:57:21.571121 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.571084    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tmp-dir\") pod \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") "
Jul 17 15:57:21.571121 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.571123    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-model-cache\") pod \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") "
Jul 17 15:57:21.571377 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.571163    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-home\") pod \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") "
Jul 17 15:57:21.571377 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.571192    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tls-certs\") pod \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") "
Jul 17 15:57:21.571377 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.571215    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42zzk\" (UniqueName: \"kubernetes.io/projected/9b1d54a8-db5f-4ca0-809c-ced3c000467b-kube-api-access-42zzk\") pod \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") "
Jul 17 15:57:21.571377 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.571240    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-dshm\") pod \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\" (UID: \"9b1d54a8-db5f-4ca0-809c-ced3c000467b\") "
Jul 17 15:57:21.571566 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.571411    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9b1d54a8-db5f-4ca0-809c-ced3c000467b" (UID: "9b1d54a8-db5f-4ca0-809c-ced3c000467b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:57:21.571566 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.571478    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-model-cache" (OuterVolumeSpecName: "model-cache") pod "9b1d54a8-db5f-4ca0-809c-ced3c000467b" (UID: "9b1d54a8-db5f-4ca0-809c-ced3c000467b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:57:21.571566 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.571492    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-home" (OuterVolumeSpecName: "home") pod "9b1d54a8-db5f-4ca0-809c-ced3c000467b" (UID: "9b1d54a8-db5f-4ca0-809c-ced3c000467b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:57:21.573584 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.573561    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9b1d54a8-db5f-4ca0-809c-ced3c000467b" (UID: "9b1d54a8-db5f-4ca0-809c-ced3c000467b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 15:57:21.573661 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.573590    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-dshm" (OuterVolumeSpecName: "dshm") pod "9b1d54a8-db5f-4ca0-809c-ced3c000467b" (UID: "9b1d54a8-db5f-4ca0-809c-ced3c000467b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:57:21.573661 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.573634    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b1d54a8-db5f-4ca0-809c-ced3c000467b-kube-api-access-42zzk" (OuterVolumeSpecName: "kube-api-access-42zzk") pod "9b1d54a8-db5f-4ca0-809c-ced3c000467b" (UID: "9b1d54a8-db5f-4ca0-809c-ced3c000467b"). InnerVolumeSpecName "kube-api-access-42zzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:57:21.609779 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.609745    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:57:21.672481 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.672444    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tmp-dir\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:57:21.672481 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.672476    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-model-cache\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:57:21.672481 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.672485    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-home\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:57:21.672720 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.672493    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b1d54a8-db5f-4ca0-809c-ced3c000467b-tls-certs\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:57:21.672720 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.672502    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42zzk\" (UniqueName: \"kubernetes.io/projected/9b1d54a8-db5f-4ca0-809c-ced3c000467b-kube-api-access-42zzk\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:57:21.672720 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:21.672510    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b1d54a8-db5f-4ca0-809c-ced3c000467b-dshm\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:57:22.201882 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:22.201828    2582 generic.go:356] "Generic (PLEG): container finished" podID="9b1d54a8-db5f-4ca0-809c-ced3c000467b" containerID="a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301" exitCode=0
Jul 17 15:57:22.202090 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:22.201887    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b" event={"ID":"9b1d54a8-db5f-4ca0-809c-ced3c000467b","Type":"ContainerDied","Data":"a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301"}
Jul 17 15:57:22.202090 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:22.201924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b" event={"ID":"9b1d54a8-db5f-4ca0-809c-ced3c000467b","Type":"ContainerDied","Data":"81c3ba0a47c67cb3cc16c256483972d8dc753a019ae37b5339a93a980470956c"}
Jul 17 15:57:22.202090 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:22.201944    2582 scope.go:117] "RemoveContainer" containerID="a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301"
Jul 17 15:57:22.202090 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:22.201896    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"
Jul 17 15:57:22.210691 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:22.210674    2582 scope.go:117] "RemoveContainer" containerID="a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301"
Jul 17 15:57:22.211000 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:57:22.210980    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301\": container with ID starting with a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301 not found: ID does not exist" containerID="a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301"
Jul 17 15:57:22.211074 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:22.211007    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301"} err="failed to get container status \"a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301\": rpc error: code = NotFound desc = could not find container \"a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301\": container with ID starting with a4f0f50d0e99081d2a91611f94e5187bef87e617346305ef95b9d47393dde301 not found: ID does not exist"
Jul 17 15:57:22.225682 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:22.225653    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"]
Jul 17 15:57:22.232179 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:22.232152    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-291633/auth-test-model-291633-kserve-86f6f7f5ff-htk8b"]
Jul 17 15:57:22.903699 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:22.903666    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b1d54a8-db5f-4ca0-809c-ced3c000467b" path="/var/lib/kubelet/pods/9b1d54a8-db5f-4ca0-809c-ced3c000467b/volumes"
Jul 17 15:57:27.442026 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:27.441982    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:27.442451 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:27.442241    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:27.462660 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:27.462628    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:28.242772 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:28.242738    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:57:31.496789 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:31.496753    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:57:45.349085 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:45.349037    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:57:50.402145 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:57:50.402105    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:58:12.399704 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:12.399664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:58:31.609487 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:31.609404    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:58:36.749513 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:36.749471    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"]
Jul 17 15:58:36.771051 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:36.771023    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:58:37.636981 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:37.636951    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:58:48.918997 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:48.918961    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:58:49.934511 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:49.934477    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"]
Jul 17 15:58:49.934884 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:49.934789    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b1d54a8-db5f-4ca0-809c-ced3c000467b" containerName="main"
Jul 17 15:58:49.934884 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:49.934799    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b1d54a8-db5f-4ca0-809c-ced3c000467b" containerName="main"
Jul 17 15:58:49.934884 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:49.934868    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b1d54a8-db5f-4ca0-809c-ced3c000467b" containerName="main"
Jul 17 15:58:49.937745 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:49.937726    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:49.938232 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:49.938213    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:58:49.940528 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:49.940509    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-291633\"/\"rate-test-model-291633-kserve-self-signed-certs\""
Jul 17 15:58:49.951003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:49.950979    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"]
Jul 17 15:58:50.015251 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.015222    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-home\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.015445 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.015261    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-tmp-dir\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.015445 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.015291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnrbp\" (UniqueName: \"kubernetes.io/projected/99ee225e-1773-413b-abd2-6898a5f473e2-kube-api-access-wnrbp\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.015445 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.015379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99ee225e-1773-413b-abd2-6898a5f473e2-tls-certs\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.015445 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.015418    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-dshm\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.015623 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.015470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-model-cache\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.116802 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.116711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-tmp-dir\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.117388 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.117364    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnrbp\" (UniqueName: \"kubernetes.io/projected/99ee225e-1773-413b-abd2-6898a5f473e2-kube-api-access-wnrbp\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.117517 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.117429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99ee225e-1773-413b-abd2-6898a5f473e2-tls-certs\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.117517 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.117466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-dshm\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.117624 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.117518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-model-cache\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.117624 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.117597    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-home\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.117752 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.117725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-tmp-dir\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.117970 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.117952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-home\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.118042 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.118015    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-model-cache\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.119771 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.119748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-dshm\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.120003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.119984    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99ee225e-1773-413b-abd2-6898a5f473e2-tls-certs\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.127967 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.127944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnrbp\" (UniqueName: \"kubernetes.io/projected/99ee225e-1773-413b-abd2-6898a5f473e2-kube-api-access-wnrbp\") pod \"rate-test-model-291633-kserve-588f6fff7f-dxztc\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") " pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.246155 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.246125    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:58:50.381330 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.381302    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"]
Jul 17 15:58:50.383309 ip-10-0-138-239 kubenswrapper[2582]: W0717 15:58:50.383281    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99ee225e_1773_413b_abd2_6898a5f473e2.slice/crio-9ad110f232f75154c1e0d362695dec86c2031e43e7e74c2b745ea9ea13cf4794 WatchSource:0}: Error finding container 9ad110f232f75154c1e0d362695dec86c2031e43e7e74c2b745ea9ea13cf4794: Status 404 returned error can't find the container with id 9ad110f232f75154c1e0d362695dec86c2031e43e7e74c2b745ea9ea13cf4794
Jul 17 15:58:50.628701 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.628606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc" event={"ID":"99ee225e-1773-413b-abd2-6898a5f473e2","Type":"ContainerStarted","Data":"697773f0f697e7cc3125740f4a8ec0db7761649357767bcbf9a5b035bb246e8d"}
Jul 17 15:58:50.628701 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.628650    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc" event={"ID":"99ee225e-1773-413b-abd2-6898a5f473e2","Type":"ContainerStarted","Data":"9ad110f232f75154c1e0d362695dec86c2031e43e7e74c2b745ea9ea13cf4794"}
Jul 17 15:58:50.649822 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:50.649760    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc" podStartSLOduration=1.649739523 podStartE2EDuration="1.649739523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 15:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 15:58:50.647816233 +0000 UTC m=+2982.312266337" watchObservedRunningTime="2026-07-17 15:58:50.649739523 +0000 UTC m=+2982.314189628"
Jul 17 15:58:51.769442 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:51.769401    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh" podUID="2e4ec205-1a92-4bdc-acf7-111c487c041b" containerName="main" containerID="cri-o://a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6" gracePeriod=45
Jul 17 15:58:52.016282 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.016255    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:58:52.132884 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.132741    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-model-cache\") pod \"2e4ec205-1a92-4bdc-acf7-111c487c041b\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") "
Jul 17 15:58:52.132884 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.132815    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjmwk\" (UniqueName: \"kubernetes.io/projected/2e4ec205-1a92-4bdc-acf7-111c487c041b-kube-api-access-cjmwk\") pod \"2e4ec205-1a92-4bdc-acf7-111c487c041b\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") "
Jul 17 15:58:52.133122 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.132911    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-dshm\") pod \"2e4ec205-1a92-4bdc-acf7-111c487c041b\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") "
Jul 17 15:58:52.133122 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.133008    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4ec205-1a92-4bdc-acf7-111c487c041b-tls-certs\") pod \"2e4ec205-1a92-4bdc-acf7-111c487c041b\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") "
Jul 17 15:58:52.133122 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.133047    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-home\") pod \"2e4ec205-1a92-4bdc-acf7-111c487c041b\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") "
Jul 17 15:58:52.133122 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.133077    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-tmp-dir\") pod \"2e4ec205-1a92-4bdc-acf7-111c487c041b\" (UID: \"2e4ec205-1a92-4bdc-acf7-111c487c041b\") "
Jul 17 15:58:52.133122 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.133082    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e4ec205-1a92-4bdc-acf7-111c487c041b" (UID: "2e4ec205-1a92-4bdc-acf7-111c487c041b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:58:52.133382 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.133243    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-home" (OuterVolumeSpecName: "home") pod "2e4ec205-1a92-4bdc-acf7-111c487c041b" (UID: "2e4ec205-1a92-4bdc-acf7-111c487c041b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:58:52.133382 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.133323    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-home\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:58:52.133382 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.133341    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-model-cache\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:58:52.133382 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.133351    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e4ec205-1a92-4bdc-acf7-111c487c041b" (UID: "2e4ec205-1a92-4bdc-acf7-111c487c041b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:58:52.134991 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.134971    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-dshm" (OuterVolumeSpecName: "dshm") pod "2e4ec205-1a92-4bdc-acf7-111c487c041b" (UID: "2e4ec205-1a92-4bdc-acf7-111c487c041b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 15:58:52.135061 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.135044    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e4ec205-1a92-4bdc-acf7-111c487c041b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e4ec205-1a92-4bdc-acf7-111c487c041b" (UID: "2e4ec205-1a92-4bdc-acf7-111c487c041b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 15:58:52.135146 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.135126    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e4ec205-1a92-4bdc-acf7-111c487c041b-kube-api-access-cjmwk" (OuterVolumeSpecName: "kube-api-access-cjmwk") pod "2e4ec205-1a92-4bdc-acf7-111c487c041b" (UID: "2e4ec205-1a92-4bdc-acf7-111c487c041b"). InnerVolumeSpecName "kube-api-access-cjmwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 15:58:52.234095 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.234057    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjmwk\" (UniqueName: \"kubernetes.io/projected/2e4ec205-1a92-4bdc-acf7-111c487c041b-kube-api-access-cjmwk\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:58:52.234095 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.234090    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-dshm\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:58:52.234095 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.234103    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4ec205-1a92-4bdc-acf7-111c487c041b-tls-certs\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:58:52.234334 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.234117    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e4ec205-1a92-4bdc-acf7-111c487c041b-tmp-dir\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 15:58:52.639128 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.639093    2582 generic.go:356] "Generic (PLEG): container finished" podID="2e4ec205-1a92-4bdc-acf7-111c487c041b" containerID="a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6" exitCode=0
Jul 17 15:58:52.639128 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.639130    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"
Jul 17 15:58:52.639351 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.639141    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh" event={"ID":"2e4ec205-1a92-4bdc-acf7-111c487c041b","Type":"ContainerDied","Data":"a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6"}
Jul 17 15:58:52.639351 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.639179    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh" event={"ID":"2e4ec205-1a92-4bdc-acf7-111c487c041b","Type":"ContainerDied","Data":"f69932def7f1aa44a0535ded972089dcef5cdd18e6001cf63e26f0eb9ea89e92"}
Jul 17 15:58:52.639351 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.639196    2582 scope.go:117] "RemoveContainer" containerID="a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6"
Jul 17 15:58:52.648470 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.648448    2582 scope.go:117] "RemoveContainer" containerID="a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6"
Jul 17 15:58:52.648755 ip-10-0-138-239 kubenswrapper[2582]: E0717 15:58:52.648726    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6\": container with ID starting with a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6 not found: ID does not exist" containerID="a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6"
Jul 17 15:58:52.648928 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.648771    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6"} err="failed to get container status \"a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6\": rpc error: code = NotFound desc = could not find container \"a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6\": container with ID starting with a0fdca6cd8d7dd85dabe3f6d211ede8c1ec45870666df7fbff005aba740cdaa6 not found: ID does not exist"
Jul 17 15:58:52.663000 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.662971    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"]
Jul 17 15:58:52.667463 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.667437    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-291633/sub-test-model-291633-kserve-5d9b47cf4c-64bkh"]
Jul 17 15:58:52.905058 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:58:52.904979    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e4ec205-1a92-4bdc-acf7-111c487c041b" path="/var/lib/kubelet/pods/2e4ec205-1a92-4bdc-acf7-111c487c041b/volumes"
Jul 17 15:59:00.246513 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:00.246459    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:59:00.247034 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:00.246544    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:59:00.262789 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:00.262753    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:59:00.412924 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:00.412884    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:59:00.690632 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:00.690546    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 15:59:16.641378 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:16.641340    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:59:21.299755 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:21.299716    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:59:26.418769 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:26.418705    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:59:35.501744 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:35.501706    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:59:41.850003 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:41.849960    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:59:41.950185 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:41.950148    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:59:44.011857 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:44.011823    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:59:45.458355 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:45.458319    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:59:45.559972 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:45.559940    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:59:48.638651 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:48.638617    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:59:48.735076 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:48.735046    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:59:51.154860 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:51.154816    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 15:59:58.851583 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:58.851545    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"]
Jul 17 15:59:58.876186 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:58.876152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 15:59:59.819053 ip-10-0-138-239 kubenswrapper[2582]: I0717 15:59:59.819016    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:00.143439 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.143354    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc"]
Jul 17 16:00:00.143797 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.143691    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e4ec205-1a92-4bdc-acf7-111c487c041b" containerName="main"
Jul 17 16:00:00.143797 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.143701    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e4ec205-1a92-4bdc-acf7-111c487c041b" containerName="main"
Jul 17 16:00:00.143797 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.143761    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e4ec205-1a92-4bdc-acf7-111c487c041b" containerName="main"
Jul 17 16:00:00.146469 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.146447    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp"]
Jul 17 16:00:00.146623 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.146590    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc"
Jul 17 16:00:00.149678 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.149654    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 16:00:00.149678 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.149673    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp"
Jul 17 16:00:00.160336 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.160308    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc"]
Jul 17 16:00:00.161056 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.161034    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc"
Jul 17 16:00:00.163244 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.163218    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp"]
Jul 17 16:00:00.168590 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.168562    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp"
Jul 17 16:00:00.308497 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.308466    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc"]
Jul 17 16:00:00.310467 ip-10-0-138-239 kubenswrapper[2582]: W0717 16:00:00.310437    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97647b0_57be_47ea_b121_fdfd17fc2eea.slice/crio-e69612f09553450ca0b00386ca92e7245f1ec14a2e8f6368888360c91a71f8ba WatchSource:0}: Error finding container e69612f09553450ca0b00386ca92e7245f1ec14a2e8f6368888360c91a71f8ba: Status 404 returned error can't find the container with id e69612f09553450ca0b00386ca92e7245f1ec14a2e8f6368888360c91a71f8ba
Jul 17 16:00:00.330317 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.330293    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp"]
Jul 17 16:00:00.331780 ip-10-0-138-239 kubenswrapper[2582]: W0717 16:00:00.331753    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36d9ece_621c_4717_aed1_10faad0124c4.slice/crio-c8925b3ec628e9a22ba07e6644b71498666b5b4aa04470c667255445918b5fd3 WatchSource:0}: Error finding container c8925b3ec628e9a22ba07e6644b71498666b5b4aa04470c667255445918b5fd3: Status 404 returned error can't find the container with id c8925b3ec628e9a22ba07e6644b71498666b5b4aa04470c667255445918b5fd3
Jul 17 16:00:00.970840 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.970733    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp" event={"ID":"e36d9ece-621c-4717-aed1-10faad0124c4","Type":"ContainerStarted","Data":"8b05481c419f1da85bcab9fe3da575d9a8a850e5a9d2bce2f74b73156153c3e4"}
Jul 17 16:00:00.970840 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.970793    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp" event={"ID":"e36d9ece-621c-4717-aed1-10faad0124c4","Type":"ContainerStarted","Data":"c8925b3ec628e9a22ba07e6644b71498666b5b4aa04470c667255445918b5fd3"}
Jul 17 16:00:00.972185 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.972163    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc" event={"ID":"d97647b0-57be-47ea-b121-fdfd17fc2eea","Type":"ContainerStarted","Data":"a1eabddc42664d80d4a22ea7e02b22ecd0ac0a47b8b3631ee42bf6ba0f6738a6"}
Jul 17 16:00:00.972293 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.972208    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc" event={"ID":"d97647b0-57be-47ea-b121-fdfd17fc2eea","Type":"ContainerStarted","Data":"e69612f09553450ca0b00386ca92e7245f1ec14a2e8f6368888360c91a71f8ba"}
Jul 17 16:00:00.987405 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:00.987286    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp" podStartSLOduration=0.987269562 podStartE2EDuration="987.269562ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:00:00.987231202 +0000 UTC m=+3052.651681307" watchObservedRunningTime="2026-07-17 16:00:00.987269562 +0000 UTC m=+3052.651719670"
Jul 17 16:00:01.003512 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:01.003469    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc" podStartSLOduration=1.003453477 podStartE2EDuration="1.003453477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:00:01.002212185 +0000 UTC m=+3052.666662292" watchObservedRunningTime="2026-07-17 16:00:01.003453477 +0000 UTC m=+3052.667903583"
Jul 17 16:00:01.977931 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:01.977894    2582 generic.go:356] "Generic (PLEG): container finished" podID="e36d9ece-621c-4717-aed1-10faad0124c4" containerID="8b05481c419f1da85bcab9fe3da575d9a8a850e5a9d2bce2f74b73156153c3e4" exitCode=0
Jul 17 16:00:01.978366 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:01.977984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp" event={"ID":"e36d9ece-621c-4717-aed1-10faad0124c4","Type":"ContainerDied","Data":"8b05481c419f1da85bcab9fe3da575d9a8a850e5a9d2bce2f74b73156153c3e4"}
Jul 17 16:00:01.979455 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:01.979431    2582 generic.go:356] "Generic (PLEG): container finished" podID="d97647b0-57be-47ea-b121-fdfd17fc2eea" containerID="a1eabddc42664d80d4a22ea7e02b22ecd0ac0a47b8b3631ee42bf6ba0f6738a6" exitCode=0
Jul 17 16:00:01.979564 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:01.979514    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc" event={"ID":"d97647b0-57be-47ea-b121-fdfd17fc2eea","Type":"ContainerDied","Data":"a1eabddc42664d80d4a22ea7e02b22ecd0ac0a47b8b3631ee42bf6ba0f6738a6"}
Jul 17 16:00:03.124882 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:03.124858    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc"
Jul 17 16:00:03.127816 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:03.127799    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp"
Jul 17 16:00:03.990471 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:03.990443    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp"
Jul 17 16:00:03.990701 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:03.990468    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp" event={"ID":"e36d9ece-621c-4717-aed1-10faad0124c4","Type":"ContainerDied","Data":"c8925b3ec628e9a22ba07e6644b71498666b5b4aa04470c667255445918b5fd3"}
Jul 17 16:00:03.990701 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:03.990513    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8925b3ec628e9a22ba07e6644b71498666b5b4aa04470c667255445918b5fd3"
Jul 17 16:00:03.991916 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:03.991890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc" event={"ID":"d97647b0-57be-47ea-b121-fdfd17fc2eea","Type":"ContainerDied","Data":"e69612f09553450ca0b00386ca92e7245f1ec14a2e8f6368888360c91a71f8ba"}
Jul 17 16:00:03.992025 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:03.991917    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc"
Jul 17 16:00:03.992025 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:03.991936    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e69612f09553450ca0b00386ca92e7245f1ec14a2e8f6368888360c91a71f8ba"
Jul 17 16:00:05.503027 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:05.502985    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 16:00:13.871742 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:13.871692    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc" podUID="99ee225e-1773-413b-abd2-6898a5f473e2" containerName="main" containerID="cri-o://697773f0f697e7cc3125740f4a8ec0db7761649357767bcbf9a5b035bb246e8d" gracePeriod=45
Jul 17 16:00:14.041267 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.041218    2582 generic.go:356] "Generic (PLEG): container finished" podID="99ee225e-1773-413b-abd2-6898a5f473e2" containerID="697773f0f697e7cc3125740f4a8ec0db7761649357767bcbf9a5b035bb246e8d" exitCode=0
Jul 17 16:00:14.041434 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.041401    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc" event={"ID":"99ee225e-1773-413b-abd2-6898a5f473e2","Type":"ContainerDied","Data":"697773f0f697e7cc3125740f4a8ec0db7761649357767bcbf9a5b035bb246e8d"}
Jul 17 16:00:14.124405 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.124336    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 16:00:14.215113 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.215078    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-home\") pod \"99ee225e-1773-413b-abd2-6898a5f473e2\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") "
Jul 17 16:00:14.215315 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.215169    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-tmp-dir\") pod \"99ee225e-1773-413b-abd2-6898a5f473e2\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") "
Jul 17 16:00:14.215315 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.215197    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnrbp\" (UniqueName: \"kubernetes.io/projected/99ee225e-1773-413b-abd2-6898a5f473e2-kube-api-access-wnrbp\") pod \"99ee225e-1773-413b-abd2-6898a5f473e2\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") "
Jul 17 16:00:14.215315 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.215248    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99ee225e-1773-413b-abd2-6898a5f473e2-tls-certs\") pod \"99ee225e-1773-413b-abd2-6898a5f473e2\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") "
Jul 17 16:00:14.215315 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.215273    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-model-cache\") pod \"99ee225e-1773-413b-abd2-6898a5f473e2\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") "
Jul 17 16:00:14.215315 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.215303    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-dshm\") pod \"99ee225e-1773-413b-abd2-6898a5f473e2\" (UID: \"99ee225e-1773-413b-abd2-6898a5f473e2\") "
Jul 17 16:00:14.215571 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.215356    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-home" (OuterVolumeSpecName: "home") pod "99ee225e-1773-413b-abd2-6898a5f473e2" (UID: "99ee225e-1773-413b-abd2-6898a5f473e2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:00:14.215571 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.215450    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "99ee225e-1773-413b-abd2-6898a5f473e2" (UID: "99ee225e-1773-413b-abd2-6898a5f473e2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:00:14.215642 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.215579    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-home\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 16:00:14.215642 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.215597    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-tmp-dir\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 16:00:14.215642 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.215571    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-model-cache" (OuterVolumeSpecName: "model-cache") pod "99ee225e-1773-413b-abd2-6898a5f473e2" (UID: "99ee225e-1773-413b-abd2-6898a5f473e2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:00:14.217417 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.217396    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-dshm" (OuterVolumeSpecName: "dshm") pod "99ee225e-1773-413b-abd2-6898a5f473e2" (UID: "99ee225e-1773-413b-abd2-6898a5f473e2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:00:14.217515 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.217439    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ee225e-1773-413b-abd2-6898a5f473e2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "99ee225e-1773-413b-abd2-6898a5f473e2" (UID: "99ee225e-1773-413b-abd2-6898a5f473e2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:00:14.217515 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.217483    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99ee225e-1773-413b-abd2-6898a5f473e2-kube-api-access-wnrbp" (OuterVolumeSpecName: "kube-api-access-wnrbp") pod "99ee225e-1773-413b-abd2-6898a5f473e2" (UID: "99ee225e-1773-413b-abd2-6898a5f473e2"). InnerVolumeSpecName "kube-api-access-wnrbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:00:14.316885 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.316828    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnrbp\" (UniqueName: \"kubernetes.io/projected/99ee225e-1773-413b-abd2-6898a5f473e2-kube-api-access-wnrbp\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 16:00:14.316885 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.316885    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99ee225e-1773-413b-abd2-6898a5f473e2-tls-certs\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 16:00:14.317083 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.316900    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-model-cache\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 16:00:14.317083 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:14.316912    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99ee225e-1773-413b-abd2-6898a5f473e2-dshm\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 16:00:15.047039 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:15.046990    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"
Jul 17 16:00:15.047039 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:15.047014    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc" event={"ID":"99ee225e-1773-413b-abd2-6898a5f473e2","Type":"ContainerDied","Data":"9ad110f232f75154c1e0d362695dec86c2031e43e7e74c2b745ea9ea13cf4794"}
Jul 17 16:00:15.047568 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:15.047075    2582 scope.go:117] "RemoveContainer" containerID="697773f0f697e7cc3125740f4a8ec0db7761649357767bcbf9a5b035bb246e8d"
Jul 17 16:00:15.069942 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:15.069905    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"]
Jul 17 16:00:15.073897 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:15.073869    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-291633/rate-test-model-291633-kserve-588f6fff7f-dxztc"]
Jul 17 16:00:16.903705 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:16.903668    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99ee225e-1773-413b-abd2-6898a5f473e2" path="/var/lib/kubelet/pods/99ee225e-1773-413b-abd2-6898a5f473e2/volumes"
Jul 17 16:00:19.853992 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.853953    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp"]
Jul 17 16:00:19.854382 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.854285    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e36d9ece-621c-4717-aed1-10faad0124c4" containerName="cleanup"
Jul 17 16:00:19.854382 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.854296    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36d9ece-621c-4717-aed1-10faad0124c4" containerName="cleanup"
Jul 17 16:00:19.854382 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.854317    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ee225e-1773-413b-abd2-6898a5f473e2" containerName="main"
Jul 17 16:00:19.854382 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.854325    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ee225e-1773-413b-abd2-6898a5f473e2" containerName="main"
Jul 17 16:00:19.854382 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.854336    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d97647b0-57be-47ea-b121-fdfd17fc2eea" containerName="cleanup"
Jul 17 16:00:19.854382 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.854341    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d97647b0-57be-47ea-b121-fdfd17fc2eea" containerName="cleanup"
Jul 17 16:00:19.854574 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.854402    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e36d9ece-621c-4717-aed1-10faad0124c4" containerName="cleanup"
Jul 17 16:00:19.854574 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.854411    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="99ee225e-1773-413b-abd2-6898a5f473e2" containerName="main"
Jul 17 16:00:19.854574 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.854417    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d97647b0-57be-47ea-b121-fdfd17fc2eea" containerName="cleanup"
Jul 17 16:00:19.857389 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.857370    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp"
Jul 17 16:00:19.860156 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.860139    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 16:00:19.860241 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.860176    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 16:00:19.865491 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.865467    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp"]
Jul 17 16:00:19.963567 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:19.963529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b24eb7-f0e5-45a4-abb6-65203969a799-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-291633-zflmp\" (UID: \"c4b24eb7-f0e5-45a4-abb6-65203969a799\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp"
Jul 17 16:00:20.064370 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:20.064330    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b24eb7-f0e5-45a4-abb6-65203969a799-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-291633-zflmp\" (UID: \"c4b24eb7-f0e5-45a4-abb6-65203969a799\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp"
Jul 17 16:00:20.065025 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:20.065004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b24eb7-f0e5-45a4-abb6-65203969a799-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-291633-zflmp\" (UID: \"c4b24eb7-f0e5-45a4-abb6-65203969a799\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp"
Jul 17 16:00:20.169011 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:20.168920    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp"
Jul 17 16:00:20.304380 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:20.304353    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp"]
Jul 17 16:00:20.306325 ip-10-0-138-239 kubenswrapper[2582]: W0717 16:00:20.306300    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b24eb7_f0e5_45a4_abb6_65203969a799.slice/crio-90aa8f45d566890fbd69ba9e96ab86f0f9c3672c6cc3ae78b29a547b5cf03a9e WatchSource:0}: Error finding container 90aa8f45d566890fbd69ba9e96ab86f0f9c3672c6cc3ae78b29a547b5cf03a9e: Status 404 returned error can't find the container with id 90aa8f45d566890fbd69ba9e96ab86f0f9c3672c6cc3ae78b29a547b5cf03a9e
Jul 17 16:00:20.395756 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:20.395722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:20.501657 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:20.501622    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:21.077409 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:21.077374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp" event={"ID":"c4b24eb7-f0e5-45a4-abb6-65203969a799","Type":"ContainerStarted","Data":"e160319748806bcf5cdeea5119a94f5bec53a7c4dac534b66a41c415ec49dc8c"}
Jul 17 16:00:21.077806 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:21.077426    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp" event={"ID":"c4b24eb7-f0e5-45a4-abb6-65203969a799","Type":"ContainerStarted","Data":"90aa8f45d566890fbd69ba9e96ab86f0f9c3672c6cc3ae78b29a547b5cf03a9e"}
Jul 17 16:00:21.094841 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:21.094797    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp" podStartSLOduration=2.094783581 podStartE2EDuration="2.094783581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:00:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:00:21.093527735 +0000 UTC m=+3072.757977841" watchObservedRunningTime="2026-07-17 16:00:21.094783581 +0000 UTC m=+3072.759233686"
Jul 17 16:00:22.083419 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:22.083386    2582 generic.go:356] "Generic (PLEG): container finished" podID="c4b24eb7-f0e5-45a4-abb6-65203969a799" containerID="e160319748806bcf5cdeea5119a94f5bec53a7c4dac534b66a41c415ec49dc8c" exitCode=0
Jul 17 16:00:22.083819 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:22.083431    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp" event={"ID":"c4b24eb7-f0e5-45a4-abb6-65203969a799","Type":"ContainerDied","Data":"e160319748806bcf5cdeea5119a94f5bec53a7c4dac534b66a41c415ec49dc8c"}
Jul 17 16:00:23.219868 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:23.219821    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp"
Jul 17 16:00:23.293038 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:23.293000    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b24eb7-f0e5-45a4-abb6-65203969a799-maas-api-service-ca\") pod \"c4b24eb7-f0e5-45a4-abb6-65203969a799\" (UID: \"c4b24eb7-f0e5-45a4-abb6-65203969a799\") "
Jul 17 16:00:23.293398 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:23.293368    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b24eb7-f0e5-45a4-abb6-65203969a799-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c4b24eb7-f0e5-45a4-abb6-65203969a799" (UID: "c4b24eb7-f0e5-45a4-abb6-65203969a799"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 16:00:23.393720 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:23.393634    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4b24eb7-f0e5-45a4-abb6-65203969a799-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 16:00:24.099159 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:24.099131    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp"
Jul 17 16:00:24.099159 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:24.099142    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-291633-zflmp" event={"ID":"c4b24eb7-f0e5-45a4-abb6-65203969a799","Type":"ContainerDied","Data":"90aa8f45d566890fbd69ba9e96ab86f0f9c3672c6cc3ae78b29a547b5cf03a9e"}
Jul 17 16:00:24.099379 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:24.099212    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90aa8f45d566890fbd69ba9e96ab86f0f9c3672c6cc3ae78b29a547b5cf03a9e"
Jul 17 16:00:30.478253 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:30.478220    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp"]
Jul 17 16:00:30.478629 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:30.478460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:30.481579 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:30.481555    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-291633-29738400-8d8hp"]
Jul 17 16:00:30.904356 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:30.904323    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e36d9ece-621c-4717-aed1-10faad0124c4" path="/var/lib/kubelet/pods/e36d9ece-621c-4717-aed1-10faad0124c4/volumes"
Jul 17 16:00:34.500800 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:34.500755    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 16:00:34.967532 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:34.967444    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:41.923707 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:41.923659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:41.993927 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:41.993892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:45.763017 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:45.762981    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:45.994792 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:45.994748    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:46.114555 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.114473    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v"]
Jul 17 16:00:46.114791 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.114779    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b24eb7-f0e5-45a4-abb6-65203969a799" containerName="revoke-keys"
Jul 17 16:00:46.114840 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.114792    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b24eb7-f0e5-45a4-abb6-65203969a799" containerName="revoke-keys"
Jul 17 16:00:46.114903 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.114881    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b24eb7-f0e5-45a4-abb6-65203969a799" containerName="revoke-keys"
Jul 17 16:00:46.118902 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.118881    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v"
Jul 17 16:00:46.121566 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.121545    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 16:00:46.121676 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.121606    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bkrmx\""
Jul 17 16:00:46.127173 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.127152    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v"]
Jul 17 16:00:46.180704 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.180666    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df62147-9565-4c87-b6dd-70135c38cde2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v\" (UID: \"9df62147-9565-4c87-b6dd-70135c38cde2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v"
Jul 17 16:00:46.281441 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.281397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df62147-9565-4c87-b6dd-70135c38cde2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v\" (UID: \"9df62147-9565-4c87-b6dd-70135c38cde2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v"
Jul 17 16:00:46.282068 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.282042    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df62147-9565-4c87-b6dd-70135c38cde2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v\" (UID: \"9df62147-9565-4c87-b6dd-70135c38cde2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v"
Jul 17 16:00:46.431301 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.431206    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v"
Jul 17 16:00:46.570032 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.570003    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v"]
Jul 17 16:00:46.571562 ip-10-0-138-239 kubenswrapper[2582]: W0717 16:00:46.571527    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df62147_9565_4c87_b6dd_70135c38cde2.slice/crio-139091326b1a15b0f128c55662c3f00f9d162d8efdc058cab1889de74348a73f WatchSource:0}: Error finding container 139091326b1a15b0f128c55662c3f00f9d162d8efdc058cab1889de74348a73f: Status 404 returned error can't find the container with id 139091326b1a15b0f128c55662c3f00f9d162d8efdc058cab1889de74348a73f
Jul 17 16:00:46.655378 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.655344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:46.755823 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:46.755770    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:47.212892 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:47.212785    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v" event={"ID":"9df62147-9565-4c87-b6dd-70135c38cde2","Type":"ContainerStarted","Data":"0e2a7f66f03fe1799809b33ff9f54006b967901479c277ebdb0c2aa4b2dc21bd"}
Jul 17 16:00:47.212892 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:47.212859    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v" event={"ID":"9df62147-9565-4c87-b6dd-70135c38cde2","Type":"ContainerStarted","Data":"139091326b1a15b0f128c55662c3f00f9d162d8efdc058cab1889de74348a73f"}
Jul 17 16:00:47.233196 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:47.233142    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v" podStartSLOduration=1.233126664 podStartE2EDuration="1.233126664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:00:47.230310402 +0000 UTC m=+3098.894760518" watchObservedRunningTime="2026-07-17 16:00:47.233126664 +0000 UTC m=+3098.897576769"
Jul 17 16:00:48.219167 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:48.219132    2582 generic.go:356] "Generic (PLEG): container finished" podID="9df62147-9565-4c87-b6dd-70135c38cde2" containerID="0e2a7f66f03fe1799809b33ff9f54006b967901479c277ebdb0c2aa4b2dc21bd" exitCode=0
Jul 17 16:00:48.219583 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:48.219226    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v" event={"ID":"9df62147-9565-4c87-b6dd-70135c38cde2","Type":"ContainerDied","Data":"0e2a7f66f03fe1799809b33ff9f54006b967901479c277ebdb0c2aa4b2dc21bd"}
Jul 17 16:00:49.353670 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:49.353644    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v"
Jul 17 16:00:49.406375 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:49.406342    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df62147-9565-4c87-b6dd-70135c38cde2-maas-api-service-ca\") pod \"9df62147-9565-4c87-b6dd-70135c38cde2\" (UID: \"9df62147-9565-4c87-b6dd-70135c38cde2\") "
Jul 17 16:00:49.406658 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:49.406637    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9df62147-9565-4c87-b6dd-70135c38cde2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9df62147-9565-4c87-b6dd-70135c38cde2" (UID: "9df62147-9565-4c87-b6dd-70135c38cde2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 16:00:49.507084 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:49.507047    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df62147-9565-4c87-b6dd-70135c38cde2-maas-api-service-ca\") on node \"ip-10-0-138-239.ec2.internal\" DevicePath \"\""
Jul 17 16:00:50.229995 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:50.229959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v" event={"ID":"9df62147-9565-4c87-b6dd-70135c38cde2","Type":"ContainerDied","Data":"139091326b1a15b0f128c55662c3f00f9d162d8efdc058cab1889de74348a73f"}
Jul 17 16:00:50.230174 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:50.230008    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="139091326b1a15b0f128c55662c3f00f9d162d8efdc058cab1889de74348a73f"
Jul 17 16:00:50.230174 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:50.229974    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v"
Jul 17 16:00:56.709212 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:56.709169    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:00:56.719817 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:56.719782    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc"]
Jul 17 16:00:56.723039 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:56.723016    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f65ca6-29738400-wm7cc"]
Jul 17 16:00:56.903349 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:56.903309    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d97647b0-57be-47ea-b121-fdfd17fc2eea" path="/var/lib/kubelet/pods/d97647b0-57be-47ea-b121-fdfd17fc2eea/volumes"
Jul 17 16:00:59.501833 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:00:59.501796    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7tbx7"]
Jul 17 16:01:01.201756 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:01.201715    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:01:08.138160 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:08.138125    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:01:08.202190 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:08.202157    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:01:10.801443 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:10.801410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:01:10.864213 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:10.864177    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:01:11.907417 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:11.907380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:01:12.143679 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:12.143645    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:01:17.955356 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:17.955325    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ftpfd_be2edea6-69ac-4d1c-b91a-8e222d7cb7d5/manager/0.log"
Jul 17 16:01:18.086743 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:18.086713    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2pn4s_1a46bc35-85b8-4794-824b-7712a8b40fe7/manager/0.log"
Jul 17 16:01:18.313966 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:18.313933    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-68pzl_eaaf47bd-cf34-4110-a478-918dd4d56231/server/0.log"
Jul 17 16:01:18.428726 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:18.428690    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9xfc5_95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3/manager/0.log"
Jul 17 16:01:18.661020 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:18.660937    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb95c7566-hjjvf_a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a/copy-manifests/0.log"
Jul 17 16:01:18.674768 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:18.674739    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb95c7566-hjjvf_a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a/manager/0.log"
Jul 17 16:01:19.274324 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:19.274297    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29738370-g48d6_50364f71-6b78-4784-b06e-962c902d6cb3/cleanup/0.log"
Jul 17 16:01:19.385408 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:19.385380    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29738385-7xjm2_7b2ddea8-bbf1-4ec9-82af-ddf01b967705/cleanup/0.log"
Jul 17 16:01:19.598312 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:19.598229    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-f54d84-x92k7_8817d769-4a9a-4718-999c-7027d2b8ed97/revoke-keys/0.log"
Jul 17 16:01:19.717806 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:19.717774    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-f159e6-2zj2q_e0dc2338-e0c3-4436-b818-070813e13e13/revoke-keys/0.log"
Jul 17 16:01:19.827898 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:19.827867    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-f93829-227v6_173dbef7-25c4-49c7-af4e-b6d7f48a0177/revoke-keys/0.log"
Jul 17 16:01:19.940387 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:19.940301    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-1e887c-9jvrm_0baaa22c-869e-464d-a64d-a83025a6ab1d/revoke-keys/0.log"
Jul 17 16:01:20.055613 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:20.055587    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-25e005e0-7fpvm_e92e8924-3513-4a46-b14a-40aa86a8ba93/revoke-keys/0.log"
Jul 17 16:01:20.165169 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:20.165134    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-bf62e094-dqm5z_79c37883-87ce-4e90-8f20-11404dec0dcf/revoke-keys/0.log"
Jul 17 16:01:20.290530 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:20.290507    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-291633-zflmp_c4b24eb7-f0e5-45a4-abb6-65203969a799/revoke-keys/0.log"
Jul 17 16:01:20.405427 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:20.405399    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-f65ca6-vwd2v_9df62147-9565-4c87-b6dd-70135c38cde2/revoke-keys/0.log"
Jul 17 16:01:22.066446 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:22.066397    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fflnb_aab4c7e8-41e6-4e6e-b8aa-0d1c1467bc90/manager/0.log"
Jul 17 16:01:22.428390 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:22.428293    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-p4tmk_d8da98df-0056-4040-a186-79938f996c2b/manager/0.log"
Jul 17 16:01:22.543466 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:22.543434    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7tbx7_5f86885d-b856-42ff-b1de-85dccf857c37/limitador/0.log"
Jul 17 16:01:23.135188 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:23.135161    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s6f84_ca775dad-164f-4530-9c7b-f95adf410803/discovery/0.log"
Jul 17 16:01:23.250645 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:23.250589    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c457bb55-vszsf_d3581556-2089-4836-a5a5-12032ba35eea/kube-auth-proxy/0.log"
Jul 17 16:01:24.551905 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:24.551872    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv8w78_98ab0e06-0907-45a6-85cf-21bc2caa1424/main/0.log"
Jul 17 16:01:30.103214 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:30.103162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:01:30.179502 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:30.179468    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:01:30.583112 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:30.583077    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:01:30.684167 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:30.684137    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log" limit=1024
Jul 17 16:01:33.139122 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:33.139079    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pqp8d_cbfa4901-322d-4bf9-a3a2-d17f7fbf23e8/global-pull-secret-syncer/0.log"
Jul 17 16:01:33.291325 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:33.291295    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dbmhn_0758be33-496e-4076-a0ea-0aa599cd3acc/konnectivity-agent/0.log"
Jul 17 16:01:33.418833 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:33.418746    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-239.ec2.internal_2f114662f8c568f2e1d8877c1f328796/haproxy/0.log"
Jul 17 16:01:38.527014 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:38.526966    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fflnb_aab4c7e8-41e6-4e6e-b8aa-0d1c1467bc90/manager/0.log"
Jul 17 16:01:38.719268 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:38.719236    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-p4tmk_d8da98df-0056-4040-a186-79938f996c2b/manager/0.log"
Jul 17 16:01:38.796317 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:38.796243    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7tbx7_5f86885d-b856-42ff-b1de-85dccf857c37/limitador/0.log"
Jul 17 16:01:41.128040 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:41.128008    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8vs4_9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630/node-exporter/0.log"
Jul 17 16:01:41.158048 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:41.158015    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8vs4_9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630/kube-rbac-proxy/0.log"
Jul 17 16:01:41.186908 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:41.186884    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8vs4_9f1fbe6b-bc5e-480d-a86f-6c2d01dd7630/init-textfile/0.log"
Jul 17 16:01:43.210952 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:43.210925    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-qgqnl_b3259bdf-a344-4624-bf7f-957e6d70543a/networking-console-plugin/0.log"
Jul 17 16:01:43.885958 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:43.885924    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"]
Jul 17 16:01:43.886358 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:43.886339    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df62147-9565-4c87-b6dd-70135c38cde2" containerName="revoke-keys"
Jul 17 16:01:43.886513 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:43.886361    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df62147-9565-4c87-b6dd-70135c38cde2" containerName="revoke-keys"
Jul 17 16:01:43.886513 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:43.886431    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df62147-9565-4c87-b6dd-70135c38cde2" containerName="revoke-keys"
Jul 17 16:01:43.889558 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:43.889534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:43.892371 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:43.892341    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fvc44\"/\"openshift-service-ca.crt\""
Jul 17 16:01:43.893483 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:43.893468    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fvc44\"/\"kube-root-ca.crt\""
Jul 17 16:01:43.893596 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:43.893470    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fvc44\"/\"default-dockercfg-txbgf\""
Jul 17 16:01:43.915572 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:43.915534    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"]
Jul 17 16:01:44.064647 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.064614    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-proc\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.064836 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.064661    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-podres\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.064836 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.064746    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-sys\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.064836 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.064770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-lib-modules\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.064836 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.064795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7rqg\" (UniqueName: \"kubernetes.io/projected/eb9536ac-4a24-44bc-9a98-e3b70850d80a-kube-api-access-t7rqg\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.165461 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.165360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-sys\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.165461 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.165401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-lib-modules\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.165461 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.165424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7rqg\" (UniqueName: \"kubernetes.io/projected/eb9536ac-4a24-44bc-9a98-e3b70850d80a-kube-api-access-t7rqg\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.165711 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.165457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-proc\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.165711 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.165502    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-sys\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.165711 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.165529    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-podres\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.165711 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.165534    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-lib-modules\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.165711 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.165568    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-proc\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.165711 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.165666    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb9536ac-4a24-44bc-9a98-e3b70850d80a-podres\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.174798 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.174773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7rqg\" (UniqueName: \"kubernetes.io/projected/eb9536ac-4a24-44bc-9a98-e3b70850d80a-kube-api-access-t7rqg\") pod \"perf-node-gather-daemonset-qh9zn\" (UID: \"eb9536ac-4a24-44bc-9a98-e3b70850d80a\") " pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.199291 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.199266    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.336240 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.336203    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"]
Jul 17 16:01:44.337182 ip-10-0-138-239 kubenswrapper[2582]: W0717 16:01:44.337153    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeb9536ac_4a24_44bc_9a98_e3b70850d80a.slice/crio-af55c7dad2c4ee81069b1fde1ad0588cc005b0713bd63465d645d22c2eea6164 WatchSource:0}: Error finding container af55c7dad2c4ee81069b1fde1ad0588cc005b0713bd63465d645d22c2eea6164: Status 404 returned error can't find the container with id af55c7dad2c4ee81069b1fde1ad0588cc005b0713bd63465d645d22c2eea6164
Jul 17 16:01:44.488880 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.488831    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn" event={"ID":"eb9536ac-4a24-44bc-9a98-e3b70850d80a","Type":"ContainerStarted","Data":"e3c9d5cce4b844ba9c840b33e41f1f100790a497cc7ed032c0d8c0e104925f2a"}
Jul 17 16:01:44.489027 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.488897    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn" event={"ID":"eb9536ac-4a24-44bc-9a98-e3b70850d80a","Type":"ContainerStarted","Data":"af55c7dad2c4ee81069b1fde1ad0588cc005b0713bd63465d645d22c2eea6164"}
Jul 17 16:01:44.489027 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.488931    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:44.534979 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:44.534936    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn" podStartSLOduration=1.534920333 podStartE2EDuration="1.534920333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:01:44.533491361 +0000 UTC m=+3156.197941466" watchObservedRunningTime="2026-07-17 16:01:44.534920333 +0000 UTC m=+3156.199370472"
Jul 17 16:01:46.518437 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:46.518409    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2wgw_50c7fa37-6581-4c75-9081-eca174cc2681/dns/0.log"
Jul 17 16:01:46.558370 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:46.558344    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2wgw_50c7fa37-6581-4c75-9081-eca174cc2681/kube-rbac-proxy/0.log"
Jul 17 16:01:46.732126 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:46.732099    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jqm97_21493365-4d8d-4699-967a-59fefc50cc48/dns-node-resolver/0.log"
Jul 17 16:01:47.477587 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:47.477559    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ml224_6f5da215-d35b-40d3-a7e8-04073e6510e7/node-ca/0.log"
Jul 17 16:01:48.681037 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:48.681006    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s6f84_ca775dad-164f-4530-9c7b-f95adf410803/discovery/0.log"
Jul 17 16:01:48.706252 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:48.706228    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c457bb55-vszsf_d3581556-2089-4836-a5a5-12032ba35eea/kube-auth-proxy/0.log"
Jul 17 16:01:49.677320 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:49.677289    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ph9b2_2ed94aac-788d-4c4e-9e41-22c864979f4b/serve-healthcheck-canary/0.log"
Jul 17 16:01:50.253263 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:50.253233    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nldf_d1731595-b5af-4867-8aa9-2fc220ff1a51/kube-rbac-proxy/0.log"
Jul 17 16:01:50.281961 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:50.281930    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nldf_d1731595-b5af-4867-8aa9-2fc220ff1a51/exporter/0.log"
Jul 17 16:01:50.316271 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:50.316245    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nldf_d1731595-b5af-4867-8aa9-2fc220ff1a51/extractor/0.log"
Jul 17 16:01:50.505039 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:50.504972    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fvc44/perf-node-gather-daemonset-qh9zn"
Jul 17 16:01:52.957296 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:52.957267    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ftpfd_be2edea6-69ac-4d1c-b91a-8e222d7cb7d5/manager/0.log"
Jul 17 16:01:53.094176 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:53.094152    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2pn4s_1a46bc35-85b8-4794-824b-7712a8b40fe7/manager/0.log"
Jul 17 16:01:53.230087 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:53.230057    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-68pzl_eaaf47bd-cf34-4110-a478-918dd4d56231/server/0.log"
Jul 17 16:01:53.308735 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:53.308693    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9xfc5_95bc5d2a-890a-4ebb-b55a-9a2fedbc4ac3/manager/0.log"
Jul 17 16:01:53.504369 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:53.504344    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb95c7566-hjjvf_a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a/manager/0.log"
Jul 17 16:01:53.526408 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:53.526383    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb95c7566-hjjvf_a53b60f2-cc62-4d81-8ce0-4a8a1e3caf1a/copy-manifests/0.log"
Jul 17 16:01:54.636496 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:54.636462    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s6f84_ca775dad-164f-4530-9c7b-f95adf410803/discovery/0.log"
Jul 17 16:01:54.647351 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:54.647325    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c457bb55-vszsf_d3581556-2089-4836-a5a5-12032ba35eea/kube-auth-proxy/0.log"
Jul 17 16:01:55.049060 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:55.049033    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lpmzw_d54ec3df-8d14-4038-822e-b05e3c3b1dcb/openshift-lws-operator/0.log"
Jul 17 16:01:56.220982 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:56.220951    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s6f84_ca775dad-164f-4530-9c7b-f95adf410803/discovery/0.log"
Jul 17 16:01:56.234170 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:01:56.234145    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77c457bb55-vszsf_d3581556-2089-4836-a5a5-12032ba35eea/kube-auth-proxy/0.log"
Jul 17 16:02:00.358181 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:02:00.358152    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-mrdcd_9281490b-5e58-4901-9883-fbda88af0e75/migrator/0.log"
Jul 17 16:02:00.387091 ip-10-0-138-239 kubenswrapper[2582]: I0717 16:02:00.387062    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-mrdcd_9281490b-5e58-4901-9883-fbda88af0e75/graceful-termination/0.log"