Jul 17 09:16:20.634702 ip-10-0-131-131 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 09:16:20.634718 ip-10-0-131-131 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 09:16:20.634728 ip-10-0-131-131 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 09:16:20.635199 ip-10-0-131-131 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 09:16:30.809004 ip-10-0-131-131 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 17 09:16:30.809019 ip-10-0-131-131 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a1aca1983c7d49bbaa42336334c3f0b0 --
Jul 17 09:17:59.361168 ip-10-0-131-131 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.801258    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808388    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808401    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808405    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808409    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808412    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808415    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808418    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 09:17:59.832049 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808421    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808424    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808426    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808438    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808441    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808444    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808447    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808450    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808452    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808455    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808457    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808461    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808465    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808469    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808472    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808476    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808478    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808481    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808484    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808487    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 09:17:59.834499 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808490    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808493    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808496    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808499    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808501    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808504    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808506    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808509    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808512    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808514    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808517    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808519    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808522    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808525    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808528    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808531    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808534    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808538    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808542    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 09:17:59.836761 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808545    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808548    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808551    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808554    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808557    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808559    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808563    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808566    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808569    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808571    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808574    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808577    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808579    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808582    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808586    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808588    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808592    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808595    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808597    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 09:17:59.850226 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808600    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808603    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808605    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808608    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808611    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808613    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808616    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808619    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808622    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808624    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808628    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808631    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808633    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808636    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808639    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808642    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808644    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808647    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808649    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 09:17:59.852385 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808653    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808657    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808660    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808663    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808666    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808668    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808672    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808675    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808678    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808680    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808684    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808687    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808689    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808692    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.808695    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809442    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809449    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809454    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809457    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809460    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 09:17:59.854482 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809471    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809474    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809477    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809480    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809482    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809485    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809488    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809491    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809494    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809496    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809499    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809501    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809504    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809507    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809509    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809512    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809514    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809517    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809519    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809522    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 09:17:59.856925 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809525    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809527    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809530    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809533    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809536    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809538    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809541    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809544    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809546    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809549    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809552    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809555    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809557    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809562    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809567    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809571    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809573    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809576    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809579    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 09:17:59.870184 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809582    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809586    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809590    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809593    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809595    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809598    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809600    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809604    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809606    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809609    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809612    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809614    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809617    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809621    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809624    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809627    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809632    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809636    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809639    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 09:17:59.872451 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809642    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809644    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809647    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809650    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809653    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809655    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809658    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809661    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809664    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809667    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809670    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809673    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809675    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809678    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809681    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809683    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809686    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809689    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809691    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809694    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 09:17:59.874206 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809696    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809699    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809701    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809704    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809707    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809709    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809712    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809716    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809719    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809723    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809726    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809728    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809731    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809734    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809737    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.809740    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810164    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810170    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810174    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810177    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 09:17:59.876586 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810180    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810183    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810186    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810190    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810192    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810195    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810198    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810201    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810204    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810206    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810209    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810212    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810214    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810217    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810220    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810223    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810225    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810228    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810230    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810233    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 09:17:59.890301 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810236    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 09:17:59.886484 ip-10-0-131-131 systemd[1]: Started Kubernetes Kubelet.
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810240    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810243    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810245    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810248    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810253    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810256    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810258    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810261    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810263    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810266    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810269    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810271    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810274    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810277    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810279    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810282    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810285    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810287    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810290    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 09:17:59.892920 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810292    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810295    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810298    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810300    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810302    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810307    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810311    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810315    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810317    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810320    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810322    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810325    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810328    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810331    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810334    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810337    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810339    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810343    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810346    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810349    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 09:17:59.906536 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810351    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810354    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810357    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810359    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810362    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810364    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810367    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810370    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810372    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810375    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810378    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810380    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810383    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810385    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810388    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810390    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810393    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810396    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810398    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 09:17:59.909916 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810401    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810405    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810409    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810412    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810415    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810417    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810423    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810427    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810430    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810432    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810436    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810439    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810441    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810444    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810447    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.810449    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810514    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810521    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810528    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810534    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 09:17:59.922322 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810541    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810546    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810552    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810558    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810564    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810567    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810571    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810574    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810577    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810580    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810583    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810586    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810588    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810591    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810596    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810598    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810602    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810605    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810609    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810613    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810616    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810619    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810624    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810627    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 09:17:59.925580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810630    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810633    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810637    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810640    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810644    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810647    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810650    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810654    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810657    2560 flags.go:64] FLAG: --enable-server="true"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810660    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810665    2560 flags.go:64] FLAG: --event-burst="100"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810669    2560 flags.go:64] FLAG: --event-qps="50"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810672    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810675    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810678    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810682    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810685    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810689    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810691    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810694    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810697    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810700    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810703    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810706    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810709    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 09:17:59.938320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810712    2560 flags.go:64] FLAG: --feature-gates=""
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810717    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810721    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810724    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810727    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810731    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810734    2560 flags.go:64] FLAG: --help="false"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810738    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-131-131.ec2.internal"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810741    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810744    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810747    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810750    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810754    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810757    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810760    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810763    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810766    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810769    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810772    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810775    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810778    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810781    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810784    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810787    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 09:17:59.941524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810790    2560 flags.go:64] FLAG: --lock-file=""
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810793    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810795    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810798    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810804    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810806    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810809    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810812    2560 flags.go:64] FLAG: --logging-format="text"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810815    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810820    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810823    2560 flags.go:64] FLAG: --manifest-url=""
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810826    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810830    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810849    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810853    2560 flags.go:64] FLAG: --max-pods="110"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810856    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810859    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810862    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810865    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810868    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810871    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810874    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810882    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810885    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810888    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 09:18:00.131575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810891    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810895    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810900    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810903    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810906    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810909    2560 flags.go:64] FLAG: --port="10250"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810912    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810915    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04c7b0bb6cf6561cb"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810918    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810921    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810924    2560 flags.go:64] FLAG: --register-node="true"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810927    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810931    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810934    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810937    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810940    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810943    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810949    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810952    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810955    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810959    2560 flags.go:64] FLAG: --runonce="false"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810962    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810965    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810968    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810971    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 09:18:00.134560 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810974    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810977    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810980    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810983    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810986    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810989    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810992    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810995    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.810998    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811002    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811004    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811010    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811013    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811016    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811020    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811023    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811026    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811029    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811032    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811035    2560 flags.go:64] FLAG: --v="2"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811039    2560 flags.go:64] FLAG: --version="false"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811043    2560 flags.go:64] FLAG: --vmodule=""
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811046    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.811050    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811183    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 09:18:00.142625 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811188    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811191    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811197    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811200    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811203    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811206    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811209    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811212    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811215    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811218    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811221    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811224    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811227    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811230    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811233    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811235    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811240    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811244    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811247    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811250    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 09:18:00.143400 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811253    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811255    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811258    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811260    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811263    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811266    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811268    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811271    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811274    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811276    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811279    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811284    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811286    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811289    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811293    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811296    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811300    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811303    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811306    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 09:18:00.143989 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811308    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811312    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811316    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811319    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811322    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811324    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811327    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811330    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811334    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811337    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811339    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811343    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811346    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811349    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811351    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811354    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811356    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811359    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811362    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811364    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 09:18:00.144557 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811367    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811369    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811372    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811374    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811378    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811381    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811384    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811388    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811391    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811394    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811396    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811399    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811401    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811404    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811407    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811409    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811412    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811414    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811417    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811419    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 09:18:00.145121 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811422    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811425    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811427    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811430    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811433    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811436    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811439    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811441    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811444    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811446    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811449    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811452    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811454    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811457    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811459    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811462    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811466    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811469    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 09:18:00.145698 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.811471    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.812221    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.819647    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.819665    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.820459    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.820467    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820529    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820536    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820539    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820542    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820545    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820549    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820554    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820557    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820560    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 09:18:00.146195 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820563    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820566    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820569    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820572    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820575    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820578    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820580    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820583    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820586    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820588    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820591    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820594    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820596    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820599    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820601    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820604    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820607    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820610    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820613    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 09:18:00.146683 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820618    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820622    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820628    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820631    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820633    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820636    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820639    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820642    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820645    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820648    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820651    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820653    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820656    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820659    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820662    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820664    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820667    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820670    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820672    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820675    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 09:18:00.147263 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820678    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820681    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820684    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820687    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820691    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820694    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820697    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820700    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820703    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820706    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820709    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820711    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820714    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820717    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820722    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820724    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820727    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820730    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820733    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820735    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 09:18:00.147822 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820738    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820741    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820744    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820746    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820749    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820752    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820754    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820757    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820761    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820764    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820767    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820769    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820772    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820774    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820777    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820779    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820782    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820785    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820787    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820790    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 09:18:00.148384 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820793    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820796    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820798    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820801    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820804    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820806    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820810    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820813    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820816    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820819    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820822    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.820827    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820981    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820987    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820990    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 09:18:00.148962 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820993    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820996    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.820999    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821002    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821005    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821009    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821012    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821015    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821018    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821021    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821023    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821026    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821029    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821031    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821034    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821037    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821040    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821042    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821045    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821047    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 09:18:00.149382 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821050    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821053    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821055    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821058    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821062    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821065    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821068    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821071    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821073    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821076    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821079    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821081    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821084    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821086    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821089    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821091    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821094    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821098    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821100    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821103    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 09:18:00.150006 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821106    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821108    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821111    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821114    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821116    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821119    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821122    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821125    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821127    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821130    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821133    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821137    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821140    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821143    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821146    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821158    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821163    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821165    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821169    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821172    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 09:18:00.150528 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821174    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821177    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821180    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821182    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821186    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821190    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821193    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821196    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821199    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821204    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821207    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821210    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821213    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821216    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821218    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821221    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821224    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821227    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821230    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 09:18:00.151198 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821233    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821236    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821239    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821241    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821244    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821246    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821249    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821251    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821254    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821258    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821261    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821263    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821266    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821270    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821273    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821277    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 09:18:00.151681 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:17:59.821280    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.821285    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.821402    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.823432    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.825067    2560 server.go:1019] "Starting client certificate rotation"
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.825180    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.825226    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.827415    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.833585    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.848430    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.852910    2560 log.go:25] "Validated CRI v1 image API"
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.854883    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 09:18:00.273488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.857373    2560 fs.go:135] Filesystem UUIDs: map[4589d023-e0de-461d-b8aa-3b5eeef271d6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 abf23f8a-adcd-4067-b86e-4b357556e2a6:/dev/nvme0n1p4]
Jul 17 09:18:00.274223 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.857401    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 09:18:00.274223 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.858473    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.861658    2560 manager.go:216] Machine: {Timestamp:2026-07-17 09:17:59.861180848 +0000 UTC m=+0.368816651 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100637 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2715b154c4407109b7cfba98672167 SystemUUID:ec2715b1-54c4-4071-09b7-cfba98672167 BootID:a1aca198-3c7d-49bb-aa42-336334c3f0b0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dd:1a:24:81:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dd:1a:24:81:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:72:10:34:5d:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.861761    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.861858    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.864969    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.864997    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-131.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.865729    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.865738    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.865746    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.866664    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.867779    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.870164    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.870280    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.870308    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.870318    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.870331    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.870346    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.870359    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 09:18:00.276749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.870737    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.870762    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.874408    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.876421    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.876448    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877447    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877459    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877465    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877470    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877478    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877483    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877492    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877498    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877504    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877510    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877517    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.877523    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.879121    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.879135    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.881980    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-131.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:17:59.881990    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:17:59.882001    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-131.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.882607    2560 server.go:1268] "Started kubelet"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.882713    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.885742    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.885999    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.887570    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.888736    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:17:59.893945    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.895431    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.895449    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:17:59.895744    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896071    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896089    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896186    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896194    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896244    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:17:59.895157    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-131.ec2.internal.18c30918e44729f6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-131.ec2.internal,UID:ip-10-0-131-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-131.ec2.internal,},FirstTimestamp:2026-07-17 09:17:59.882582518 +0000 UTC m=+0.390218319,LastTimestamp:2026-07-17 09:17:59.882582518 +0000 UTC m=+0.390218319,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-131.ec2.internal,}"
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896389    2560 factory.go:55] Registering systemd factory
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896404    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896626    2560 factory.go:153] Registering CRI-O factory
Jul 17 09:18:00.277585 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896638    2560 factory.go:223] Registration of the crio container factory successfully
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896679    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896696    2560 factory.go:103] Registering Raw factory
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.896707    2560 manager.go:1196] Started watching for new ooms in manager
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.897076    2560 manager.go:349] Starting recovery of all containers
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.911469    2560 manager.go:354] Recovery completed
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:17:59.913860    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-131.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:17:59.913892    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.916314    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.918169    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.918193    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.918203    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientPID"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.918742    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.918745    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.918755    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.918768    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.919517    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.919539    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.919549    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientPID"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.919869    2560 policy_none.go:49] "None policy: Start"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.919881    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.919892    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.919877    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-74zjm"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.920667    2560 policy_none.go:47] "Start"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.927945    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-74zjm"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:17:59.929722    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-131.ec2.internal.18c30918e6665888  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-131.ec2.internal,UID:ip-10-0-131-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-131.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-131.ec2.internal,},FirstTimestamp:2026-07-17 09:17:59.918180488 +0000 UTC m=+0.425816289,LastTimestamp:2026-07-17 09:17:59.918180488 +0000 UTC m=+0.425816289,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-131.ec2.internal,}"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.972466    2560 manager.go:337] "Starting Device Plugin manager"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:17:59.972503    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.972516    2560 server.go:87] "Starting device plugin registration server"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.972783    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.972792    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.972956    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.973055    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.973064    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:17:59.973466    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:17:59.973509    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:17:59.997921    2560 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2595 into the system container \"/system.slice\": <nil>"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.073563    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 09:18:00.284039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.074720    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.074747    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.074757    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientPID"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.074784    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.084100    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:00.084123    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-131.ec2.internal\": node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:00.119099    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.160385    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.161614    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.161650    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.161669    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:00.161702    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.164031    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:00.219880    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.262043    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-131.ec2.internal"]
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.262159    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.263576    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.263609    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.263627    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientPID"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.264917    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.265034    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.265067    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.265676    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.265700    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.265713    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientPID"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.265734    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.265757    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.265767    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientPID"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.267116    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.267137    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.267794    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.267821    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 09:18:00.285287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.267831    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientPID"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.298468    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c65581df230d7f42838c46f439cf3795-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal\" (UID: \"c65581df230d7f42838c46f439cf3795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.298497    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c65581df230d7f42838c46f439cf3795-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal\" (UID: \"c65581df230d7f42838c46f439cf3795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.298515    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b15db55deb2124b8d29985bc300252e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-131.ec2.internal\" (UID: \"1b15db55deb2124b8d29985bc300252e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:00.309651    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-131.ec2.internal\" not found" node="ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:00.318603    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-131.ec2.internal\" not found" node="ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:00.320406    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.399181    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b15db55deb2124b8d29985bc300252e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-131.ec2.internal\" (UID: \"1b15db55deb2124b8d29985bc300252e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.399221    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c65581df230d7f42838c46f439cf3795-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal\" (UID: \"c65581df230d7f42838c46f439cf3795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.399246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c65581df230d7f42838c46f439cf3795-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal\" (UID: \"c65581df230d7f42838c46f439cf3795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.399284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b15db55deb2124b8d29985bc300252e-config\") pod \"kube-apiserver-proxy-ip-10-0-131-131.ec2.internal\" (UID: \"1b15db55deb2124b8d29985bc300252e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.399293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c65581df230d7f42838c46f439cf3795-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal\" (UID: \"c65581df230d7f42838c46f439cf3795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.399294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c65581df230d7f42838c46f439cf3795-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal\" (UID: \"c65581df230d7f42838c46f439cf3795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:00.446651 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:00.421287    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:00.590722 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:00.521784    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:01.747419 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.615384    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:01.747419 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:00.621936    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:01.747419 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:00.621978    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:01.747419 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:01.738850    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:01.904080 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:01.839405    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:01.904080 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:01.840521    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 09:18:01.904080 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:01.840696    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 09:18:01.979163 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:01.940281    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:01.979163 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:01.947415    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 09:13:00 +0000 UTC" deadline="2028-04-28 04:27:36.323011956 +0000 UTC"
Jul 17 09:18:01.979163 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:01.947443    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15619h9m34.375571493s"
Jul 17 09:18:02.066617 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.031047    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 09:18:02.066617 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.032102    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 09:18:02.066617 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.032129    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 09:18:02.066617 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.032138    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeHasSufficientPID"
Jul 17 09:18:02.066617 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:02.040412    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-131.ec2.internal\" not found"
Jul 17 09:18:02.066617 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.040741    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 09:18:02.183492 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.111514    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:02.183492 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.131323    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 09:18:02.183492 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.133555    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-131.ec2.internal"
Jul 17 09:18:02.183492 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.147281    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 09:18:02.294360 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.276239    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 09:18:02.440676 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:18:02.334379    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b15db55deb2124b8d29985bc300252e.slice/crio-bc0ccdd862d724b1a4fa4131406b5b294499afecb4af6e7b22caf2fcf7d2a25d WatchSource:0}: Error finding container bc0ccdd862d724b1a4fa4131406b5b294499afecb4af6e7b22caf2fcf7d2a25d: Status 404 returned error can't find the container with id bc0ccdd862d724b1a4fa4131406b5b294499afecb4af6e7b22caf2fcf7d2a25d
Jul 17 09:18:02.440676 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:18:02.334756    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65581df230d7f42838c46f439cf3795.slice/crio-9d1552f9905877e8fdec478b58696b4ea5bc7d2ebb450e589a18d5b3cdeb09d2 WatchSource:0}: Error finding container 9d1552f9905877e8fdec478b58696b4ea5bc7d2ebb450e589a18d5b3cdeb09d2: Status 404 returned error can't find the container with id 9d1552f9905877e8fdec478b58696b4ea5bc7d2ebb450e589a18d5b3cdeb09d2
Jul 17 09:18:02.440676 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.340312    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 09:18:02.562553 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.464332    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 09:18:02.844851 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.844825    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 09:18:02.887176 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.887144    2560 apiserver.go:52] "Watching apiserver"
Jul 17 09:18:02.894539 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.894513    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 09:18:02.894944 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.894921    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-131.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b","openshift-cluster-node-tuning-operator/tuned-p4qvx","openshift-dns/node-resolver-gcl4j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal","openshift-multus/multus-bzqg2","openshift-multus/network-metrics-daemon-l78lc","kube-system/konnectivity-agent-5dt7g","openshift-image-registry/node-ca-mgltv","openshift-multus/multus-additional-cni-plugins-r725x","openshift-network-diagnostics/network-check-target-9x5jk","openshift-network-operator/iptables-alerter-rsfkq","openshift-ovn-kubernetes/ovnkube-node-5rf9q","kube-system/global-pull-secret-syncer-zrdcn"]
Jul 17 09:18:02.897361 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.897339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:02.897448 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:02.897418    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:02.899960 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.899936    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:02.900050 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:02.900012    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:02.902119 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.902099    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.904411 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.904261    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gcl4j"
Jul 17 09:18:02.904880 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.904859    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 09:18:02.904985 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.904862    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 09:18:02.904985 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.904921    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v5njt\""
Jul 17 09:18:02.906482 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.906463    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:02.906574 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:02.906529    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:02.906727 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.906685    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 09:18:02.906815 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.906694    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 09:18:02.906815 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.906710    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h52bc\""
Jul 17 09:18:02.908859 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.908834    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.911061 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.911042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mgltv"
Jul 17 09:18:02.911157 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.911102    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 09:18:02.911475 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.911455    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 09:18:02.911555 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.911536    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 09:18:02.911610 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.911569    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 09:18:02.911681 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.911666    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5qr6z\""
Jul 17 09:18:02.911789 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.911758    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 09:18:02.913440 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.913422    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.913951 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.913924    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 09:18:02.914229 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.914214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6mzm5\""
Jul 17 09:18:02.914296 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.914266    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 09:18:02.914462 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.914439    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 09:18:02.915763 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.915745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:02.916992 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.916838    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q6q7c\""
Jul 17 09:18:02.917514 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.917269    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 09:18:02.917514 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.917423    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 09:18:02.917671 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.917606    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 09:18:02.917671 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.917621    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 09:18:02.919879 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.919852    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 09:18:02.920143 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.920119    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 09:18:02.920374 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.920100    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 09:18:02.920706 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.920689    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-shd42\""
Jul 17 09:18:02.920875 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.920691    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 09:18:02.921127 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.921108    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 09:18:02.921452 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.921435    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:02.922145 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.922127    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:02.923209 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-host\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.923287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-tuned\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.923287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86eae500-f996-4f04-9792-5a5af6c9c893-tmp-dir\") pod \"node-resolver-gcl4j\" (UID: \"86eae500-f996-4f04-9792-5a5af6c9c893\") " pod="openshift-dns/node-resolver-gcl4j"
Jul 17 09:18:02.923403 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-run-ovn-kubernetes\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.923403 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923351    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84807261-d1ec-4148-9c9c-776f43fdd74a-host\") pod \"node-ca-mgltv\" (UID: \"84807261-d1ec-4148-9c9c-776f43fdd74a\") " pod="openshift-image-registry/node-ca-mgltv"
Jul 17 09:18:02.923502 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923411    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84807261-d1ec-4148-9c9c-776f43fdd74a-serviceca\") pod \"node-ca-mgltv\" (UID: \"84807261-d1ec-4148-9c9c-776f43fdd74a\") " pod="openshift-image-registry/node-ca-mgltv"
Jul 17 09:18:02.923502 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-run-netns\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.923502 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923473    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-run-openvswitch\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.923647 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dsdp\" (UniqueName: \"kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp\") pod \"network-check-target-9x5jk\" (UID: \"831dc05c-c0a7-4272-98f0-e3b956a47ccf\") " pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:02.923647 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-cni-dir\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.923647 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923551    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-run-netns\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.923647 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-var-lib-kubelet\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.923858 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss7wl\" (UniqueName: \"kubernetes.io/projected/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-kube-api-access-ss7wl\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.923858 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-log-socket\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.923858 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.923858 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f69f\" (UniqueName: \"kubernetes.io/projected/84807261-d1ec-4148-9c9c-776f43fdd74a-kube-api-access-4f69f\") pod \"node-ca-mgltv\" (UID: \"84807261-d1ec-4148-9c9c-776f43fdd74a\") " pod="openshift-image-registry/node-ca-mgltv"
Jul 17 09:18:02.924062 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923899    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-sys\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.924062 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc9d19c5-2c07-4534-b47d-b7815d3f2892-tmp\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.924062 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923942    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-socket-dir-parent\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.924062 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-var-lib-cni-multus\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.924062 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.923986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-kubelet\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.924062 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924015    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb04d6e3-f7e4-4699-a891-c52edfe78c59-ovnkube-config\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.924062 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924017    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 09:18:02.924062 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924037    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-sysconfig\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.924443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qrfc\" (UniqueName: \"kubernetes.io/projected/86eae500-f996-4f04-9792-5a5af6c9c893-kube-api-access-9qrfc\") pod \"node-resolver-gcl4j\" (UID: \"86eae500-f996-4f04-9792-5a5af6c9c893\") " pod="openshift-dns/node-resolver-gcl4j"
Jul 17 09:18:02.924443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924115    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-cnibin\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.924443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rsfkq"
Jul 17 09:18:02.924443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924211    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4sbq8\""
Jul 17 09:18:02.924443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924298    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 09:18:02.924443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924208    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-var-lib-cni-bin\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.924443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924395    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-os-release\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.924443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-conf-dir\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.924833 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-run-systemd\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.924833 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-var-lib-openvswitch\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.924833 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924537    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-node-log\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.924833 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924678    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 09:18:02.924833 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924713    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b5s7r\""
Jul 17 09:18:02.924833 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924678    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 09:18:02.924833 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crdbs\" (UniqueName: \"kubernetes.io/projected/9a86c19b-a795-4528-89f0-5f7377a569d7-kube-api-access-crdbs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:02.925161 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924857    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e26a86fd-e979-4246-af0d-5881142edd51-kubelet-config\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:02.925161 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924890    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb04d6e3-f7e4-4699-a891-c52edfe78c59-env-overrides\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.925161 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e26a86fd-e979-4246-af0d-5881142edd51-dbus\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:02.925161 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-kubernetes\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.925161 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.924975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-run-k8s-cni-cncf-io\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.925161 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.925005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-daemon-config\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.925161 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.925036    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-etc-openvswitch\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.925161 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.925066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-run-ovn\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.925161 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.925105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-cni-netd\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.925161 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.925128    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 09:18:02.925627 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.925187    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-var-lib-kubelet\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.925627 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.925217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-run-multus-certs\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.925627 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.925263    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-modprobe-d\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.927191 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927023    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 09:18:02.927191 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927092    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 09:18:02.927191 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927162    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mpnxw\""
Jul 17 09:18:02.927394 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927204    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 09:18:02.927394 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-systemd\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.927394 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927351    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5jf9\" (UniqueName: \"kubernetes.io/projected/fb04d6e3-f7e4-4699-a891-c52edfe78c59-kube-api-access-q5jf9\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.927394 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927385    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:02.927540 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-lib-modules\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.927540 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gb2z\" (UniqueName: \"kubernetes.io/projected/cc9d19c5-2c07-4534-b47d-b7815d3f2892-kube-api-access-2gb2z\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.927540 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-cni-binary-copy\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.927540 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-etc-kubernetes\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.927540 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb04d6e3-f7e4-4699-a891-c52edfe78c59-ovn-node-metrics-cert\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.927540 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86eae500-f996-4f04-9792-5a5af6c9c893-hosts-file\") pod \"node-resolver-gcl4j\" (UID: \"86eae500-f996-4f04-9792-5a5af6c9c893\") " pod="openshift-dns/node-resolver-gcl4j"
Jul 17 09:18:02.927737 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-system-cni-dir\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.927737 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-systemd-units\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.927737 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927608    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-cni-bin\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.927737 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-sysctl-conf\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.927737 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-run\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.927737 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927694    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-hostroot\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:02.927737 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-slash\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.928181 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927757    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb04d6e3-f7e4-4699-a891-c52edfe78c59-ovnkube-script-lib\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:02.928181 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927812    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:02.928181 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.927835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-sysctl-d\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:02.951644 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.951622    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d7ljs"
Jul 17 09:18:02.959026 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:02.958976    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d7ljs"
Jul 17 09:18:03.013618 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.013581    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 09:18:03.028988 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.028958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-cni-binary-copy\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.028988 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.028990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-etc-kubernetes\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029010    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb04d6e3-f7e4-4699-a891-c52edfe78c59-ovn-node-metrics-cert\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29f42b87-7a7e-40e9-a9eb-d8502e5cb33a-host-slash\") pod \"iptables-alerter-rsfkq\" (UID: \"29f42b87-7a7e-40e9-a9eb-d8502e5cb33a\") " pod="openshift-network-operator/iptables-alerter-rsfkq"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7tdp\" (UniqueName: \"kubernetes.io/projected/be48fad1-53e1-475d-838d-7df345fdac0d-kube-api-access-s7tdp\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029065    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86eae500-f996-4f04-9792-5a5af6c9c893-hosts-file\") pod \"node-resolver-gcl4j\" (UID: \"86eae500-f996-4f04-9792-5a5af6c9c893\") " pod="openshift-dns/node-resolver-gcl4j"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-system-cni-dir\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-systemd-units\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-cni-bin\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-sysctl-conf\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-run\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029179    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-hostroot\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-slash\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb04d6e3-f7e4-4699-a891-c52edfe78c59-ovnkube-script-lib\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:03.029241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-sysctl-d\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-host\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-tuned\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86eae500-f996-4f04-9792-5a5af6c9c893-tmp-dir\") pod \"node-resolver-gcl4j\" (UID: \"86eae500-f996-4f04-9792-5a5af6c9c893\") " pod="openshift-dns/node-resolver-gcl4j"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-run-ovn-kubernetes\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029341    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84807261-d1ec-4148-9c9c-776f43fdd74a-host\") pod \"node-ca-mgltv\" (UID: \"84807261-d1ec-4148-9c9c-776f43fdd74a\") " pod="openshift-image-registry/node-ca-mgltv"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84807261-d1ec-4148-9c9c-776f43fdd74a-serviceca\") pod \"node-ca-mgltv\" (UID: \"84807261-d1ec-4148-9c9c-776f43fdd74a\") " pod="openshift-image-registry/node-ca-mgltv"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-run-netns\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029407    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-run-openvswitch\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29f42b87-7a7e-40e9-a9eb-d8502e5cb33a-iptables-alerter-script\") pod \"iptables-alerter-rsfkq\" (UID: \"29f42b87-7a7e-40e9-a9eb-d8502e5cb33a\") " pod="openshift-network-operator/iptables-alerter-rsfkq"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029458    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsdp\" (UniqueName: \"kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp\") pod \"network-check-target-9x5jk\" (UID: \"831dc05c-c0a7-4272-98f0-e3b956a47ccf\") " pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-cni-dir\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-run-netns\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029539    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62743f2a-e9dd-485c-8d68-32c9a3195c37-cni-binary-copy\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-var-lib-kubelet\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss7wl\" (UniqueName: \"kubernetes.io/projected/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-kube-api-access-ss7wl\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-log-socket\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.029940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f69f\" (UniqueName: \"kubernetes.io/projected/84807261-d1ec-4148-9c9c-776f43fdd74a-kube-api-access-4f69f\") pod \"node-ca-mgltv\" (UID: \"84807261-d1ec-4148-9c9c-776f43fdd74a\") " pod="openshift-image-registry/node-ca-mgltv"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029671    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029692    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-sys\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc9d19c5-2c07-4534-b47d-b7815d3f2892-tmp\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-socket-dir-parent\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-var-lib-cni-multus\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62743f2a-e9dd-485c-8d68-32c9a3195c37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029846    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkcn7\" (UniqueName: \"kubernetes.io/projected/62743f2a-e9dd-485c-8d68-32c9a3195c37-kube-api-access-hkcn7\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-kubelet\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb04d6e3-f7e4-4699-a891-c52edfe78c59-ovnkube-config\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-cnibin\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029942    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8sf4\" (UniqueName: \"kubernetes.io/projected/29f42b87-7a7e-40e9-a9eb-d8502e5cb33a-kube-api-access-w8sf4\") pod \"iptables-alerter-rsfkq\" (UID: \"29f42b87-7a7e-40e9-a9eb-d8502e5cb33a\") " pod="openshift-network-operator/iptables-alerter-rsfkq"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-socket-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.029994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-sysconfig\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qrfc\" (UniqueName: \"kubernetes.io/projected/86eae500-f996-4f04-9792-5a5af6c9c893-kube-api-access-9qrfc\") pod \"node-resolver-gcl4j\" (UID: \"86eae500-f996-4f04-9792-5a5af6c9c893\") " pod="openshift-dns/node-resolver-gcl4j"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-cnibin\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.030797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-var-lib-cni-bin\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-os-release\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86eae500-f996-4f04-9792-5a5af6c9c893-tmp-dir\") pod \"node-resolver-gcl4j\" (UID: \"86eae500-f996-4f04-9792-5a5af6c9c893\") " pod="openshift-dns/node-resolver-gcl4j"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030149    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c8e2ec5-68c6-43df-87e9-b6100da255e6-konnectivity-ca\") pod \"konnectivity-agent-5dt7g\" (UID: \"8c8e2ec5-68c6-43df-87e9-b6100da255e6\") " pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-os-release\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-conf-dir\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030219    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-run-systemd\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-var-lib-openvswitch\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-node-log\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdbs\" (UniqueName: \"kubernetes.io/projected/9a86c19b-a795-4528-89f0-5f7377a569d7-kube-api-access-crdbs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e26a86fd-e979-4246-af0d-5881142edd51-kubelet-config\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030348    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62743f2a-e9dd-485c-8d68-32c9a3195c37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb04d6e3-f7e4-4699-a891-c52edfe78c59-env-overrides\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e26a86fd-e979-4246-af0d-5881142edd51-dbus\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-device-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030461    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-sys-fs\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-kubernetes\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.031570 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-run-k8s-cni-cncf-io\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-daemon-config\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-etc-openvswitch\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-run-ovn\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-cni-netd\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c8e2ec5-68c6-43df-87e9-b6100da255e6-agent-certs\") pod \"konnectivity-agent-5dt7g\" (UID: \"8c8e2ec5-68c6-43df-87e9-b6100da255e6\") " pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-cni-binary-copy\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-var-lib-kubelet\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030732    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-run-multus-certs\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-system-cni-dir\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-etc-kubernetes\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-modprobe-d\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-systemd\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5jf9\" (UniqueName: \"kubernetes.io/projected/fb04d6e3-f7e4-4699-a891-c52edfe78c59-kube-api-access-q5jf9\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:03.032461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030936    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-registration-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.030964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-lib-modules\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gb2z\" (UniqueName: \"kubernetes.io/projected/cc9d19c5-2c07-4534-b47d-b7815d3f2892-kube-api-access-2gb2z\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031185    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-run-ovn-kubernetes\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84807261-d1ec-4148-9c9c-776f43fdd74a-host\") pod \"node-ca-mgltv\" (UID: \"84807261-d1ec-4148-9c9c-776f43fdd74a\") " pod="openshift-image-registry/node-ca-mgltv"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-system-cni-dir\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031534    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86eae500-f996-4f04-9792-5a5af6c9c893-hosts-file\") pod \"node-resolver-gcl4j\" (UID: \"86eae500-f996-4f04-9792-5a5af6c9c893\") " pod="openshift-dns/node-resolver-gcl4j"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031584    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-systemd-units\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031624    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-cni-bin\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031746    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-sysctl-conf\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031852    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-run\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-hostroot\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/84807261-d1ec-4148-9c9c-776f43fdd74a-serviceca\") pod \"node-ca-mgltv\" (UID: \"84807261-d1ec-4148-9c9c-776f43fdd74a\") " pod="openshift-image-registry/node-ca-mgltv"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-slash\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.031968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-run-netns\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.032029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-run-openvswitch\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.032370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-cni-dir\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.033418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.032442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-run-netns\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.032486    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb04d6e3-f7e4-4699-a891-c52edfe78c59-ovnkube-script-lib\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.032505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-var-lib-kubelet\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.032594    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.032654    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs podName:9a86c19b-a795-4528-89f0-5f7377a569d7 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:03.532633231 +0000 UTC m=+3.024327629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs") pod "network-metrics-daemon-l78lc" (UID: "9a86c19b-a795-4528-89f0-5f7377a569d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.032812    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-log-socket\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.032859    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.032952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-sysctl-d\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-host\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-sys\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033413    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-socket-dir-parent\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-var-lib-cni-bin\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033483    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-cnibin\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-var-lib-cni-multus\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-os-release\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-kubelet\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033703    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-conf-dir\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-run-systemd\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.035160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-var-lib-openvswitch\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.033858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-node-log\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e26a86fd-e979-4246-af0d-5881142edd51-kubelet-config\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb04d6e3-f7e4-4699-a891-c52edfe78c59-env-overrides\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-sysconfig\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-run-k8s-cni-cncf-io\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e26a86fd-e979-4246-af0d-5881142edd51-dbus\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034575    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-kubernetes\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034614    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-run-ovn\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-etc-openvswitch\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb04d6e3-f7e4-4699-a891-c52edfe78c59-host-cni-netd\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034814    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-modprobe-d\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-var-lib-kubelet\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.034939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-host-run-multus-certs\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.035100    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.035206    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret podName:e26a86fd-e979-4246-af0d-5881142edd51 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:03.535191079 +0000 UTC m=+3.026885478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret") pod "global-pull-secret-syncer-zrdcn" (UID: "e26a86fd-e979-4246-af0d-5881142edd51") : object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.035272    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-systemd\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.035308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-multus-daemon-config\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.035986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.035430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc9d19c5-2c07-4534-b47d-b7815d3f2892-lib-modules\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.036819 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.035725    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb04d6e3-f7e4-4699-a891-c52edfe78c59-ovnkube-config\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.036819 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.036046    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb04d6e3-f7e4-4699-a891-c52edfe78c59-ovn-node-metrics-cert\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.037338 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.037293    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc9d19c5-2c07-4534-b47d-b7815d3f2892-etc-tuned\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.040084 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.040008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc9d19c5-2c07-4534-b47d-b7815d3f2892-tmp\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.041415 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.041388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gb2z\" (UniqueName: \"kubernetes.io/projected/cc9d19c5-2c07-4534-b47d-b7815d3f2892-kube-api-access-2gb2z\") pod \"tuned-p4qvx\" (UID: \"cc9d19c5-2c07-4534-b47d-b7815d3f2892\") " pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.041560 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.041476    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 09:18:03.041560 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.041497    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 09:18:03.041560 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.041510    2560 projected.go:196] Error preparing data for projected volume kube-api-access-8dsdp for pod openshift-network-diagnostics/network-check-target-9x5jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:03.041704 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.041606    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp podName:831dc05c-c0a7-4272-98f0-e3b956a47ccf nodeName:}" failed. No retries permitted until 2026-07-17 09:18:03.541584448 +0000 UTC m=+3.033278836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8dsdp" (UniqueName: "kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp") pod "network-check-target-9x5jk" (UID: "831dc05c-c0a7-4272-98f0-e3b956a47ccf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:03.044384 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.044359    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss7wl\" (UniqueName: \"kubernetes.io/projected/4b72f06c-2e86-4cb6-a43a-5718771d3bbf-kube-api-access-ss7wl\") pod \"multus-bzqg2\" (UID: \"4b72f06c-2e86-4cb6-a43a-5718771d3bbf\") " pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.050360 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.050319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crdbs\" (UniqueName: \"kubernetes.io/projected/9a86c19b-a795-4528-89f0-5f7377a569d7-kube-api-access-crdbs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:03.050845 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.050825    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5jf9\" (UniqueName: \"kubernetes.io/projected/fb04d6e3-f7e4-4699-a891-c52edfe78c59-kube-api-access-q5jf9\") pod \"ovnkube-node-5rf9q\" (UID: \"fb04d6e3-f7e4-4699-a891-c52edfe78c59\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.051348 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.051327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qrfc\" (UniqueName: \"kubernetes.io/projected/86eae500-f996-4f04-9792-5a5af6c9c893-kube-api-access-9qrfc\") pod \"node-resolver-gcl4j\" (UID: \"86eae500-f996-4f04-9792-5a5af6c9c893\") " pod="openshift-dns/node-resolver-gcl4j"
Jul 17 09:18:03.053059 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.052984    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f69f\" (UniqueName: \"kubernetes.io/projected/84807261-d1ec-4148-9c9c-776f43fdd74a-kube-api-access-4f69f\") pod \"node-ca-mgltv\" (UID: \"84807261-d1ec-4148-9c9c-776f43fdd74a\") " pod="openshift-image-registry/node-ca-mgltv"
Jul 17 09:18:03.132011 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.131965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62743f2a-e9dd-485c-8d68-32c9a3195c37-cni-binary-copy\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.132011 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.132245 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62743f2a-e9dd-485c-8d68-32c9a3195c37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.132245 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkcn7\" (UniqueName: \"kubernetes.io/projected/62743f2a-e9dd-485c-8d68-32c9a3195c37-kube-api-access-hkcn7\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.132245 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132096    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-cnibin\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.132245 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8sf4\" (UniqueName: \"kubernetes.io/projected/29f42b87-7a7e-40e9-a9eb-d8502e5cb33a-kube-api-access-w8sf4\") pod \"iptables-alerter-rsfkq\" (UID: \"29f42b87-7a7e-40e9-a9eb-d8502e5cb33a\") " pod="openshift-network-operator/iptables-alerter-rsfkq"
Jul 17 09:18:03.132245 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-socket-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.132245 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-os-release\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.132245 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c8e2ec5-68c6-43df-87e9-b6100da255e6-konnectivity-ca\") pod \"konnectivity-agent-5dt7g\" (UID: \"8c8e2ec5-68c6-43df-87e9-b6100da255e6\") " pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:03.132245 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132219    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62743f2a-e9dd-485c-8d68-32c9a3195c37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.132245 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-device-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.132731 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-sys-fs\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.132731 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132297    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.132731 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c8e2ec5-68c6-43df-87e9-b6100da255e6-agent-certs\") pod \"konnectivity-agent-5dt7g\" (UID: \"8c8e2ec5-68c6-43df-87e9-b6100da255e6\") " pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:03.132731 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132346    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-system-cni-dir\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.132731 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.132731 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-registration-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.132731 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29f42b87-7a7e-40e9-a9eb-d8502e5cb33a-host-slash\") pod \"iptables-alerter-rsfkq\" (UID: \"29f42b87-7a7e-40e9-a9eb-d8502e5cb33a\") " pod="openshift-network-operator/iptables-alerter-rsfkq"
Jul 17 09:18:03.132731 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7tdp\" (UniqueName: \"kubernetes.io/projected/be48fad1-53e1-475d-838d-7df345fdac0d-kube-api-access-s7tdp\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.132731 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29f42b87-7a7e-40e9-a9eb-d8502e5cb33a-iptables-alerter-script\") pod \"iptables-alerter-rsfkq\" (UID: \"29f42b87-7a7e-40e9-a9eb-d8502e5cb33a\") " pod="openshift-network-operator/iptables-alerter-rsfkq"
Jul 17 09:18:03.132731 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132686    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62743f2a-e9dd-485c-8d68-32c9a3195c37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.133248 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132870    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-device-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.133248 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.133248 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.132940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-system-cni-dir\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.133248 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.133065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.133248 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.133142    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-sys-fs\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.133248 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.133160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-cnibin\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.133248 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.133163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62743f2a-e9dd-485c-8d68-32c9a3195c37-cni-binary-copy\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.133248 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.133163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-registration-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.133248 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.133187    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29f42b87-7a7e-40e9-a9eb-d8502e5cb33a-host-slash\") pod \"iptables-alerter-rsfkq\" (UID: \"29f42b87-7a7e-40e9-a9eb-d8502e5cb33a\") " pod="openshift-network-operator/iptables-alerter-rsfkq"
Jul 17 09:18:03.133248 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.133216    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.133248 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.133242    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62743f2a-e9dd-485c-8d68-32c9a3195c37-os-release\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.133753 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.133317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be48fad1-53e1-475d-838d-7df345fdac0d-socket-dir\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.133753 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.133655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29f42b87-7a7e-40e9-a9eb-d8502e5cb33a-iptables-alerter-script\") pod \"iptables-alerter-rsfkq\" (UID: \"29f42b87-7a7e-40e9-a9eb-d8502e5cb33a\") " pod="openshift-network-operator/iptables-alerter-rsfkq"
Jul 17 09:18:03.133753 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.133725    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c8e2ec5-68c6-43df-87e9-b6100da255e6-konnectivity-ca\") pod \"konnectivity-agent-5dt7g\" (UID: \"8c8e2ec5-68c6-43df-87e9-b6100da255e6\") " pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:03.134382 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.134348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62743f2a-e9dd-485c-8d68-32c9a3195c37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.136140 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.136095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c8e2ec5-68c6-43df-87e9-b6100da255e6-agent-certs\") pod \"konnectivity-agent-5dt7g\" (UID: \"8c8e2ec5-68c6-43df-87e9-b6100da255e6\") " pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:03.144499 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.144462    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkcn7\" (UniqueName: \"kubernetes.io/projected/62743f2a-e9dd-485c-8d68-32c9a3195c37-kube-api-access-hkcn7\") pod \"multus-additional-cni-plugins-r725x\" (UID: \"62743f2a-e9dd-485c-8d68-32c9a3195c37\") " pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.145125 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.145104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8sf4\" (UniqueName: \"kubernetes.io/projected/29f42b87-7a7e-40e9-a9eb-d8502e5cb33a-kube-api-access-w8sf4\") pod \"iptables-alerter-rsfkq\" (UID: \"29f42b87-7a7e-40e9-a9eb-d8502e5cb33a\") " pod="openshift-network-operator/iptables-alerter-rsfkq"
Jul 17 09:18:03.145267 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.145231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7tdp\" (UniqueName: \"kubernetes.io/projected/be48fad1-53e1-475d-838d-7df345fdac0d-kube-api-access-s7tdp\") pod \"aws-ebs-csi-driver-node-8rh5b\" (UID: \"be48fad1-53e1-475d-838d-7df345fdac0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.192812 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.192745    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-131.ec2.internal" event={"ID":"1b15db55deb2124b8d29985bc300252e","Type":"ContainerStarted","Data":"bc0ccdd862d724b1a4fa4131406b5b294499afecb4af6e7b22caf2fcf7d2a25d"}
Jul 17 09:18:03.194120 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.194090    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal" event={"ID":"c65581df230d7f42838c46f439cf3795","Type":"ContainerStarted","Data":"9d1552f9905877e8fdec478b58696b4ea5bc7d2ebb450e589a18d5b3cdeb09d2"}
Jul 17 09:18:03.214328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.214061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p4qvx"
Jul 17 09:18:03.227825 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.227550    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gcl4j"
Jul 17 09:18:03.228697 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:18:03.228666    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9d19c5_2c07_4534_b47d_b7815d3f2892.slice/crio-6ed33f9310966e201f22cfbacd25e133bf016375bdc65dc38d4bae9ea3fc0fb8 WatchSource:0}: Error finding container 6ed33f9310966e201f22cfbacd25e133bf016375bdc65dc38d4bae9ea3fc0fb8: Status 404 returned error can't find the container with id 6ed33f9310966e201f22cfbacd25e133bf016375bdc65dc38d4bae9ea3fc0fb8
Jul 17 09:18:03.234124 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.233976    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bzqg2"
Jul 17 09:18:03.238921 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.238901    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mgltv"
Jul 17 09:18:03.245558 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.245535    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:03.246161 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:18:03.245992    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b72f06c_2e86_4cb6_a43a_5718771d3bbf.slice/crio-558ff9d7ddcc6dcd678062d6a1386c504bd2ed1f8208b3387c5d487e452b7acd WatchSource:0}: Error finding container 558ff9d7ddcc6dcd678062d6a1386c504bd2ed1f8208b3387c5d487e452b7acd: Status 404 returned error can't find the container with id 558ff9d7ddcc6dcd678062d6a1386c504bd2ed1f8208b3387c5d487e452b7acd
Jul 17 09:18:03.253012 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.252860    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b"
Jul 17 09:18:03.258865 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.258724    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:03.261444 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:18:03.261378    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb04d6e3_f7e4_4699_a891_c52edfe78c59.slice/crio-a9de7f3960d42460b8c2affdcac3de49b3731f295925c732492da3cc74350f78 WatchSource:0}: Error finding container a9de7f3960d42460b8c2affdcac3de49b3731f295925c732492da3cc74350f78: Status 404 returned error can't find the container with id a9de7f3960d42460b8c2affdcac3de49b3731f295925c732492da3cc74350f78
Jul 17 09:18:03.266753 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.265976    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r725x"
Jul 17 09:18:03.275172 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.273984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rsfkq"
Jul 17 09:18:03.277968 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:18:03.277935    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62743f2a_e9dd_485c_8d68_32c9a3195c37.slice/crio-07294c1cc29bfe02672476658c4d3bef01e5266e79c78c275143a4861194560e WatchSource:0}: Error finding container 07294c1cc29bfe02672476658c4d3bef01e5266e79c78c275143a4861194560e: Status 404 returned error can't find the container with id 07294c1cc29bfe02672476658c4d3bef01e5266e79c78c275143a4861194560e
Jul 17 09:18:03.281002 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:18:03.280979    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8e2ec5_68c6_43df_87e9_b6100da255e6.slice/crio-84046531d80fa0e8f3f60bfbaf31d9d6c50352001e55442b9c5b0cca8f0ed2ed WatchSource:0}: Error finding container 84046531d80fa0e8f3f60bfbaf31d9d6c50352001e55442b9c5b0cca8f0ed2ed: Status 404 returned error can't find the container with id 84046531d80fa0e8f3f60bfbaf31d9d6c50352001e55442b9c5b0cca8f0ed2ed
Jul 17 09:18:03.286072 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:18:03.286051    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f42b87_7a7e_40e9_a9eb_d8502e5cb33a.slice/crio-69a5e26bbc0c771913bf2f13fa0c94c2e37547a947c28302811d583e6f660b37 WatchSource:0}: Error finding container 69a5e26bbc0c771913bf2f13fa0c94c2e37547a947c28302811d583e6f660b37: Status 404 returned error can't find the container with id 69a5e26bbc0c771913bf2f13fa0c94c2e37547a947c28302811d583e6f660b37
Jul 17 09:18:03.536191 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.536105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:03.536191 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.536147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:03.537125 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.536552    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:03.537125 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.536639    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs podName:9a86c19b-a795-4528-89f0-5f7377a569d7 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:04.536617657 +0000 UTC m=+4.028312047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs") pod "network-metrics-daemon-l78lc" (UID: "9a86c19b-a795-4528-89f0-5f7377a569d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:03.537125 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.536645    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:03.537125 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.536722    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret podName:e26a86fd-e979-4246-af0d-5881142edd51 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:04.53670409 +0000 UTC m=+4.028398489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret") pod "global-pull-secret-syncer-zrdcn" (UID: "e26a86fd-e979-4246-af0d-5881142edd51") : object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:03.637099 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.637047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsdp\" (UniqueName: \"kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp\") pod \"network-check-target-9x5jk\" (UID: \"831dc05c-c0a7-4272-98f0-e3b956a47ccf\") " pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:03.637246 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.637213    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 09:18:03.637246 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.637233    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 09:18:03.637339 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.637247    2560 projected.go:196] Error preparing data for projected volume kube-api-access-8dsdp for pod openshift-network-diagnostics/network-check-target-9x5jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:03.637339 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:03.637319    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp podName:831dc05c-c0a7-4272-98f0-e3b956a47ccf nodeName:}" failed. No retries permitted until 2026-07-17 09:18:04.637304739 +0000 UTC m=+4.128999123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dsdp" (UniqueName: "kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp") pod "network-check-target-9x5jk" (UID: "831dc05c-c0a7-4272-98f0-e3b956a47ccf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:03.962600 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.962478    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 09:13:02 +0000 UTC" deadline="2028-04-01 04:30:54.378131084 +0000 UTC"
Jul 17 09:18:03.962600 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:03.962551    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14971h12m50.415584413s"
Jul 17 09:18:04.177924 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.177891    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:04.178081 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:04.178025    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:04.199728 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.199651    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b" event={"ID":"be48fad1-53e1-475d-838d-7df345fdac0d","Type":"ContainerStarted","Data":"287b1cd0aa6e363fa01087b278164fd642118b575eb5ce429623e4fb99523833"}
Jul 17 09:18:04.202173 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.202144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q" event={"ID":"fb04d6e3-f7e4-4699-a891-c52edfe78c59","Type":"ContainerStarted","Data":"a9de7f3960d42460b8c2affdcac3de49b3731f295925c732492da3cc74350f78"}
Jul 17 09:18:04.203852 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.203824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p4qvx" event={"ID":"cc9d19c5-2c07-4534-b47d-b7815d3f2892","Type":"ContainerStarted","Data":"6ed33f9310966e201f22cfbacd25e133bf016375bdc65dc38d4bae9ea3fc0fb8"}
Jul 17 09:18:04.207801 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.207734    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rsfkq" event={"ID":"29f42b87-7a7e-40e9-a9eb-d8502e5cb33a","Type":"ContainerStarted","Data":"69a5e26bbc0c771913bf2f13fa0c94c2e37547a947c28302811d583e6f660b37"}
Jul 17 09:18:04.210804 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.210763    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r725x" event={"ID":"62743f2a-e9dd-485c-8d68-32c9a3195c37","Type":"ContainerStarted","Data":"07294c1cc29bfe02672476658c4d3bef01e5266e79c78c275143a4861194560e"}
Jul 17 09:18:04.214846 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.214768    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5dt7g" event={"ID":"8c8e2ec5-68c6-43df-87e9-b6100da255e6","Type":"ContainerStarted","Data":"84046531d80fa0e8f3f60bfbaf31d9d6c50352001e55442b9c5b0cca8f0ed2ed"}
Jul 17 09:18:04.216913 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.216889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mgltv" event={"ID":"84807261-d1ec-4148-9c9c-776f43fdd74a","Type":"ContainerStarted","Data":"896dd6b93312b432ce2523e96a605685b549e772eb7120417a22fe53563807c3"}
Jul 17 09:18:04.218689 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.218664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bzqg2" event={"ID":"4b72f06c-2e86-4cb6-a43a-5718771d3bbf","Type":"ContainerStarted","Data":"558ff9d7ddcc6dcd678062d6a1386c504bd2ed1f8208b3387c5d487e452b7acd"}
Jul 17 09:18:04.222062 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.222039    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gcl4j" event={"ID":"86eae500-f996-4f04-9792-5a5af6c9c893","Type":"ContainerStarted","Data":"2433c8b5e2eb3e74a37d0d97a62beb0ffb4d0bc0a6ab0629ef60517987e41216"}
Jul 17 09:18:04.544647 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.544569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:04.544647 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.544638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:04.544897 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:04.544795    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:04.544897 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:04.544859    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs podName:9a86c19b-a795-4528-89f0-5f7377a569d7 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:06.544839803 +0000 UTC m=+6.036534201 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs") pod "network-metrics-daemon-l78lc" (UID: "9a86c19b-a795-4528-89f0-5f7377a569d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:04.545256 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:04.545239    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:04.545328 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:04.545289    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret podName:e26a86fd-e979-4246-af0d-5881142edd51 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:06.545275139 +0000 UTC m=+6.036969539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret") pod "global-pull-secret-syncer-zrdcn" (UID: "e26a86fd-e979-4246-af0d-5881142edd51") : object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:04.645793 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.644985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsdp\" (UniqueName: \"kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp\") pod \"network-check-target-9x5jk\" (UID: \"831dc05c-c0a7-4272-98f0-e3b956a47ccf\") " pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:04.645793 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:04.645174    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 09:18:04.645793 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:04.645202    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 09:18:04.645793 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:04.645217    2560 projected.go:196] Error preparing data for projected volume kube-api-access-8dsdp for pod openshift-network-diagnostics/network-check-target-9x5jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:04.645793 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:04.645276    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp podName:831dc05c-c0a7-4272-98f0-e3b956a47ccf nodeName:}" failed. No retries permitted until 2026-07-17 09:18:06.645256473 +0000 UTC m=+6.136950859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dsdp" (UniqueName: "kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp") pod "network-check-target-9x5jk" (UID: "831dc05c-c0a7-4272-98f0-e3b956a47ccf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:04.963074 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.963011    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 09:13:02 +0000 UTC" deadline="2028-03-20 01:06:08.720392268 +0000 UTC"
Jul 17 09:18:04.963074 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:04.963054    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14679h48m3.757343487s"
Jul 17 09:18:05.180908 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:05.180060    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:05.180908 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:05.180411    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:05.180908 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:05.180495    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:05.180908 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:05.180563    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:05.240825 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:05.240076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-131.ec2.internal" event={"ID":"1b15db55deb2124b8d29985bc300252e","Type":"ContainerStarted","Data":"93c606ca1517981b12609f915615bc12cf47a7f2dfb201302b2a03bbfd7835a0"}
Jul 17 09:18:05.268475 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:05.267924    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-131.ec2.internal" podStartSLOduration=3.26790244 podStartE2EDuration="3.26790244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:05.267233005 +0000 UTC m=+4.758927416" watchObservedRunningTime="2026-07-17 09:18:05.26790244 +0000 UTC m=+4.759596846"
Jul 17 09:18:06.178645 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:06.178067    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:06.178645 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:06.178186    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:06.256714 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:06.255244    2560 generic.go:356] "Generic (PLEG): container finished" podID="c65581df230d7f42838c46f439cf3795" containerID="7aa39b2373535e12d29c121a235faa9ec57ca096ba8302a9d5438378f369659e" exitCode=0
Jul 17 09:18:06.256714 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:06.256626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal" event={"ID":"c65581df230d7f42838c46f439cf3795","Type":"ContainerDied","Data":"7aa39b2373535e12d29c121a235faa9ec57ca096ba8302a9d5438378f369659e"}
Jul 17 09:18:06.559090 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:06.559008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:06.559090 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:06.559073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:06.559314 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:06.559217    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:06.559314 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:06.559276    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs podName:9a86c19b-a795-4528-89f0-5f7377a569d7 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:10.559258899 +0000 UTC m=+10.050953287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs") pod "network-metrics-daemon-l78lc" (UID: "9a86c19b-a795-4528-89f0-5f7377a569d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:06.559689 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:06.559667    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:06.559804 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:06.559721    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret podName:e26a86fd-e979-4246-af0d-5881142edd51 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:10.559706226 +0000 UTC m=+10.051400615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret") pod "global-pull-secret-syncer-zrdcn" (UID: "e26a86fd-e979-4246-af0d-5881142edd51") : object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:06.660101 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:06.660062    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsdp\" (UniqueName: \"kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp\") pod \"network-check-target-9x5jk\" (UID: \"831dc05c-c0a7-4272-98f0-e3b956a47ccf\") " pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:06.660289 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:06.660273    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 09:18:06.660347 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:06.660295    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 09:18:06.660347 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:06.660308    2560 projected.go:196] Error preparing data for projected volume kube-api-access-8dsdp for pod openshift-network-diagnostics/network-check-target-9x5jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:06.660442 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:06.660369    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp podName:831dc05c-c0a7-4272-98f0-e3b956a47ccf nodeName:}" failed. No retries permitted until 2026-07-17 09:18:10.660350813 +0000 UTC m=+10.152045199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dsdp" (UniqueName: "kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp") pod "network-check-target-9x5jk" (UID: "831dc05c-c0a7-4272-98f0-e3b956a47ccf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:07.178534 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:07.178497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:07.178701 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:07.178502    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:07.178701 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:07.178634    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:07.179163 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:07.178715    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:08.178550 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:08.178343    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:08.178550 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:08.178453    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:09.178586 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:09.178509    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:09.178740 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:09.178656    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:09.179129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:09.179092    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:09.179217 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:09.179192    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:10.177847 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:10.177812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:10.177995 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:10.177959    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:10.591850 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:10.591754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:10.592297 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:10.591887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:10.592297 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:10.591911    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:10.592297 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:10.591988    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs podName:9a86c19b-a795-4528-89f0-5f7377a569d7 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:18.591967366 +0000 UTC m=+18.083661765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs") pod "network-metrics-daemon-l78lc" (UID: "9a86c19b-a795-4528-89f0-5f7377a569d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:10.592297 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:10.591993    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:10.592297 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:10.592045    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret podName:e26a86fd-e979-4246-af0d-5881142edd51 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:18.592029314 +0000 UTC m=+18.083723698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret") pod "global-pull-secret-syncer-zrdcn" (UID: "e26a86fd-e979-4246-af0d-5881142edd51") : object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:10.693128 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:10.693082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsdp\" (UniqueName: \"kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp\") pod \"network-check-target-9x5jk\" (UID: \"831dc05c-c0a7-4272-98f0-e3b956a47ccf\") " pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:10.693296 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:10.693256    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 09:18:10.693372 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:10.693301    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 09:18:10.693372 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:10.693330    2560 projected.go:196] Error preparing data for projected volume kube-api-access-8dsdp for pod openshift-network-diagnostics/network-check-target-9x5jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:10.693472 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:10.693393    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp podName:831dc05c-c0a7-4272-98f0-e3b956a47ccf nodeName:}" failed. No retries permitted until 2026-07-17 09:18:18.693374174 +0000 UTC m=+18.185068573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dsdp" (UniqueName: "kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp") pod "network-check-target-9x5jk" (UID: "831dc05c-c0a7-4272-98f0-e3b956a47ccf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:11.178903 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:11.178871    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:11.179063 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:11.179009    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:11.179063 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:11.179044    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:11.179198 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:11.179169    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:12.178288 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:12.178255    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:12.178749 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:12.178375    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:13.178339 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:13.177861    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:13.178339 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:13.177980    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:13.178339 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:13.178029    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:13.178339 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:13.178151    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:14.178752 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:14.178714    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:14.179153 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:14.178851    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:15.177870 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:15.177832    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:15.178021 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:15.177834    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:15.178021 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:15.177989    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:15.178123 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:15.178051    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:16.177834 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:16.177801    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:16.178276 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:16.177930    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:17.178460 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:17.178428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:17.178899 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:17.178437    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:17.178899 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:17.178565    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:17.178899 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:17.178663    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:18.178352 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:18.178268    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:18.178542 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:18.178390    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:18.282681 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:18.282641    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal" event={"ID":"c65581df230d7f42838c46f439cf3795","Type":"ContainerStarted","Data":"c02cae232718f027a5d119f01e7b1d7e1271442365852f2ad2b37995ee490696"}
Jul 17 09:18:18.301984 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:18.301930    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-131.ec2.internal" podStartSLOduration=16.301915786 podStartE2EDuration="16.301915786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:18.30130466 +0000 UTC m=+17.792999267" watchObservedRunningTime="2026-07-17 09:18:18.301915786 +0000 UTC m=+17.793610192"
Jul 17 09:18:18.653149 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:18.653052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:18.653149 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:18.653114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:18.653371 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:18.653216    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:18.653371 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:18.653218    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:18.653371 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:18.653277    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs podName:9a86c19b-a795-4528-89f0-5f7377a569d7 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:34.653258082 +0000 UTC m=+34.144952485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs") pod "network-metrics-daemon-l78lc" (UID: "9a86c19b-a795-4528-89f0-5f7377a569d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:18.653371 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:18.653299    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret podName:e26a86fd-e979-4246-af0d-5881142edd51 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:34.653287214 +0000 UTC m=+34.144981599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret") pod "global-pull-secret-syncer-zrdcn" (UID: "e26a86fd-e979-4246-af0d-5881142edd51") : object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:18.754181 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:18.754144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsdp\" (UniqueName: \"kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp\") pod \"network-check-target-9x5jk\" (UID: \"831dc05c-c0a7-4272-98f0-e3b956a47ccf\") " pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:18.754363 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:18.754306    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 09:18:18.754363 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:18.754330    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 09:18:18.754363 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:18.754345    2560 projected.go:196] Error preparing data for projected volume kube-api-access-8dsdp for pod openshift-network-diagnostics/network-check-target-9x5jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:18.754479 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:18.754406    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp podName:831dc05c-c0a7-4272-98f0-e3b956a47ccf nodeName:}" failed. No retries permitted until 2026-07-17 09:18:34.754390432 +0000 UTC m=+34.246084833 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dsdp" (UniqueName: "kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp") pod "network-check-target-9x5jk" (UID: "831dc05c-c0a7-4272-98f0-e3b956a47ccf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:19.178318 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:19.178282    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:19.178318 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:19.178316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:19.178563 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:19.178403    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:19.178563 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:19.178498    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:20.178671 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:20.178637    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:20.179172 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:20.178750    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:21.179637 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:21.179599    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:21.180113 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:21.179711    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:21.180113 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:21.179812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:21.180113 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:21.179935    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:22.178716 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.178498    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:22.178872 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:22.178850    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:22.290168 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.290144    2560 generic.go:356] "Generic (PLEG): container finished" podID="62743f2a-e9dd-485c-8d68-32c9a3195c37" containerID="0ad1757ae12a4062b65150ebfac343385eb046fe3e30a592bc9b8a33f22350ca" exitCode=0
Jul 17 09:18:22.290858 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.290232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r725x" event={"ID":"62743f2a-e9dd-485c-8d68-32c9a3195c37","Type":"ContainerDied","Data":"0ad1757ae12a4062b65150ebfac343385eb046fe3e30a592bc9b8a33f22350ca"}
Jul 17 09:18:22.291612 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.291592    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5dt7g" event={"ID":"8c8e2ec5-68c6-43df-87e9-b6100da255e6","Type":"ContainerStarted","Data":"e8e1e33cc597ac591992f41734b69465bae6f6dc1512a8aaa41bfa0c8a0a6ab2"}
Jul 17 09:18:22.293211 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.293174    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mgltv" event={"ID":"84807261-d1ec-4148-9c9c-776f43fdd74a","Type":"ContainerStarted","Data":"b4fcdf2d7fc775b6881a1f9658e8b04f191334c82528b57f500c079d2527d568"}
Jul 17 09:18:22.294647 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.294624    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bzqg2" event={"ID":"4b72f06c-2e86-4cb6-a43a-5718771d3bbf","Type":"ContainerStarted","Data":"29b618524367849fc8216694870fa29ce5ac51d6be1592b05b4405d617914eb3"}
Jul 17 09:18:22.296046 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.296023    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gcl4j" event={"ID":"86eae500-f996-4f04-9792-5a5af6c9c893","Type":"ContainerStarted","Data":"6d653629aa09a8cd6738a51decc06023904614fdf1717bcafe47e201b5d2674c"}
Jul 17 09:18:22.297392 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.297374    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b" event={"ID":"be48fad1-53e1-475d-838d-7df345fdac0d","Type":"ContainerStarted","Data":"7b4d38f06a324d122ad02e20db19c779ab112ae204222ac35892b4e01564b2ec"}
Jul 17 09:18:22.300047 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.300027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q" event={"ID":"fb04d6e3-f7e4-4699-a891-c52edfe78c59","Type":"ContainerStarted","Data":"046d6f84b4c5dcc562d4ff02f24b7b791053a45eb81e1aa6385fb6cd7fd3dc7e"}
Jul 17 09:18:22.300158 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.300088    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q" event={"ID":"fb04d6e3-f7e4-4699-a891-c52edfe78c59","Type":"ContainerStarted","Data":"7eb33ccf2b1e72091d0f1581ae46389453ec3c7e7b991255d22a2fd287d86c28"}
Jul 17 09:18:22.300158 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.300130    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q" event={"ID":"fb04d6e3-f7e4-4699-a891-c52edfe78c59","Type":"ContainerStarted","Data":"14918167f629639302a790d3e3751c23fea44c0307edc0c6547c9d37362046cc"}
Jul 17 09:18:22.300261 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.300161    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q" event={"ID":"fb04d6e3-f7e4-4699-a891-c52edfe78c59","Type":"ContainerStarted","Data":"0578c9fe716e25c39a2b82d9b6aaf1f9cb57dcc4022455d9d0fa285f580a4a5e"}
Jul 17 09:18:22.300261 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.300188    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q" event={"ID":"fb04d6e3-f7e4-4699-a891-c52edfe78c59","Type":"ContainerStarted","Data":"dabd02c9160e5ef1915bade2768d0b862907a4c6ce88f11a4b73b8eec0dc1d2b"}
Jul 17 09:18:22.301529 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.301505    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p4qvx" event={"ID":"cc9d19c5-2c07-4534-b47d-b7815d3f2892","Type":"ContainerStarted","Data":"48b95c455487632e24e1fa8bd2d0dd7557ac114ee61e5b3f788746f5238880d0"}
Jul 17 09:18:22.340602 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.340549    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p4qvx" podStartSLOduration=6.908182224 podStartE2EDuration="21.34052983s" totalImagesPullingTime="14.432347606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:22.339687606 +0000 UTC m=+21.831382012" watchObservedRunningTime="2026-07-17 09:18:22.34052983 +0000 UTC m=+21.832224237"
Jul 17 09:18:22.356198 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.356114    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gcl4j" podStartSLOduration=7.133387579 podStartE2EDuration="21.356096696s" totalImagesPullingTime="14.222709117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:22.355812302 +0000 UTC m=+21.847506793" watchObservedRunningTime="2026-07-17 09:18:22.356096696 +0000 UTC m=+21.847791104"
Jul 17 09:18:22.379266 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.379222    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bzqg2" podStartSLOduration=2.80409421 podStartE2EDuration="21.379207775s" totalImagesPullingTime="18.575113565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:22.379178298 +0000 UTC m=+21.870872726" watchObservedRunningTime="2026-07-17 09:18:22.379207775 +0000 UTC m=+21.870902181"
Jul 17 09:18:22.398632 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.398593    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mgltv" podStartSLOduration=7.044539985 podStartE2EDuration="21.398579187s" totalImagesPullingTime="14.354039202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:22.398383255 +0000 UTC m=+21.890077663" watchObservedRunningTime="2026-07-17 09:18:22.398579187 +0000 UTC m=+21.890273612"
Jul 17 09:18:22.426407 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:22.426359    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5dt7g" podStartSLOduration=7.049489724 podStartE2EDuration="21.426346011s" totalImagesPullingTime="14.376856287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:22.425263578 +0000 UTC m=+21.916957983" watchObservedRunningTime="2026-07-17 09:18:22.426346011 +0000 UTC m=+21.918040416"
Jul 17 09:18:23.178853 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:23.178824    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:23.178853 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:23.178840    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:23.179083 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:23.178928    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:23.179083 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:23.179043    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:23.214875 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:23.214828    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:23.306854 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:23.306818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q" event={"ID":"fb04d6e3-f7e4-4699-a891-c52edfe78c59","Type":"ContainerStarted","Data":"6762251b1ae5bb54adc05ca37f781f3db06fcafc981e04b15bb5c124529b89b1"}
Jul 17 09:18:23.308610 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:23.308558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rsfkq" event={"ID":"29f42b87-7a7e-40e9-a9eb-d8502e5cb33a","Type":"ContainerStarted","Data":"3881fde714721dae7aca18fc2015756af53e2b7ec33cd3687f742092369bb232"}
Jul 17 09:18:23.329042 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:23.328987    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rsfkq" podStartSLOduration=7.957314474 podStartE2EDuration="22.328964438s" totalImagesPullingTime="14.371649964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:23.328897067 +0000 UTC m=+22.820591483" watchObservedRunningTime="2026-07-17 09:18:23.328964438 +0000 UTC m=+22.820658846"
Jul 17 09:18:23.373909 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:23.373881    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 09:18:24.002193 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:24.002077    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T09:18:23.373903859Z","UUID":"4807b1ea-ca17-4b7a-8751-3f8fd1b0da1f","Handler":null,"Name":"","Endpoint":""}
Jul 17 09:18:24.003662 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:24.003639    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 09:18:24.003804 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:24.003685    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 09:18:24.178482 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:24.178456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:24.178645 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:24.178599    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:24.314450 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:24.313744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b" event={"ID":"be48fad1-53e1-475d-838d-7df345fdac0d","Type":"ContainerStarted","Data":"9ce970b7717d8e198d5aa242621fe2b2af872c4acde1988a6373f6f4c3c925a3"}
Jul 17 09:18:25.178338 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:25.178309    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:25.178580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:25.178317    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:25.178580 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:25.178424    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:25.178580 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:25.178485    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:25.318497 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:25.318457    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b" event={"ID":"be48fad1-53e1-475d-838d-7df345fdac0d","Type":"ContainerStarted","Data":"cda2159fe9d2209e7636affdff749ca47a5c6c0e3d161a3d8fae1c09096df59f"}
Jul 17 09:18:25.322603 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:25.322570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q" event={"ID":"fb04d6e3-f7e4-4699-a891-c52edfe78c59","Type":"ContainerStarted","Data":"538eba032d69c12e96b915655f0cfede20c0759816268a622566b65d4bc3b781"}
Jul 17 09:18:26.178120 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:26.177925    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:26.178300 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:26.178217    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:26.529404 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:26.529370    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:26.530182 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:26.529979    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:26.548427 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:26.548377    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rh5b" podStartSLOduration=8.921935402 podStartE2EDuration="25.548359535s" totalImagesPullingTime="16.626424133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:25.338391478 +0000 UTC m=+24.830085896" watchObservedRunningTime="2026-07-17 09:18:26.548359535 +0000 UTC m=+26.040053943"
Jul 17 09:18:27.178075 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:27.177996    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:27.178295 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:27.178144    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:27.178295 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:27.178205    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:27.178407 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:27.178317    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:27.327796 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:27.327752    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5dt7g"
Jul 17 09:18:28.178002 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:28.177933    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:28.178545 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:28.178043    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:28.333237 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:28.333196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q" event={"ID":"fb04d6e3-f7e4-4699-a891-c52edfe78c59","Type":"ContainerStarted","Data":"a554e0dcae45aa92b89b3271ea6ebda8c58a03f803de02312870034927e453c2"}
Jul 17 09:18:29.178232 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:29.178191    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:29.178714 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:29.178191    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:29.178714 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:29.178306    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:29.178714 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:29.178424    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:29.337159 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:29.337128    2560 generic.go:356] "Generic (PLEG): container finished" podID="62743f2a-e9dd-485c-8d68-32c9a3195c37" containerID="00b704ad40e688846d4d87eb7cc6da74d34712ad89eb4458687f123d184a9840" exitCode=0
Jul 17 09:18:29.337371 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:29.337212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r725x" event={"ID":"62743f2a-e9dd-485c-8d68-32c9a3195c37","Type":"ContainerDied","Data":"00b704ad40e688846d4d87eb7cc6da74d34712ad89eb4458687f123d184a9840"}
Jul 17 09:18:29.337651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:29.337636    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:29.337753 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:29.337733    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:29.337894 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:29.337812    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:29.352985 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:29.352959    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:29.353176 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:29.353161    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:18:29.367572 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:29.367531    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q" podStartSLOduration=9.706694206 podStartE2EDuration="28.367516023s" totalImagesPullingTime="18.660821817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:28.382641902 +0000 UTC m=+27.874336310" watchObservedRunningTime="2026-07-17 09:18:29.367516023 +0000 UTC m=+28.859210428"
Jul 17 09:18:30.177995 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:30.177962    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:30.178196 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:30.178083    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:30.191344 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:30.191318    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrdcn"]
Jul 17 09:18:30.194969 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:30.194946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9x5jk"]
Jul 17 09:18:30.195083 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:30.195029    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:30.195126 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:30.195102    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:30.213621 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:30.213597    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l78lc"]
Jul 17 09:18:30.213703 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:30.213684    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:30.213823 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:30.213802    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:30.338870 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:30.338843    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:30.339036 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:30.338942    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:31.342912 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:31.342877    2560 generic.go:356] "Generic (PLEG): container finished" podID="62743f2a-e9dd-485c-8d68-32c9a3195c37" containerID="b6a69b4f3ec281b0d261ab1d50146608a517e3ef2526c7e79f01c006802a70b0" exitCode=0
Jul 17 09:18:31.343352 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:31.342968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r725x" event={"ID":"62743f2a-e9dd-485c-8d68-32c9a3195c37","Type":"ContainerDied","Data":"b6a69b4f3ec281b0d261ab1d50146608a517e3ef2526c7e79f01c006802a70b0"}
Jul 17 09:18:32.178603 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:32.178435    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:32.178747 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:32.178435    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:32.178747 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:32.178677    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:32.178853 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:32.178435    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:32.178853 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:32.178757    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:32.178853 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:32.178843    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:33.349719 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:33.349682    2560 generic.go:356] "Generic (PLEG): container finished" podID="62743f2a-e9dd-485c-8d68-32c9a3195c37" containerID="45f2f21362a5eb2815e94a12188322847252fcdad5534dd291bc93397184b3cd" exitCode=0
Jul 17 09:18:33.350212 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:33.349725    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r725x" event={"ID":"62743f2a-e9dd-485c-8d68-32c9a3195c37","Type":"ContainerDied","Data":"45f2f21362a5eb2815e94a12188322847252fcdad5534dd291bc93397184b3cd"}
Jul 17 09:18:34.178385 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.178347    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:34.178667 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.178350    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:34.178667 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.178486    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:34.178667 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:34.178489    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l78lc" podUID="9a86c19b-a795-4528-89f0-5f7377a569d7"
Jul 17 09:18:34.178667 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:34.178574    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9x5jk" podUID="831dc05c-c0a7-4272-98f0-e3b956a47ccf"
Jul 17 09:18:34.178993 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:34.178683    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrdcn" podUID="e26a86fd-e979-4246-af0d-5881142edd51"
Jul 17 09:18:34.674732 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.674647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:34.674732 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.674716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:34.675188 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:34.674817    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:34.675188 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:34.674874    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret podName:e26a86fd-e979-4246-af0d-5881142edd51 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:06.674856365 +0000 UTC m=+66.166550763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret") pod "global-pull-secret-syncer-zrdcn" (UID: "e26a86fd-e979-4246-af0d-5881142edd51") : object "kube-system"/"original-pull-secret" not registered
Jul 17 09:18:34.675188 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:34.674818    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:34.675188 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:34.674965    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs podName:9a86c19b-a795-4528-89f0-5f7377a569d7 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:06.674945271 +0000 UTC m=+66.166639658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs") pod "network-metrics-daemon-l78lc" (UID: "9a86c19b-a795-4528-89f0-5f7377a569d7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 09:18:34.775384 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.775349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsdp\" (UniqueName: \"kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp\") pod \"network-check-target-9x5jk\" (UID: \"831dc05c-c0a7-4272-98f0-e3b956a47ccf\") " pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:34.775560 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:34.775508    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 09:18:34.775560 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:34.775526    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 09:18:34.775560 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:34.775537    2560 projected.go:196] Error preparing data for projected volume kube-api-access-8dsdp for pod openshift-network-diagnostics/network-check-target-9x5jk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:34.775716 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:34.775582    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp podName:831dc05c-c0a7-4272-98f0-e3b956a47ccf nodeName:}" failed. No retries permitted until 2026-07-17 09:19:06.775569334 +0000 UTC m=+66.267263718 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dsdp" (UniqueName: "kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp") pod "network-check-target-9x5jk" (UID: "831dc05c-c0a7-4272-98f0-e3b956a47ccf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 09:18:34.820658 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.820631    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-131.ec2.internal" event="NodeReady"
Jul 17 09:18:34.820811 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.820750    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 09:18:34.867080 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.867056    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-97d5c8896-mcb7h"]
Jul 17 09:18:34.882840 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.882815    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:34.885288 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.885270    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 09:18:34.885428 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.885398    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7jzf9\""
Jul 17 09:18:34.885428 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.885397    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 09:18:34.885544 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.885500    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 09:18:34.889742 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.889719    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sx2fn"]
Jul 17 09:18:34.898013 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.897990    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 09:18:34.911162 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.911134    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tn85c"]
Jul 17 09:18:34.911298 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.911277    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:34.913939 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.913921    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 09:18:34.914390 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.914373    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 09:18:34.914489 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.914378    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4mh5z\""
Jul 17 09:18:34.926987 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.926937    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-97d5c8896-mcb7h"]
Jul 17 09:18:34.926987 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.926968    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tn85c"]
Jul 17 09:18:34.926987 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.926983    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sx2fn"]
Jul 17 09:18:34.927141 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.927017    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tn85c"
Jul 17 09:18:34.929864 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.929843    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 09:18:34.929967 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.929844    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 09:18:34.929967 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.929946    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cdjx7\""
Jul 17 09:18:34.930069 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.929991    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 09:18:34.977692 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.977667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w2p7\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-kube-api-access-9w2p7\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:34.977866 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.977711    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:34.977866 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.977731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-certificates\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:34.977866 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.977806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-bound-sa-token\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:34.977866 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.977851    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-trusted-ca\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:34.978068 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.977883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-installation-pull-secrets\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:34.978068 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.977931    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-image-registry-private-configuration\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:34.978068 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:34.977972    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f244fd94-2db7-419d-9adb-77c274aaf12b-ca-trust-extracted\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.079237 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w2p7\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-kube-api-access-9w2p7\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.079403 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.079403 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-certificates\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.079403 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079329    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.079403 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079352    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr6f8\" (UniqueName: \"kubernetes.io/projected/a17822fc-0486-4589-8572-77562adfcfe5-kube-api-access-jr6f8\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.079403 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-bound-sa-token\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.079633 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-trusted-ca\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.079633 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-installation-pull-secrets\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.079633 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/545402ad-c7ce-44e3-b164-b2d91e838e53-cert\") pod \"ingress-canary-tn85c\" (UID: \"545402ad-c7ce-44e3-b164-b2d91e838e53\") " pod="openshift-ingress-canary/ingress-canary-tn85c"
Jul 17 09:18:35.079633 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-image-registry-private-configuration\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.079633 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f244fd94-2db7-419d-9adb-77c274aaf12b-ca-trust-extracted\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.079633 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:35.079616    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 09:18:35.079633 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:35.079636    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97d5c8896-mcb7h: secret "image-registry-tls" not found
Jul 17 09:18:35.080049 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:35.079705    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls podName:f244fd94-2db7-419d-9adb-77c274aaf12b nodeName:}" failed. No retries permitted until 2026-07-17 09:18:35.579682376 +0000 UTC m=+35.071376779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls") pod "image-registry-97d5c8896-mcb7h" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b") : secret "image-registry-tls" not found
Jul 17 09:18:35.080049 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.079996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a17822fc-0486-4589-8572-77562adfcfe5-tmp-dir\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.080049 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.080010    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f244fd94-2db7-419d-9adb-77c274aaf12b-ca-trust-extracted\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.080207 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.080066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a17822fc-0486-4589-8572-77562adfcfe5-config-volume\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.080207 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.080097    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr6vx\" (UniqueName: \"kubernetes.io/projected/545402ad-c7ce-44e3-b164-b2d91e838e53-kube-api-access-dr6vx\") pod \"ingress-canary-tn85c\" (UID: \"545402ad-c7ce-44e3-b164-b2d91e838e53\") " pod="openshift-ingress-canary/ingress-canary-tn85c"
Jul 17 09:18:35.080500 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.080471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-certificates\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.080966 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.080922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-trusted-ca\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.084232 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.084174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-image-registry-private-configuration\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.084232 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.084183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-installation-pull-secrets\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.090675 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.090655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-bound-sa-token\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.092538 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.092517    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w2p7\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-kube-api-access-9w2p7\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.180740 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.180654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a17822fc-0486-4589-8572-77562adfcfe5-tmp-dir\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.180740 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.180717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a17822fc-0486-4589-8572-77562adfcfe5-config-volume\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.180960 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.180747    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr6vx\" (UniqueName: \"kubernetes.io/projected/545402ad-c7ce-44e3-b164-b2d91e838e53-kube-api-access-dr6vx\") pod \"ingress-canary-tn85c\" (UID: \"545402ad-c7ce-44e3-b164-b2d91e838e53\") " pod="openshift-ingress-canary/ingress-canary-tn85c"
Jul 17 09:18:35.180960 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.180844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.180960 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.180868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr6f8\" (UniqueName: \"kubernetes.io/projected/a17822fc-0486-4589-8572-77562adfcfe5-kube-api-access-jr6f8\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.180960 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.180907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/545402ad-c7ce-44e3-b164-b2d91e838e53-cert\") pod \"ingress-canary-tn85c\" (UID: \"545402ad-c7ce-44e3-b164-b2d91e838e53\") " pod="openshift-ingress-canary/ingress-canary-tn85c"
Jul 17 09:18:35.181170 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.181015    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a17822fc-0486-4589-8572-77562adfcfe5-tmp-dir\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.181251 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:35.181231    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 09:18:35.181310 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:35.181297    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls podName:a17822fc-0486-4589-8572-77562adfcfe5 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:35.681277929 +0000 UTC m=+35.172972331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls") pod "dns-default-sx2fn" (UID: "a17822fc-0486-4589-8572-77562adfcfe5") : secret "dns-default-metrics-tls" not found
Jul 17 09:18:35.181899 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.181874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a17822fc-0486-4589-8572-77562adfcfe5-config-volume\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.183495 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.183473    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/545402ad-c7ce-44e3-b164-b2d91e838e53-cert\") pod \"ingress-canary-tn85c\" (UID: \"545402ad-c7ce-44e3-b164-b2d91e838e53\") " pod="openshift-ingress-canary/ingress-canary-tn85c"
Jul 17 09:18:35.192387 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.192364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr6f8\" (UniqueName: \"kubernetes.io/projected/a17822fc-0486-4589-8572-77562adfcfe5-kube-api-access-jr6f8\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.192751 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.192729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr6vx\" (UniqueName: \"kubernetes.io/projected/545402ad-c7ce-44e3-b164-b2d91e838e53-kube-api-access-dr6vx\") pod \"ingress-canary-tn85c\" (UID: \"545402ad-c7ce-44e3-b164-b2d91e838e53\") " pod="openshift-ingress-canary/ingress-canary-tn85c"
Jul 17 09:18:35.236849 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.236828    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tn85c"
Jul 17 09:18:35.411336 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.411177    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tn85c"]
Jul 17 09:18:35.414766 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:18:35.414738    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545402ad_c7ce_44e3_b164_b2d91e838e53.slice/crio-56fd02e3365f17e1f6505ae6ef903313a41ea7a3533696798e321e9151bccb8b WatchSource:0}: Error finding container 56fd02e3365f17e1f6505ae6ef903313a41ea7a3533696798e321e9151bccb8b: Status 404 returned error can't find the container with id 56fd02e3365f17e1f6505ae6ef903313a41ea7a3533696798e321e9151bccb8b
Jul 17 09:18:35.585093 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.584993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:35.585237 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:35.585125    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 09:18:35.585237 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:35.585138    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97d5c8896-mcb7h: secret "image-registry-tls" not found
Jul 17 09:18:35.585237 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:35.585185    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls podName:f244fd94-2db7-419d-9adb-77c274aaf12b nodeName:}" failed. No retries permitted until 2026-07-17 09:18:36.58517251 +0000 UTC m=+36.076866894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls") pod "image-registry-97d5c8896-mcb7h" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b") : secret "image-registry-tls" not found
Jul 17 09:18:35.686069 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:35.686039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:35.686689 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:35.686194    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 09:18:35.686689 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:35.686251    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls podName:a17822fc-0486-4589-8572-77562adfcfe5 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:36.686235765 +0000 UTC m=+36.177930154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls") pod "dns-default-sx2fn" (UID: "a17822fc-0486-4589-8572-77562adfcfe5") : secret "dns-default-metrics-tls" not found
Jul 17 09:18:36.178663 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.178586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:18:36.178895 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.178586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:18:36.178895 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.178586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:18:36.181799 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.181578    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 09:18:36.182839 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.182572    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 09:18:36.182839 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.182661    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 09:18:36.182839 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.182618    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dzpfx\""
Jul 17 09:18:36.183060 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.182848    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2lf7\""
Jul 17 09:18:36.183060 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.182942    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 09:18:36.359479 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.359439    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tn85c" event={"ID":"545402ad-c7ce-44e3-b164-b2d91e838e53","Type":"ContainerStarted","Data":"56fd02e3365f17e1f6505ae6ef903313a41ea7a3533696798e321e9151bccb8b"}
Jul 17 09:18:36.594649 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.594564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:36.594818 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:36.594726    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 09:18:36.594818 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:36.594740    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97d5c8896-mcb7h: secret "image-registry-tls" not found
Jul 17 09:18:36.594818 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:36.594818    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls podName:f244fd94-2db7-419d-9adb-77c274aaf12b nodeName:}" failed. No retries permitted until 2026-07-17 09:18:38.594790941 +0000 UTC m=+38.086485344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls") pod "image-registry-97d5c8896-mcb7h" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b") : secret "image-registry-tls" not found
Jul 17 09:18:36.695354 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:36.695322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:36.695817 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:36.695484    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 09:18:36.695817 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:36.695543    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls podName:a17822fc-0486-4589-8572-77562adfcfe5 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:38.695525128 +0000 UTC m=+38.187219514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls") pod "dns-default-sx2fn" (UID: "a17822fc-0486-4589-8572-77562adfcfe5") : secret "dns-default-metrics-tls" not found
Jul 17 09:18:38.309592 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:38.309558    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:38.486504 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:38.486472    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:38.591169 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:38.591085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:38.609440 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:38.609407    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:38.609587 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:38.609569    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 09:18:38.609587 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:38.609584    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97d5c8896-mcb7h: secret "image-registry-tls" not found
Jul 17 09:18:38.609674 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:38.609645    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls podName:f244fd94-2db7-419d-9adb-77c274aaf12b nodeName:}" failed. No retries permitted until 2026-07-17 09:18:42.609629506 +0000 UTC m=+42.101323894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls") pod "image-registry-97d5c8896-mcb7h" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b") : secret "image-registry-tls" not found
Jul 17 09:18:38.710712 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:38.710672    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:38.710895 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:38.710864    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 09:18:38.710963 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:38.710942    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls podName:a17822fc-0486-4589-8572-77562adfcfe5 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:42.710927147 +0000 UTC m=+42.202621531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls") pod "dns-default-sx2fn" (UID: "a17822fc-0486-4589-8572-77562adfcfe5") : secret "dns-default-metrics-tls" not found
Jul 17 09:18:38.715439 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:38.715407    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:39.313973 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:39.313942    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:39.368566 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:39.368529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r725x" event={"ID":"62743f2a-e9dd-485c-8d68-32c9a3195c37","Type":"ContainerStarted","Data":"3d3bfcfa3e9d8337663f2b4b0835d725ff652421b3b2512d98c3a696b5cdf291"}
Jul 17 09:18:39.370015 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:39.369990    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tn85c" event={"ID":"545402ad-c7ce-44e3-b164-b2d91e838e53","Type":"ContainerStarted","Data":"e316604f2c0c20bcff6f4caf0c73cb2938b0eb137980877c5bc584f7e66f1e94"}
Jul 17 09:18:39.432211 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:39.432132    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tn85c" podStartSLOduration=1.632698275 podStartE2EDuration="5.432113791s" totalImagesPullingTime="3.799415516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:39.431495623 +0000 UTC m=+38.923190030" watchObservedRunningTime="2026-07-17 09:18:39.432113791 +0000 UTC m=+38.923808197"
Jul 17 09:18:39.436704 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:39.436683    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:39.707393 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:39.707310    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:39.878330 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:39.878299    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:40.375215 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:40.375039    2560 generic.go:356] "Generic (PLEG): container finished" podID="62743f2a-e9dd-485c-8d68-32c9a3195c37" containerID="3d3bfcfa3e9d8337663f2b4b0835d725ff652421b3b2512d98c3a696b5cdf291" exitCode=0
Jul 17 09:18:40.375608 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:40.375116    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r725x" event={"ID":"62743f2a-e9dd-485c-8d68-32c9a3195c37","Type":"ContainerDied","Data":"3d3bfcfa3e9d8337663f2b4b0835d725ff652421b3b2512d98c3a696b5cdf291"}
Jul 17 09:18:40.389763 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:40.389734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:40.537964 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:40.537941    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:41.380825 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:41.380789    2560 generic.go:356] "Generic (PLEG): container finished" podID="62743f2a-e9dd-485c-8d68-32c9a3195c37" containerID="06822c48c95f15ebc390f2f59b69ee7ed176908640edaa94aa2edf8ded3c3869" exitCode=0
Jul 17 09:18:41.380825 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:41.380805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r725x" event={"ID":"62743f2a-e9dd-485c-8d68-32c9a3195c37","Type":"ContainerDied","Data":"06822c48c95f15ebc390f2f59b69ee7ed176908640edaa94aa2edf8ded3c3869"}
Jul 17 09:18:41.892759 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:41.892734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:42.136483 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:42.136453    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:42.386474 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:42.386392    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r725x" event={"ID":"62743f2a-e9dd-485c-8d68-32c9a3195c37","Type":"ContainerStarted","Data":"a976fd6e5736c885289cb830dab85e02e24cf873a6c44e9e96742139ff316bd1"}
Jul 17 09:18:42.417635 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:42.417567    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r725x" podStartSLOduration=12.589114642 podStartE2EDuration="41.417551562s" totalImagesPullingTime="28.82843692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:18:42.417242955 +0000 UTC m=+41.908937366" watchObservedRunningTime="2026-07-17 09:18:42.417551562 +0000 UTC m=+41.909245989"
Jul 17 09:18:42.643936 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:42.643847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:42.644090 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:42.643993    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 09:18:42.644090 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:42.644007    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97d5c8896-mcb7h: secret "image-registry-tls" not found
Jul 17 09:18:42.644090 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:42.644058    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls podName:f244fd94-2db7-419d-9adb-77c274aaf12b nodeName:}" failed. No retries permitted until 2026-07-17 09:18:50.644044254 +0000 UTC m=+50.135738651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls") pod "image-registry-97d5c8896-mcb7h" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b") : secret "image-registry-tls" not found
Jul 17 09:18:42.652178 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:42.652150    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:42.744645 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:42.744612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:42.744808 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:42.744750    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 09:18:42.744868 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:42.744823    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls podName:a17822fc-0486-4589-8572-77562adfcfe5 nodeName:}" failed. No retries permitted until 2026-07-17 09:18:50.744809662 +0000 UTC m=+50.236504046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls") pod "dns-default-sx2fn" (UID: "a17822fc-0486-4589-8572-77562adfcfe5") : secret "dns-default-metrics-tls" not found
Jul 17 09:18:44.028973 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:44.028937    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:46.204286 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:46.204253    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:46.301053 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:46.301007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:49.554842 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:49.554801    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:49.718197 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:49.718168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:18:50.705172 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:50.705135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:18:50.705519 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:50.705256    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 09:18:50.705519 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:50.705268    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97d5c8896-mcb7h: secret "image-registry-tls" not found
Jul 17 09:18:50.705519 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:50.705317    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls podName:f244fd94-2db7-419d-9adb-77c274aaf12b nodeName:}" failed. No retries permitted until 2026-07-17 09:19:06.705304733 +0000 UTC m=+66.196999116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls") pod "image-registry-97d5c8896-mcb7h" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b") : secret "image-registry-tls" not found
Jul 17 09:18:50.805577 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:18:50.805540    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:18:50.805737 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:50.805684    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 09:18:50.805797 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:18:50.805743    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls podName:a17822fc-0486-4589-8572-77562adfcfe5 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:06.805727472 +0000 UTC m=+66.297421869 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls") pod "dns-default-sx2fn" (UID: "a17822fc-0486-4589-8572-77562adfcfe5") : secret "dns-default-metrics-tls" not found
Jul 17 09:19:00.040112 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:00.040075    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:00.143226 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:00.143197    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:01.084422 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:01.084370    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:01.279093 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:01.279062    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:01.356907 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:01.356835    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rf9q"
Jul 17 09:19:01.608830 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:01.608725    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:01.783417 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:01.783385    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:03.031657 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:03.031625    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:06.716356 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.716303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:19:06.716356 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.716364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:19:06.716820 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.716391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:19:06.716820 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:06.716504    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 09:19:06.716820 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:06.716517    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97d5c8896-mcb7h: secret "image-registry-tls" not found
Jul 17 09:19:06.716820 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:06.716583    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls podName:f244fd94-2db7-419d-9adb-77c274aaf12b nodeName:}" failed. No retries permitted until 2026-07-17 09:19:38.716570106 +0000 UTC m=+98.208264490 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls") pod "image-registry-97d5c8896-mcb7h" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b") : secret "image-registry-tls" not found
Jul 17 09:19:06.719555 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.719530    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 09:19:06.719555 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.719530    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 09:19:06.727473 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:06.727449    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 17 09:19:06.727580 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:06.727503    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs podName:9a86c19b-a795-4528-89f0-5f7377a569d7 nodeName:}" failed. No retries permitted until 2026-07-17 09:20:10.72748806 +0000 UTC m=+130.219182447 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs") pod "network-metrics-daemon-l78lc" (UID: "9a86c19b-a795-4528-89f0-5f7377a569d7") : secret "metrics-daemon-secret" not found
Jul 17 09:19:06.731120 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.731093    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e26a86fd-e979-4246-af0d-5881142edd51-original-pull-secret\") pod \"global-pull-secret-syncer-zrdcn\" (UID: \"e26a86fd-e979-4246-af0d-5881142edd51\") " pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:19:06.810284 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.810235    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrdcn"
Jul 17 09:19:06.816992 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.816965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:19:06.817112 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.817000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsdp\" (UniqueName: \"kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp\") pod \"network-check-target-9x5jk\" (UID: \"831dc05c-c0a7-4272-98f0-e3b956a47ccf\") " pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:19:06.817165 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:06.817118    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 09:19:06.817214 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:06.817174    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls podName:a17822fc-0486-4589-8572-77562adfcfe5 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:38.817157721 +0000 UTC m=+98.308852114 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls") pod "dns-default-sx2fn" (UID: "a17822fc-0486-4589-8572-77562adfcfe5") : secret "dns-default-metrics-tls" not found
Jul 17 09:19:06.820472 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.820448    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 09:19:06.830649 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.830629    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 09:19:06.840057 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.840036    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dsdp\" (UniqueName: \"kubernetes.io/projected/831dc05c-c0a7-4272-98f0-e3b956a47ccf-kube-api-access-8dsdp\") pod \"network-check-target-9x5jk\" (UID: \"831dc05c-c0a7-4272-98f0-e3b956a47ccf\") " pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:19:06.935635 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:06.935602    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrdcn"]
Jul 17 09:19:06.938541 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:19:06.938502    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26a86fd_e979_4246_af0d_5881142edd51.slice/crio-4e473e986f8fdcb4763ddd778beba211f07aba7cdc75b727a0eb1d59a0d29054 WatchSource:0}: Error finding container 4e473e986f8fdcb4763ddd778beba211f07aba7cdc75b727a0eb1d59a0d29054: Status 404 returned error can't find the container with id 4e473e986f8fdcb4763ddd778beba211f07aba7cdc75b727a0eb1d59a0d29054
Jul 17 09:19:07.105566 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:07.105489    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dzpfx\""
Jul 17 09:19:07.112995 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:07.112972    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:19:07.247272 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:07.247246    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9x5jk"]
Jul 17 09:19:07.250042 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:19:07.250019    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831dc05c_c0a7_4272_98f0_e3b956a47ccf.slice/crio-ed183ec4b6e52af2bf48194df37b323816395688950ea472db948413518039c7 WatchSource:0}: Error finding container ed183ec4b6e52af2bf48194df37b323816395688950ea472db948413518039c7: Status 404 returned error can't find the container with id ed183ec4b6e52af2bf48194df37b323816395688950ea472db948413518039c7
Jul 17 09:19:07.443907 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:07.443871    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9x5jk" event={"ID":"831dc05c-c0a7-4272-98f0-e3b956a47ccf","Type":"ContainerStarted","Data":"ed183ec4b6e52af2bf48194df37b323816395688950ea472db948413518039c7"}
Jul 17 09:19:07.444823 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:07.444803    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrdcn" event={"ID":"e26a86fd-e979-4246-af0d-5881142edd51","Type":"ContainerStarted","Data":"4e473e986f8fdcb4763ddd778beba211f07aba7cdc75b727a0eb1d59a0d29054"}
Jul 17 09:19:08.489685 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:08.489647    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:08.591357 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:08.591290    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:12.449478 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:12.449446    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:12.459044 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:12.459016    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrdcn" event={"ID":"e26a86fd-e979-4246-af0d-5881142edd51","Type":"ContainerStarted","Data":"c764b1a4b0e372a072b78ff9d69f94615f1fe85d3b12020b11d5debbd98efb4b"}
Jul 17 09:19:12.460235 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:12.460212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9x5jk" event={"ID":"831dc05c-c0a7-4272-98f0-e3b956a47ccf","Type":"ContainerStarted","Data":"ddc0e5d25e6dbd7f895d1ce6950a951e00681c0e94874edc6ba85d3847ad1ef3"}
Jul 17 09:19:12.460350 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:12.460335    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:19:12.480371 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:12.480324    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zrdcn" podStartSLOduration=66.468426563 podStartE2EDuration="1m11.480289855s" totalImagesPullingTime="5.011863292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:19:12.47994618 +0000 UTC m=+71.971640587" watchObservedRunningTime="2026-07-17 09:19:12.480289855 +0000 UTC m=+71.971984263"
Jul 17 09:19:12.495317 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:12.495280    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9x5jk" podStartSLOduration=66.798669462 podStartE2EDuration="1m11.495268527s" totalImagesPullingTime="4.696599065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:19:12.494487135 +0000 UTC m=+71.986181542" watchObservedRunningTime="2026-07-17 09:19:12.495268527 +0000 UTC m=+71.986962932"
Jul 17 09:19:12.550979 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:12.550955    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:17.841357 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:17.841323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:17.966434 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:17.966400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:18.129505 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:18.129423    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:18.231766 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:18.231736    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:30.085123 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.085011    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:30.767839 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.767802    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-94f5866d8-7xccq"]
Jul 17 09:19:30.775251 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.775222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.778126 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.778097    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mnvbf\""
Jul 17 09:19:30.778126 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.778118    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 17 09:19:30.778306 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.778101    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 17 09:19:30.778306 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.778152    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 17 09:19:30.778306 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.778130    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 17 09:19:30.778555 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.778379    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 09:19:30.779153 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.779138    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 09:19:30.787635 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.787616    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-94f5866d8-7xccq"]
Jul 17 09:19:30.891845 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.891813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.892011 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.891863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.892011 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.891881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhmqk\" (UniqueName: \"kubernetes.io/projected/d08ee435-02c4-433f-bc34-2cd946ce6b63-kube-api-access-fhmqk\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.892011 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.891912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-stats-auth\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.892011 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.891938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-default-certificate\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.992531 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.992498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-default-certificate\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.992704 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.992542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.992704 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.992582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.992704 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.992606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhmqk\" (UniqueName: \"kubernetes.io/projected/d08ee435-02c4-433f-bc34-2cd946ce6b63-kube-api-access-fhmqk\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.992704 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.992654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-stats-auth\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.992704 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:30.992663    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 09:19:30.993036 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:30.992741    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs podName:d08ee435-02c4-433f-bc34-2cd946ce6b63 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:31.49272149 +0000 UTC m=+90.984415890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs") pod "router-default-94f5866d8-7xccq" (UID: "d08ee435-02c4-433f-bc34-2cd946ce6b63") : secret "router-metrics-certs-default" not found
Jul 17 09:19:30.993036 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:30.992765    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle podName:d08ee435-02c4-433f-bc34-2cd946ce6b63 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:31.492755308 +0000 UTC m=+90.984449698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle") pod "router-default-94f5866d8-7xccq" (UID: "d08ee435-02c4-433f-bc34-2cd946ce6b63") : configmap references non-existent config key: service-ca.crt
Jul 17 09:19:30.995010 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.994976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-stats-auth\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:30.995459 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:30.995437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-default-certificate\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:31.009361 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:31.009339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhmqk\" (UniqueName: \"kubernetes.io/projected/d08ee435-02c4-433f-bc34-2cd946ce6b63-kube-api-access-fhmqk\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:31.102681 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:31.102601    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:31.213852 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:31.213821    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:31.496590 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:31.496553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:31.496800 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:31.496601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:31.496800 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:31.496692    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 09:19:31.496800 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:31.496724    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle podName:d08ee435-02c4-433f-bc34-2cd946ce6b63 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:32.496711398 +0000 UTC m=+91.988405782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle") pod "router-default-94f5866d8-7xccq" (UID: "d08ee435-02c4-433f-bc34-2cd946ce6b63") : configmap references non-existent config key: service-ca.crt
Jul 17 09:19:31.496800 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:31.496744    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs podName:d08ee435-02c4-433f-bc34-2cd946ce6b63 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:32.496731245 +0000 UTC m=+91.988425657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs") pod "router-default-94f5866d8-7xccq" (UID: "d08ee435-02c4-433f-bc34-2cd946ce6b63") : secret "router-metrics-certs-default" not found
Jul 17 09:19:32.504457 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:32.504410    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:32.504959 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:32.504481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:32.504959 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:32.504545    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 09:19:32.504959 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:32.504626    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs podName:d08ee435-02c4-433f-bc34-2cd946ce6b63 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:34.504599909 +0000 UTC m=+93.996294308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs") pod "router-default-94f5866d8-7xccq" (UID: "d08ee435-02c4-433f-bc34-2cd946ce6b63") : secret "router-metrics-certs-default" not found
Jul 17 09:19:32.504959 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:32.504645    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle podName:d08ee435-02c4-433f-bc34-2cd946ce6b63 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:34.504635536 +0000 UTC m=+93.996329919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle") pod "router-default-94f5866d8-7xccq" (UID: "d08ee435-02c4-433f-bc34-2cd946ce6b63") : configmap references non-existent config key: service-ca.crt
Jul 17 09:19:33.201513 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:33.201478    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:33.344714 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:33.344684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:34.278280 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.278249    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-trsvf"]
Jul 17 09:19:34.281251 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.281235    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.286398 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.286377    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 09:19:34.286523 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.286377    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 09:19:34.286523 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.286403    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 09:19:34.286751 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.286734    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 09:19:34.288994 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.288307    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cb5vz\""
Jul 17 09:19:34.297571 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.297550    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-trsvf"]
Jul 17 09:19:34.369651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.369601    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:34.418258 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.418231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e3b967-e7df-41f0-a07b-4a09c859209a-data-volume\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.418425 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.418267    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.418425 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.418318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4e3b967-e7df-41f0-a07b-4a09c859209a-crio-socket\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.418425 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.418334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpr4k\" (UniqueName: \"kubernetes.io/projected/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-api-access-zpr4k\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.418425 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.418353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.463895 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.463870    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:34.518631 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.518607    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:34.518745 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.518636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e3b967-e7df-41f0-a07b-4a09c859209a-data-volume\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.518745 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.518661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.518745 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:34.518717    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 09:19:34.518864 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:34.518758    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 09:19:34.518864 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:34.518765    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm podName:c4e3b967-e7df-41f0-a07b-4a09c859209a nodeName:}" failed. No retries permitted until 2026-07-17 09:19:35.018747421 +0000 UTC m=+94.510441819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trsvf" (UID: "c4e3b967-e7df-41f0-a07b-4a09c859209a") : configmap "kube-rbac-proxy" not found
Jul 17 09:19:34.518936 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.518858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:34.518936 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:34.518920    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs podName:d08ee435-02c4-433f-bc34-2cd946ce6b63 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:38.51890094 +0000 UTC m=+98.010595327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs") pod "router-default-94f5866d8-7xccq" (UID: "d08ee435-02c4-433f-bc34-2cd946ce6b63") : secret "router-metrics-certs-default" not found
Jul 17 09:19:34.519007 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:34.518954    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle podName:d08ee435-02c4-433f-bc34-2cd946ce6b63 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:38.518936389 +0000 UTC m=+98.010630775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle") pod "router-default-94f5866d8-7xccq" (UID: "d08ee435-02c4-433f-bc34-2cd946ce6b63") : configmap references non-existent config key: service-ca.crt
Jul 17 09:19:34.519007 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.518986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4e3b967-e7df-41f0-a07b-4a09c859209a-crio-socket\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.519007 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.518990    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4e3b967-e7df-41f0-a07b-4a09c859209a-data-volume\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.519110 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.519014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpr4k\" (UniqueName: \"kubernetes.io/projected/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-api-access-zpr4k\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.519110 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.519039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.519110 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.519100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c4e3b967-e7df-41f0-a07b-4a09c859209a-crio-socket\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:34.519204 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:34.519147    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:34.519204 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:34.519188    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls podName:c4e3b967-e7df-41f0-a07b-4a09c859209a nodeName:}" failed. No retries permitted until 2026-07-17 09:19:35.019176918 +0000 UTC m=+94.510871304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trsvf" (UID: "c4e3b967-e7df-41f0-a07b-4a09c859209a") : secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:34.545084 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:34.545017    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpr4k\" (UniqueName: \"kubernetes.io/projected/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-api-access-zpr4k\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:35.022003 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.021959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:35.022196 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.022051    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:35.022196 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:35.022105    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:35.022196 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:35.022162    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 09:19:35.022314 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:35.022171    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls podName:c4e3b967-e7df-41f0-a07b-4a09c859209a nodeName:}" failed. No retries permitted until 2026-07-17 09:19:36.022155743 +0000 UTC m=+95.513850160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trsvf" (UID: "c4e3b967-e7df-41f0-a07b-4a09c859209a") : secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:35.022314 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:35.022231    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm podName:c4e3b967-e7df-41f0-a07b-4a09c859209a nodeName:}" failed. No retries permitted until 2026-07-17 09:19:36.022218382 +0000 UTC m=+95.513912765 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trsvf" (UID: "c4e3b967-e7df-41f0-a07b-4a09c859209a") : configmap "kube-rbac-proxy" not found
Jul 17 09:19:35.089795 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.089743    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:35.188503 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.188475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:35.419574 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.419538    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"]
Jul 17 09:19:35.422621 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.422601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.427814 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.427762    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 17 09:19:35.427814 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.427797    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 17 09:19:35.429222 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.429197    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 09:19:35.429222 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.429214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 17 09:19:35.429456 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.429220    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 17 09:19:35.429456 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.429289    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 09:19:35.429456 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.429311    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 09:19:35.448164 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.448145    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"]
Jul 17 09:19:35.527251 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.527222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-ca\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.527379 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.527262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.527379 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.527358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.527446 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.527403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab68f4e2-b00d-4309-bd07-1a533196a770-additional-service-ca\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.527446 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.527421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t96z\" (UniqueName: \"kubernetes.io/projected/ab68f4e2-b00d-4309-bd07-1a533196a770-kube-api-access-5t96z\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.527510 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.527494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-hub\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.627812 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.627766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.628050 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.627837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab68f4e2-b00d-4309-bd07-1a533196a770-additional-service-ca\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.628050 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.627863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t96z\" (UniqueName: \"kubernetes.io/projected/ab68f4e2-b00d-4309-bd07-1a533196a770-kube-api-access-5t96z\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.628050 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.627896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-hub\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.628050 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.627936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-ca\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.628050 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.627981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.628567 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.628542    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab68f4e2-b00d-4309-bd07-1a533196a770-additional-service-ca\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.630405 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.630378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.630568 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.630545    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.630739 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.630726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-hub\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.630787 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.630746    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ab68f4e2-b00d-4309-bd07-1a533196a770-ca\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.646732 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.646712    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t96z\" (UniqueName: \"kubernetes.io/projected/ab68f4e2-b00d-4309-bd07-1a533196a770-kube-api-access-5t96z\") pod \"cluster-proxy-proxy-agent-848f998cbf-gwcxj\" (UID: \"ab68f4e2-b00d-4309-bd07-1a533196a770\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:35.743112 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:35.743046    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:19:36.013549 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:36.013449    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:36.031651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:36.031626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:36.031766 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:36.031743    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 09:19:36.031832 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:36.031809    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm podName:c4e3b967-e7df-41f0-a07b-4a09c859209a nodeName:}" failed. No retries permitted until 2026-07-17 09:19:38.031795191 +0000 UTC m=+97.523489575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trsvf" (UID: "c4e3b967-e7df-41f0-a07b-4a09c859209a") : configmap "kube-rbac-proxy" not found
Jul 17 09:19:36.031875 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:36.031838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:36.031934 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:36.031923    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:36.031975 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:36.031952    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls podName:c4e3b967-e7df-41f0-a07b-4a09c859209a nodeName:}" failed. No retries permitted until 2026-07-17 09:19:38.031945064 +0000 UTC m=+97.523639447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trsvf" (UID: "c4e3b967-e7df-41f0-a07b-4a09c859209a") : secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:36.099093 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:36.099062    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"]
Jul 17 09:19:36.117937 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:36.117914    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gcl4j_86eae500-f996-4f04-9792-5a5af6c9c893/dns-node-resolver/0.log"
Jul 17 09:19:36.124798 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:19:36.124765    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab68f4e2_b00d_4309_bd07_1a533196a770.slice/crio-88be4a26556b60fc99e4e32bac26344e6859d2deb15b8f73c983cf4b8ddcc157 WatchSource:0}: Error finding container 88be4a26556b60fc99e4e32bac26344e6859d2deb15b8f73c983cf4b8ddcc157: Status 404 returned error can't find the container with id 88be4a26556b60fc99e4e32bac26344e6859d2deb15b8f73c983cf4b8ddcc157
Jul 17 09:19:36.190234 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:36.190207    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:36.311195 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:36.311124    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:36.404843 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:36.404815    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:36.516145 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:36.516113    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" event={"ID":"ab68f4e2-b00d-4309-bd07-1a533196a770","Type":"ContainerStarted","Data":"88be4a26556b60fc99e4e32bac26344e6859d2deb15b8f73c983cf4b8ddcc157"}
Jul 17 09:19:37.434738 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:37.434702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:37.458204 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:37.458176    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mgltv_84807261-d1ec-4148-9c9c-776f43fdd74a/node-ca/0.log"
Jul 17 09:19:37.521329 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:37.521263    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:38.051602 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:38.051567    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:38.051602 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:38.051633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:38.051951 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.051743    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:38.051951 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.051770    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 09:19:38.051951 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.051832    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls podName:c4e3b967-e7df-41f0-a07b-4a09c859209a nodeName:}" failed. No retries permitted until 2026-07-17 09:19:42.051812294 +0000 UTC m=+101.543506677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trsvf" (UID: "c4e3b967-e7df-41f0-a07b-4a09c859209a") : secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:38.051951 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.051850    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm podName:c4e3b967-e7df-41f0-a07b-4a09c859209a nodeName:}" failed. No retries permitted until 2026-07-17 09:19:42.051841846 +0000 UTC m=+101.543536249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trsvf" (UID: "c4e3b967-e7df-41f0-a07b-4a09c859209a") : configmap "kube-rbac-proxy" not found
Jul 17 09:19:38.267530 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:38.267497    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tn85c_545402ad-c7ce-44e3-b164-b2d91e838e53/serve-healthcheck-canary/0.log"
Jul 17 09:19:38.556431 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:38.556396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:38.556923 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:38.556479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:38.556923 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.556582    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle podName:d08ee435-02c4-433f-bc34-2cd946ce6b63 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:46.556560787 +0000 UTC m=+106.048255183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle") pod "router-default-94f5866d8-7xccq" (UID: "d08ee435-02c4-433f-bc34-2cd946ce6b63") : configmap references non-existent config key: service-ca.crt
Jul 17 09:19:38.556923 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.556653    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 09:19:38.556923 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.556717    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs podName:d08ee435-02c4-433f-bc34-2cd946ce6b63 nodeName:}" failed. No retries permitted until 2026-07-17 09:19:46.556700805 +0000 UTC m=+106.048395208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs") pod "router-default-94f5866d8-7xccq" (UID: "d08ee435-02c4-433f-bc34-2cd946ce6b63") : secret "router-metrics-certs-default" not found
Jul 17 09:19:38.580101 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:38.580067    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:38.758210 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:38.758168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls\") pod \"image-registry-97d5c8896-mcb7h\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") " pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:19:38.758419 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.758345    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 09:19:38.758419 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.758365    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97d5c8896-mcb7h: secret "image-registry-tls" not found
Jul 17 09:19:38.758530 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.758440    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls podName:f244fd94-2db7-419d-9adb-77c274aaf12b nodeName:}" failed. No retries permitted until 2026-07-17 09:20:42.758424056 +0000 UTC m=+162.250118447 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls") pod "image-registry-97d5c8896-mcb7h" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b") : secret "image-registry-tls" not found
Jul 17 09:19:38.859467 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:38.859370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:19:38.859640 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.859535    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 09:19:38.859640 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:38.859615    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls podName:a17822fc-0486-4589-8572-77562adfcfe5 nodeName:}" failed. No retries permitted until 2026-07-17 09:20:42.859593221 +0000 UTC m=+162.351287647 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls") pod "dns-default-sx2fn" (UID: "a17822fc-0486-4589-8572-77562adfcfe5") : secret "dns-default-metrics-tls" not found
Jul 17 09:19:39.527117 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:39.527087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" event={"ID":"ab68f4e2-b00d-4309-bd07-1a533196a770","Type":"ContainerStarted","Data":"163a6e697e545ea54816bea0beee4d5867469c0b34faed3357a649cfdd951853"}
Jul 17 09:19:39.527247 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:39.527129    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" event={"ID":"ab68f4e2-b00d-4309-bd07-1a533196a770","Type":"ContainerStarted","Data":"0a99e8dcfebbd66d6ad2e2f04d8308ebb7aa8073716ca47236a454b991b77b52"}
Jul 17 09:19:39.527247 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:39.527142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" event={"ID":"ab68f4e2-b00d-4309-bd07-1a533196a770","Type":"ContainerStarted","Data":"9e0679adea86c9bf0b6001a68ee013d5612a8145587b42f9b8c99cb8c8657219"}
Jul 17 09:19:39.547188 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:39.547101    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" podStartSLOduration=1.388573557 podStartE2EDuration="4.547088592s" totalImagesPullingTime="3.158515035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:19:39.546616805 +0000 UTC m=+99.038311401" watchObservedRunningTime="2026-07-17 09:19:39.547088592 +0000 UTC m=+99.038782997"
Jul 17 09:19:41.337515 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:41.337479    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:41.436164 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:41.436134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:41.591495 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:41.591382    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:41.692017 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:41.691987    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:41.792460 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:41.792432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:42.086810 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:42.086758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:42.087022 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:42.086897    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 09:19:42.087022 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:42.086940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:42.087022 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:42.086983    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm podName:c4e3b967-e7df-41f0-a07b-4a09c859209a nodeName:}" failed. No retries permitted until 2026-07-17 09:19:50.08696357 +0000 UTC m=+109.578657970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-trsvf" (UID: "c4e3b967-e7df-41f0-a07b-4a09c859209a") : configmap "kube-rbac-proxy" not found
Jul 17 09:19:42.087203 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:42.087028    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:42.087203 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:42.087093    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls podName:c4e3b967-e7df-41f0-a07b-4a09c859209a nodeName:}" failed. No retries permitted until 2026-07-17 09:19:50.087082865 +0000 UTC m=+109.578777249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trsvf" (UID: "c4e3b967-e7df-41f0-a07b-4a09c859209a") : secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:42.218940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:42.218875    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:42.820490 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:42.820455    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:42.970915 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:42.970884    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:43.404866 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:43.404839    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:43.464720 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:43.464696    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9x5jk"
Jul 17 09:19:43.612407 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:43.612376    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:43.828858 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:43.828793    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:44.207132 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:44.207102    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:44.823151 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:44.823123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:45.210358 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:45.210329    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:45.284426 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:45.284398    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:45.423689 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:45.423661    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:45.604081 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:45.604008    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:45.805082 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:45.805051    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:45.904556 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:45.904526    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:46.230288 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:46.230181    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:46.621663 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:46.621573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:46.621663 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:46.621659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:46.621883 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:46.621762    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle podName:d08ee435-02c4-433f-bc34-2cd946ce6b63 nodeName:}" failed. No retries permitted until 2026-07-17 09:20:02.621744321 +0000 UTC m=+122.113438712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle") pod "router-default-94f5866d8-7xccq" (UID: "d08ee435-02c4-433f-bc34-2cd946ce6b63") : configmap references non-existent config key: service-ca.crt
Jul 17 09:19:46.623961 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:46.623941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d08ee435-02c4-433f-bc34-2cd946ce6b63-metrics-certs\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:19:46.808441 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:46.808410    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:47.338411 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:47.338379    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:47.488744 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:47.488712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:47.590038 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:47.589959    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:47.689962 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:47.689928    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:48.024401 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:48.024375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:48.212259 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:48.212226    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:48.619747 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:48.619700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:49.223539 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:49.223501    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:49.618477 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:49.618394    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:50.014271 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:50.014244    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:50.152819 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:50.152759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:50.152991 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:50.152835    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:50.152991 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:50.152906    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:50.152991 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:19:50.152970    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls podName:c4e3b967-e7df-41f0-a07b-4a09c859209a nodeName:}" failed. No retries permitted until 2026-07-17 09:20:06.152955283 +0000 UTC m=+125.644649666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-trsvf" (UID: "c4e3b967-e7df-41f0-a07b-4a09c859209a") : secret "insights-runtime-extractor-tls" not found
Jul 17 09:19:50.153337 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:50.153320    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c4e3b967-e7df-41f0-a07b-4a09c859209a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:19:50.207392 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:50.207367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:50.760823 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:50.760772    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:50.874413 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:50.874383    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:51.421053 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:51.421024    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:51.656060 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:51.656025    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:51.848954 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:51.848855    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:52.064617 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:52.064588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:54.431117 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:54.431086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:54.552918 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:54.552857    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:54.736112 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:54.736035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:54.912634 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:54.912603    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:55.052741 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:55.052665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:55.224293 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:55.224253    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:55.523034 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:55.523004    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:55.920606 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:55.920578    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:56.316620 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:56.316539    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:56.449225 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:56.449191    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:56.549940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:56.549908    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:56.838139 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:56.838108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:19:56.956800 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:19:56.956755    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:02.375631 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:02.375601    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:02.534600 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:02.534570    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:02.651006 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:02.650973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:20:02.651548 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:02.651522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d08ee435-02c4-433f-bc34-2cd946ce6b63-service-ca-bundle\") pod \"router-default-94f5866d8-7xccq\" (UID: \"d08ee435-02c4-433f-bc34-2cd946ce6b63\") " pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:20:02.903381 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:02.903287    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mnvbf\""
Jul 17 09:20:02.903381 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:02.903331    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:20:03.036232 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:03.036200    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-94f5866d8-7xccq"]
Jul 17 09:20:03.039862 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:20:03.039833    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08ee435_02c4_433f_bc34_2cd946ce6b63.slice/crio-b4dc34afbd31c891f01aca7c67f7aeacbb725c64727837fbb4bd32d5b4a0baf3 WatchSource:0}: Error finding container b4dc34afbd31c891f01aca7c67f7aeacbb725c64727837fbb4bd32d5b4a0baf3: Status 404 returned error can't find the container with id b4dc34afbd31c891f01aca7c67f7aeacbb725c64727837fbb4bd32d5b4a0baf3
Jul 17 09:20:03.597641 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:03.597603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-94f5866d8-7xccq" event={"ID":"d08ee435-02c4-433f-bc34-2cd946ce6b63","Type":"ContainerStarted","Data":"a41ab4294d4311aed46af83726112ea4df4b626406080bc5348900d7446f5900"}
Jul 17 09:20:03.598044 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:03.597654    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-94f5866d8-7xccq" event={"ID":"d08ee435-02c4-433f-bc34-2cd946ce6b63","Type":"ContainerStarted","Data":"b4dc34afbd31c891f01aca7c67f7aeacbb725c64727837fbb4bd32d5b4a0baf3"}
Jul 17 09:20:03.627561 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:03.627516    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-94f5866d8-7xccq" podStartSLOduration=33.627501098 podStartE2EDuration="33.627501098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:20:03.626856937 +0000 UTC m=+123.118551343" watchObservedRunningTime="2026-07-17 09:20:03.627501098 +0000 UTC m=+123.119195502"
Jul 17 09:20:03.904308 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:03.904281    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:20:03.906535 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:03.906517    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:20:04.527852 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:04.527814    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:04.600452 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:04.600425    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:20:04.601581 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:04.601564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-94f5866d8-7xccq"
Jul 17 09:20:04.625256 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:04.625233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:06.078513 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.078480    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:06.177927 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.177888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:20:06.180069 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.180048    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c4e3b967-e7df-41f0-a07b-4a09c859209a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-trsvf\" (UID: \"c4e3b967-e7df-41f0-a07b-4a09c859209a\") " pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:20:06.314739 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.314705    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:06.396613 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.396585    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cb5vz\""
Jul 17 09:20:06.402669 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.402648    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-trsvf"
Jul 17 09:20:06.511341 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.511311    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:06.537655 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.537626    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-trsvf"]
Jul 17 09:20:06.541712 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:20:06.541687    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e3b967_e7df_41f0_a07b_4a09c859209a.slice/crio-0f936372eaea8990e83a2d67599f8e41e35ba0cf22366f99f0b2636b8c915f86 WatchSource:0}: Error finding container 0f936372eaea8990e83a2d67599f8e41e35ba0cf22366f99f0b2636b8c915f86: Status 404 returned error can't find the container with id 0f936372eaea8990e83a2d67599f8e41e35ba0cf22366f99f0b2636b8c915f86
Jul 17 09:20:06.600433 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.600396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:06.606504 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.606473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trsvf" event={"ID":"c4e3b967-e7df-41f0-a07b-4a09c859209a","Type":"ContainerStarted","Data":"0f936372eaea8990e83a2d67599f8e41e35ba0cf22366f99f0b2636b8c915f86"}
Jul 17 09:20:06.689363 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.689284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:06.930730 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:06.930696    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:07.168185 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:07.168100    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:09.628855 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:09.628814    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:09.853864 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:09.853825    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:10.177802 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:10.177751    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:10.818076 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:10.818040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:20:10.820523 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:10.820494    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a86c19b-a795-4528-89f0-5f7377a569d7-metrics-certs\") pod \"network-metrics-daemon-l78lc\" (UID: \"9a86c19b-a795-4528-89f0-5f7377a569d7\") " pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:20:10.997973 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:10.997938    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2lf7\""
Jul 17 09:20:11.005489 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:11.005467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l78lc"
Jul 17 09:20:11.309069 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:11.309044    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l78lc"]
Jul 17 09:20:11.312581 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:20:11.312556    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a86c19b_a795_4528_89f0_5f7377a569d7.slice/crio-502d5d36016a4eeb4b3d3ec58b651467603cf217bb68a1ece60a549ea4204314 WatchSource:0}: Error finding container 502d5d36016a4eeb4b3d3ec58b651467603cf217bb68a1ece60a549ea4204314: Status 404 returned error can't find the container with id 502d5d36016a4eeb4b3d3ec58b651467603cf217bb68a1ece60a549ea4204314
Jul 17 09:20:11.353835 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:11.353804    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:11.498013 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:11.497935    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:11.625076 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:11.625044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trsvf" event={"ID":"c4e3b967-e7df-41f0-a07b-4a09c859209a","Type":"ContainerStarted","Data":"c480b336f6ed777e1f3b5d809cfd042ea8207a5f0247ec0d81f960a04f15043c"}
Jul 17 09:20:11.626117 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:11.626095    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l78lc" event={"ID":"9a86c19b-a795-4528-89f0-5f7377a569d7","Type":"ContainerStarted","Data":"502d5d36016a4eeb4b3d3ec58b651467603cf217bb68a1ece60a549ea4204314"}
Jul 17 09:20:13.933703 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.933673    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-665b4f9778-wx6bk"]
Jul 17 09:20:13.936910 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.936881    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:13.960624 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.960580    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665b4f9778-wx6bk"]
Jul 17 09:20:13.960828 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.960732    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:13.964159 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.964085    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 09:20:13.964289 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.964202    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 09:20:13.965329 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.965166    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 09:20:13.965329 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.965174    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 09:20:13.965329 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.965212    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 09:20:13.965329 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.965250    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wp7bs\""
Jul 17 09:20:13.965329 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.965324    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 09:20:13.965646 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.965371    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 09:20:13.973088 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:13.973069    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 17 09:20:14.027789 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.027749    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:14.047060 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.047029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-console-config\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.047212 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.047079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-oauth-serving-cert\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.047212 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.047125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-service-ca\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.047212 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.047148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-serving-cert\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.047212 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.047188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn4z8\" (UniqueName: \"kubernetes.io/projected/19f777c8-505f-4696-b944-f742ccfcfc7e-kube-api-access-bn4z8\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.047421 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.047232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-oauth-config\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.047421 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.047343    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-trusted-ca-bundle\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.148485 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.148442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-serving-cert\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.148690 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.148496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn4z8\" (UniqueName: \"kubernetes.io/projected/19f777c8-505f-4696-b944-f742ccfcfc7e-kube-api-access-bn4z8\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.148690 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.148533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-oauth-config\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.148690 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.148591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-trusted-ca-bundle\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.148690 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.148631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-console-config\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.148690 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.148676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-oauth-serving-cert\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.149081 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.149044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-service-ca\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.149956 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.149925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-service-ca\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.150083 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.149924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-trusted-ca-bundle\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.150083 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.150042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-console-config\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.150508 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.150482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-oauth-serving-cert\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.153965 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.151839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-oauth-config\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.153965 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.152276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-serving-cert\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.158951 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.158930    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn4z8\" (UniqueName: \"kubernetes.io/projected/19f777c8-505f-4696-b944-f742ccfcfc7e-kube-api-access-bn4z8\") pod \"console-665b4f9778-wx6bk\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") " pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.272707 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.272621    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:14.537604 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.537526    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:14.783278 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.783083    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:14.826340 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.826317    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665b4f9778-wx6bk"]
Jul 17 09:20:14.829760 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:20:14.829733    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f777c8_505f_4696_b944_f742ccfcfc7e.slice/crio-ad814e0aa68319f40eef3b931bfb9753b150b604ffbdd5b812374bd767fce42b WatchSource:0}: Error finding container ad814e0aa68319f40eef3b931bfb9753b150b604ffbdd5b812374bd767fce42b: Status 404 returned error can't find the container with id ad814e0aa68319f40eef3b931bfb9753b150b604ffbdd5b812374bd767fce42b
Jul 17 09:20:14.890651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:14.890617    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:15.640686 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:15.640646    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665b4f9778-wx6bk" event={"ID":"19f777c8-505f-4696-b944-f742ccfcfc7e","Type":"ContainerStarted","Data":"ad814e0aa68319f40eef3b931bfb9753b150b604ffbdd5b812374bd767fce42b"}
Jul 17 09:20:15.642677 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:15.642636    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trsvf" event={"ID":"c4e3b967-e7df-41f0-a07b-4a09c859209a","Type":"ContainerStarted","Data":"a91a44b03a18b859b2f9c38174065dfaeb0bd73ae8f0bfec405522fe492f72b1"}
Jul 17 09:20:15.644451 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:15.644426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l78lc" event={"ID":"9a86c19b-a795-4528-89f0-5f7377a569d7","Type":"ContainerStarted","Data":"36f394f2c3dc25c5a861e387eb67bcb94de154e6b610b129931d6651ddaead3c"}
Jul 17 09:20:15.644547 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:15.644476    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l78lc" event={"ID":"9a86c19b-a795-4528-89f0-5f7377a569d7","Type":"ContainerStarted","Data":"3dd773d560152736227608cea59bd930f5420c44d7a060ed8c39a9ed9c4ce002"}
Jul 17 09:20:15.671739 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:15.671683    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l78lc" podStartSLOduration=133.175548913 podStartE2EDuration="2m14.671663942s" totalImagesPullingTime="1.496115029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:20:15.670047488 +0000 UTC m=+135.161741893" watchObservedRunningTime="2026-07-17 09:20:15.671663942 +0000 UTC m=+135.163358347"
Jul 17 09:20:15.836067 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:15.836030    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:15.936361 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:15.936276    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:16.925749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:16.925693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:17.360459 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.360375    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:17.623977 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.623867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:17.766900 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.766868    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:17.782705 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.782678    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pfvc2"]
Jul 17 09:20:17.795627 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.795602    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.800281 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.800253    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 09:20:17.800868 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.800846    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 09:20:17.801715 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.801689    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 09:20:17.801825 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.801754    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 09:20:17.801825 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.801754    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 09:20:17.801939 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.801829    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rq7jd\""
Jul 17 09:20:17.801939 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.801890    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 09:20:17.867345 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.867311    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:17.878544 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.878454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.878690 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.878586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qtpp\" (UniqueName: \"kubernetes.io/projected/57076e0a-0568-416f-8496-dbf63d5c01e2-kube-api-access-7qtpp\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.878690 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.878646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-wtmp\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.878690 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.878675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.878878 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.878701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-tls\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.878878 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.878724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57076e0a-0568-416f-8496-dbf63d5c01e2-root\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.878878 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.878790    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57076e0a-0568-416f-8496-dbf63d5c01e2-sys\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.878878 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.878837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-textfile\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.878878 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.878869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57076e0a-0568-416f-8496-dbf63d5c01e2-metrics-client-ca\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.979975 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.979943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-textfile\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.979975 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.979985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57076e0a-0568-416f-8496-dbf63d5c01e2-metrics-client-ca\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980505 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980505 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qtpp\" (UniqueName: \"kubernetes.io/projected/57076e0a-0568-416f-8496-dbf63d5c01e2-kube-api-access-7qtpp\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980505 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-wtmp\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980505 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980505 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-tls\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980505 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57076e0a-0568-416f-8496-dbf63d5c01e2-root\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980505 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-textfile\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980505 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57076e0a-0568-416f-8496-dbf63d5c01e2-sys\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980902 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980528    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57076e0a-0568-416f-8496-dbf63d5c01e2-sys\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980902 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980587    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-wtmp\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980902 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57076e0a-0568-416f-8496-dbf63d5c01e2-metrics-client-ca\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.980902 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57076e0a-0568-416f-8496-dbf63d5c01e2-root\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.981106 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.980996    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.982983 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.982959    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.983552 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.983530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57076e0a-0568-416f-8496-dbf63d5c01e2-node-exporter-tls\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:17.999473 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:17.999448    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qtpp\" (UniqueName: \"kubernetes.io/projected/57076e0a-0568-416f-8496-dbf63d5c01e2-kube-api-access-7qtpp\") pod \"node-exporter-pfvc2\" (UID: \"57076e0a-0568-416f-8496-dbf63d5c01e2\") " pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:18.107011 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:18.106967    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfvc2"
Jul 17 09:20:18.259754 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:18.259706    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:18.528097 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:18.528011    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:18.756541 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:18.756479    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:18.964099 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:18.964041    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:19.178486 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:20:19.178456    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57076e0a_0568_416f_8496_dbf63d5c01e2.slice/crio-8304361402c88e08e8bb6a909d28fc573e168acd6fa21fba5d1377f80565d3d7 WatchSource:0}: Error finding container 8304361402c88e08e8bb6a909d28fc573e168acd6fa21fba5d1377f80565d3d7: Status 404 returned error can't find the container with id 8304361402c88e08e8bb6a909d28fc573e168acd6fa21fba5d1377f80565d3d7
Jul 17 09:20:19.188918 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:19.188893    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:19.659592 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:19.659562    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-trsvf" event={"ID":"c4e3b967-e7df-41f0-a07b-4a09c859209a","Type":"ContainerStarted","Data":"fc32c764b160e2ed90a20b1919439220df061c83b77bf42d9065cb40ca3a1645"}
Jul 17 09:20:19.660917 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:19.660883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665b4f9778-wx6bk" event={"ID":"19f777c8-505f-4696-b944-f742ccfcfc7e","Type":"ContainerStarted","Data":"12e63b6576a28c3fd327f78377b098e9ef981768e306590e2f144a3128ab95e1"}
Jul 17 09:20:19.661921 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:19.661902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfvc2" event={"ID":"57076e0a-0568-416f-8496-dbf63d5c01e2","Type":"ContainerStarted","Data":"8304361402c88e08e8bb6a909d28fc573e168acd6fa21fba5d1377f80565d3d7"}
Jul 17 09:20:19.707509 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:19.707457    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-trsvf" podStartSLOduration=33.182084174 podStartE2EDuration="45.707443711s" totalImagesPullingTime="12.525359537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 09:19:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:20:19.706832956 +0000 UTC m=+139.198527361" watchObservedRunningTime="2026-07-17 09:20:19.707443711 +0000 UTC m=+139.199138114"
Jul 17 09:20:19.746365 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:19.746278    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-665b4f9778-wx6bk" podStartSLOduration=2.392766901 podStartE2EDuration="6.746259515s" totalImagesPullingTime="4.353492614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:20:19.737488821 +0000 UTC m=+139.229183236" watchObservedRunningTime="2026-07-17 09:20:19.746259515 +0000 UTC m=+139.237953920"
Jul 17 09:20:20.666605 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:20.666565    2560 generic.go:356] "Generic (PLEG): container finished" podID="57076e0a-0568-416f-8496-dbf63d5c01e2" containerID="3f976464413b27b8445dce969643e2211fed15e5edb5e00e015a61f0300fa3ab" exitCode=0
Jul 17 09:20:20.667020 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:20.666656    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfvc2" event={"ID":"57076e0a-0568-416f-8496-dbf63d5c01e2","Type":"ContainerDied","Data":"3f976464413b27b8445dce969643e2211fed15e5edb5e00e015a61f0300fa3ab"}
Jul 17 09:20:20.858269 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:20.858218    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:20.962773 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:20.962693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:21.335903 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:21.335824    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:21.521101 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:21.521067    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:21.672181 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:21.672149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfvc2" event={"ID":"57076e0a-0568-416f-8496-dbf63d5c01e2","Type":"ContainerStarted","Data":"92d2623271c140b12503198602afce8b5e190d2dfcdbae7ba55fe1b984dff52b"}
Jul 17 09:20:21.672630 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:21.672206    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfvc2" event={"ID":"57076e0a-0568-416f-8496-dbf63d5c01e2","Type":"ContainerStarted","Data":"ba851e3ea54e378a542af0804b9a9f4285868c6c8652ac2c4f401bee1c9c615a"}
Jul 17 09:20:21.703685 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:21.703637    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pfvc2" podStartSLOduration=3.6267042849999998 podStartE2EDuration="4.703622093s" totalImagesPullingTime="1.013715595s" totalInitContainerRuntime="63.202213ms" isStatefulPod=true podCreationTimestamp="2026-07-17 09:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:20:21.702666176 +0000 UTC m=+141.194360591" watchObservedRunningTime="2026-07-17 09:20:21.703622093 +0000 UTC m=+141.195316498"
Jul 17 09:20:21.938075 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:21.937998    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:22.028505 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:22.028468    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:22.226646 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:22.226558    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:23.339519 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.339480    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:23.353028 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.353002    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665b4f9778-wx6bk"]
Jul 17 09:20:23.413071 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.413042    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-588bf84c9b-kmf5s"]
Jul 17 09:20:23.414743 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.414728    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.436467 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.436438    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588bf84c9b-kmf5s"]
Jul 17 09:20:23.453997 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.453974    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:23.528438 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.528411    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-config\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.528579 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.528444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-service-ca\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.528579 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.528477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-trusted-ca-bundle\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.528579 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.528549    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-serving-cert\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.528677 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.528590    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cnfp\" (UniqueName: \"kubernetes.io/projected/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-kube-api-access-9cnfp\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.528677 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.528618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-oauth-serving-cert\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.528677 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.528636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-oauth-config\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.629761 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.629676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-serving-cert\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.629761 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.629714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnfp\" (UniqueName: \"kubernetes.io/projected/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-kube-api-access-9cnfp\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.629761 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.629750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-oauth-serving-cert\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.630054 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.629793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-oauth-config\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.630054 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.629836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-config\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.630054 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.629865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-service-ca\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.630054 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.629904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-trusted-ca-bundle\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.630484 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.630458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-oauth-serving-cert\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.630609 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.630586    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-config\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.630690 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.630672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-service-ca\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.631073 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.631049    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-trusted-ca-bundle\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.632368 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.632345    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-oauth-config\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.632438 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.632367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-serving-cert\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.640051 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.640028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnfp\" (UniqueName: \"kubernetes.io/projected/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-kube-api-access-9cnfp\") pod \"console-588bf84c9b-kmf5s\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") " pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.723045 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.723013    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:23.863589 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:23.863564    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588bf84c9b-kmf5s"]
Jul 17 09:20:23.865431 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:20:23.865402    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2fdd5f_6d8a_442c_b45b_dc919de74b32.slice/crio-f610373c8d170dc981cdf0e8732a49eb0c5e5417f9ace5011ff92b3acd227962 WatchSource:0}: Error finding container f610373c8d170dc981cdf0e8732a49eb0c5e5417f9ace5011ff92b3acd227962: Status 404 returned error can't find the container with id f610373c8d170dc981cdf0e8732a49eb0c5e5417f9ace5011ff92b3acd227962
Jul 17 09:20:24.174454 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.174420    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-97d5c8896-mcb7h"]
Jul 17 09:20:24.174680 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:20:24.174660    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-97d5c8896-mcb7h" podUID="f244fd94-2db7-419d-9adb-77c274aaf12b"
Jul 17 09:20:24.272757 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.272712    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:24.322236 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.322203    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 09:20:24.324482 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.324462    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.327530 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.327503    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 17 09:20:24.327669 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.327648    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gg599\""
Jul 17 09:20:24.327754 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.327737    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 17 09:20:24.327827 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.327749    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 17 09:20:24.327827 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.327754    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3ljla4vdsktkt\""
Jul 17 09:20:24.328541 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.328521    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 17 09:20:24.328642 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.328575    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 17 09:20:24.328642 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.328522    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 17 09:20:24.328642 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.328532    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 17 09:20:24.332170 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.332147    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 17 09:20:24.332490 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.332335    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 17 09:20:24.332490 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.332428    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 17 09:20:24.332994 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.332849    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 09:20:24.333181 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.333158    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 17 09:20:24.333328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.333239    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:24.333409 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.333392    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 17 09:20:24.335432 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.335413    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 17 09:20:24.347043 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.347025    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 17 09:20:24.367274 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.367251    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 09:20:24.430067 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.429990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:24.435990 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.435968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436069 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.435996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436069 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436015    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436069 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436163 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436163 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436112    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436217 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436177    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436217 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436202    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436276 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436276 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436244    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436276 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436356 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436356 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436323    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436417 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436375    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436448 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436448 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436504 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436504 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-config\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436564 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.436564 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.436543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vkv9\" (UniqueName: \"kubernetes.io/projected/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-kube-api-access-5vkv9\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.537612 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.537581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.537612 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.537615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.537890 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.537632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.537890 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.537649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.537890 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.537804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.537890 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.537840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.537890 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.537884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.537911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.537941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.537977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538062    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538466 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538466 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538466 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538466 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-config\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538466 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.538466 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vkv9\" (UniqueName: \"kubernetes.io/projected/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-kube-api-access-5vkv9\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.539146 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.539146 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.538645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.539146 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.539047    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.539146 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.539098    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.539661 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.539633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.540474 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.540449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.541526 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.541004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.541526 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.541208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.541526 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.541305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.541526 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.541502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.541929 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.541903    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.541929 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.541922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.542421 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.542385    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.542597 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.542565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.543094 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.543070    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.543142 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.543111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.543744 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.543721    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.543843 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.543828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.543884 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.543842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-config\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.549618 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.549597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vkv9\" (UniqueName: \"kubernetes.io/projected/fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec-kube-api-access-5vkv9\") pod \"prometheus-k8s-0\" (UID: \"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.636295 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.636257    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:24.684762 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.684734    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:20:24.685211 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.684950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588bf84c9b-kmf5s" event={"ID":"7d2fdd5f-6d8a-442c-b45b-dc919de74b32","Type":"ContainerStarted","Data":"f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245"}
Jul 17 09:20:24.685211 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.685020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588bf84c9b-kmf5s" event={"ID":"7d2fdd5f-6d8a-442c-b45b-dc919de74b32","Type":"ContainerStarted","Data":"f610373c8d170dc981cdf0e8732a49eb0c5e5417f9ace5011ff92b3acd227962"}
Jul 17 09:20:24.691461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.691430    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:20:24.721811 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.721749    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-588bf84c9b-kmf5s" podStartSLOduration=1.7217310000000001 podStartE2EDuration="1.721731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:20:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:20:24.721470248 +0000 UTC m=+144.213164654" watchObservedRunningTime="2026-07-17 09:20:24.721731 +0000 UTC m=+144.213425404"
Jul 17 09:20:24.739110 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.739085    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-certificates\") pod \"f244fd94-2db7-419d-9adb-77c274aaf12b\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") "
Jul 17 09:20:24.739260 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.739124    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-installation-pull-secrets\") pod \"f244fd94-2db7-419d-9adb-77c274aaf12b\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") "
Jul 17 09:20:24.739260 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.739157    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w2p7\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-kube-api-access-9w2p7\") pod \"f244fd94-2db7-419d-9adb-77c274aaf12b\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") "
Jul 17 09:20:24.739260 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.739194    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-image-registry-private-configuration\") pod \"f244fd94-2db7-419d-9adb-77c274aaf12b\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") "
Jul 17 09:20:24.739260 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.739222    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-bound-sa-token\") pod \"f244fd94-2db7-419d-9adb-77c274aaf12b\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") "
Jul 17 09:20:24.739260 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.739253    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-trusted-ca\") pod \"f244fd94-2db7-419d-9adb-77c274aaf12b\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") "
Jul 17 09:20:24.739602 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.739583    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f244fd94-2db7-419d-9adb-77c274aaf12b-ca-trust-extracted\") pod \"f244fd94-2db7-419d-9adb-77c274aaf12b\" (UID: \"f244fd94-2db7-419d-9adb-77c274aaf12b\") "
Jul 17 09:20:24.739900 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.739799    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f244fd94-2db7-419d-9adb-77c274aaf12b" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:20:24.739985 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.739920    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f244fd94-2db7-419d-9adb-77c274aaf12b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f244fd94-2db7-419d-9adb-77c274aaf12b" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 09:20:24.740101 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.740080    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f244fd94-2db7-419d-9adb-77c274aaf12b" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:20:24.740449 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.740426    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-trusted-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:24.740497 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.740453    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f244fd94-2db7-419d-9adb-77c274aaf12b-ca-trust-extracted\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:24.740497 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.740468    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-certificates\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:24.741794 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.741754    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f244fd94-2db7-419d-9adb-77c274aaf12b" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 09:20:24.741905 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.741869    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f244fd94-2db7-419d-9adb-77c274aaf12b" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 09:20:24.741968 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.741905    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f244fd94-2db7-419d-9adb-77c274aaf12b" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:20:24.742603 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.742584    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-kube-api-access-9w2p7" (OuterVolumeSpecName: "kube-api-access-9w2p7") pod "f244fd94-2db7-419d-9adb-77c274aaf12b" (UID: "f244fd94-2db7-419d-9adb-77c274aaf12b"). InnerVolumeSpecName "kube-api-access-9w2p7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:20:24.768463 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.768431    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:24.783395 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.783301    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 09:20:24.787032 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:20:24.787010    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe57f93b_7dc3_49bf_8335_a44c0fcdc1ec.slice/crio-dce976591dabe26cf9f01b54f978d3a2b8948085865e187663af0da1f83414d3 WatchSource:0}: Error finding container dce976591dabe26cf9f01b54f978d3a2b8948085865e187663af0da1f83414d3: Status 404 returned error can't find the container with id dce976591dabe26cf9f01b54f978d3a2b8948085865e187663af0da1f83414d3
Jul 17 09:20:24.841013 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.840980    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-installation-pull-secrets\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:24.841013 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.841006    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w2p7\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-kube-api-access-9w2p7\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:24.841013 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.841016    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f244fd94-2db7-419d-9adb-77c274aaf12b-image-registry-private-configuration\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:24.841013 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.841025    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-bound-sa-token\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:24.859236 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:24.859208    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:25.689000 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:25.688975    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97d5c8896-mcb7h"
Jul 17 09:20:25.689000 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:25.688979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec","Type":"ContainerStarted","Data":"dce976591dabe26cf9f01b54f978d3a2b8948085865e187663af0da1f83414d3"}
Jul 17 09:20:25.731885 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:25.731842    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-97d5c8896-mcb7h"]
Jul 17 09:20:25.738901 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:25.738865    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-97d5c8896-mcb7h"]
Jul 17 09:20:25.850651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:25.850616    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f244fd94-2db7-419d-9adb-77c274aaf12b-registry-tls\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:26.693773 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:26.693737    2560 generic.go:356] "Generic (PLEG): container finished" podID="fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec" containerID="006c6fd221540714375c676429d6eda13d8cdca8c761b2258dfcc687a8b0bd26" exitCode=0
Jul 17 09:20:26.694162 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:26.693805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec","Type":"ContainerDied","Data":"006c6fd221540714375c676429d6eda13d8cdca8c761b2258dfcc687a8b0bd26"}
Jul 17 09:20:26.866773 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:26.866740    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:26.994368 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:26.994299    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:27.182543 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:27.182509    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f244fd94-2db7-419d-9adb-77c274aaf12b" path="/var/lib/kubelet/pods/f244fd94-2db7-419d-9adb-77c274aaf12b/volumes"
Jul 17 09:20:30.711711 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:30.711671    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec","Type":"ContainerStarted","Data":"f24ca56e6ca1769844874799458fc97b9af6cc9feb91529ff90c055bc2c2e5ca"}
Jul 17 09:20:30.712171 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:30.711786    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec","Type":"ContainerStarted","Data":"bdde7834604a982d5ea6dbfe049ed690271492abf644ef67ee0461c13b216a67"}
Jul 17 09:20:32.722208 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:32.722173    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec","Type":"ContainerStarted","Data":"e8ce83881aa975482e6da9c947e72b2d4f0f2138d64a79684b89306f25d880b4"}
Jul 17 09:20:32.722726 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:32.722235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec","Type":"ContainerStarted","Data":"d11645e207da8abcebb4feb998a03551e681c0e1c2a03aac250161bcf0752dad"}
Jul 17 09:20:32.722726 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:32.722261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec","Type":"ContainerStarted","Data":"ce6f7ad1c649f246291068f30bb0780ed1f192428ca8228e51fce16dc2a8eed8"}
Jul 17 09:20:32.722726 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:32.722284    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec","Type":"ContainerStarted","Data":"c7ba512480e980acb0311971b18d2c279565c571579a0cee54c8e3b7b1cc8e94"}
Jul 17 09:20:32.758688 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:32.758630    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.379765778 podStartE2EDuration="8.758611438s" totalImagesPullingTime="6.36082678s" totalInitContainerRuntime="18.01888ms" isStatefulPod=false podCreationTimestamp="2026-07-17 09:20:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:20:32.757256405 +0000 UTC m=+152.248950813" watchObservedRunningTime="2026-07-17 09:20:32.758611438 +0000 UTC m=+152.250305844"
Jul 17 09:20:33.723232 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:33.723181    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:33.723688 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:33.723258    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:33.727962 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:33.727938    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:34.150173 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:34.150139    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:34.252185 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:34.252154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:34.636791 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:34.636749    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:20:34.733972 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:34.733944    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:20:35.080821 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:35.080732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:35.178972 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:35.178942    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:36.487796 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:36.487738    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:36.588026 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:36.587995    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:36.655126 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:36.655093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:37.921670 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:20:37.921629    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sx2fn" podUID="a17822fc-0486-4589-8572-77562adfcfe5"
Jul 17 09:20:38.743510 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:38.743473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:20:41.811953 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:41.811917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:41.884517 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:41.884479    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:42.894310 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:42.894255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:20:42.896505 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:42.896488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a17822fc-0486-4589-8572-77562adfcfe5-metrics-tls\") pod \"dns-default-sx2fn\" (UID: \"a17822fc-0486-4589-8572-77562adfcfe5\") " pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:20:42.947305 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:42.947272    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4mh5z\""
Jul 17 09:20:42.955571 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:42.955539    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:20:43.092840 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:43.092817    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sx2fn"]
Jul 17 09:20:43.095196 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:20:43.095167    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda17822fc_0486_4589_8572_77562adfcfe5.slice/crio-4b7f654305b85fa5db42a4dfab131121af848177293d778d0326580a366bd6a7 WatchSource:0}: Error finding container 4b7f654305b85fa5db42a4dfab131121af848177293d778d0326580a366bd6a7: Status 404 returned error can't find the container with id 4b7f654305b85fa5db42a4dfab131121af848177293d778d0326580a366bd6a7
Jul 17 09:20:43.762270 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:43.762228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sx2fn" event={"ID":"a17822fc-0486-4589-8572-77562adfcfe5","Type":"ContainerStarted","Data":"4b7f654305b85fa5db42a4dfab131121af848177293d778d0326580a366bd6a7"}
Jul 17 09:20:45.771012 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:45.770974    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sx2fn" event={"ID":"a17822fc-0486-4589-8572-77562adfcfe5","Type":"ContainerStarted","Data":"f8f8f24b04ebbfeaf0dd301673714ae45f1bab500064c7368e0fea7686083388"}
Jul 17 09:20:45.771377 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:45.771029    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sx2fn" event={"ID":"a17822fc-0486-4589-8572-77562adfcfe5","Type":"ContainerStarted","Data":"2e213e60fdfc511c0c3b477d040712fb2d896263c4c1576b1bb7ddebd7233c98"}
Jul 17 09:20:45.771377 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:45.771121    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:20:45.791138 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:45.791086    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sx2fn" podStartSLOduration=129.996727693 podStartE2EDuration="2m11.791070286s" totalImagesPullingTime="1.794342593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:20:45.789939485 +0000 UTC m=+165.281633935" watchObservedRunningTime="2026-07-17 09:20:45.791070286 +0000 UTC m=+165.282764690"
Jul 17 09:20:48.372496 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:48.372438    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-665b4f9778-wx6bk" podUID="19f777c8-505f-4696-b944-f742ccfcfc7e" containerName="console" containerID="cri-o://12e63b6576a28c3fd327f78377b098e9ef981768e306590e2f144a3128ab95e1" gracePeriod=15
Jul 17 09:20:48.783982 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:48.783948    2560 generic.go:356] "Generic (PLEG): container finished" podID="19f777c8-505f-4696-b944-f742ccfcfc7e" containerID="12e63b6576a28c3fd327f78377b098e9ef981768e306590e2f144a3128ab95e1" exitCode=0
Jul 17 09:20:48.784149 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:48.783998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665b4f9778-wx6bk" event={"ID":"19f777c8-505f-4696-b944-f742ccfcfc7e","Type":"ContainerDied","Data":"12e63b6576a28c3fd327f78377b098e9ef981768e306590e2f144a3128ab95e1"}
Jul 17 09:20:49.153982 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.153947    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:49.347365 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.347283    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-console-config\") pod \"19f777c8-505f-4696-b944-f742ccfcfc7e\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") "
Jul 17 09:20:49.347365 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.347312    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-service-ca\") pod \"19f777c8-505f-4696-b944-f742ccfcfc7e\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") "
Jul 17 09:20:49.347365 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.347342    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn4z8\" (UniqueName: \"kubernetes.io/projected/19f777c8-505f-4696-b944-f742ccfcfc7e-kube-api-access-bn4z8\") pod \"19f777c8-505f-4696-b944-f742ccfcfc7e\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") "
Jul 17 09:20:49.347631 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.347426    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-oauth-config\") pod \"19f777c8-505f-4696-b944-f742ccfcfc7e\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") "
Jul 17 09:20:49.347631 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.347462    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-trusted-ca-bundle\") pod \"19f777c8-505f-4696-b944-f742ccfcfc7e\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") "
Jul 17 09:20:49.347631 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.347493    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-oauth-serving-cert\") pod \"19f777c8-505f-4696-b944-f742ccfcfc7e\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") "
Jul 17 09:20:49.347631 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.347520    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-serving-cert\") pod \"19f777c8-505f-4696-b944-f742ccfcfc7e\" (UID: \"19f777c8-505f-4696-b944-f742ccfcfc7e\") "
Jul 17 09:20:49.347864 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.347666    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-console-config" (OuterVolumeSpecName: "console-config") pod "19f777c8-505f-4696-b944-f742ccfcfc7e" (UID: "19f777c8-505f-4696-b944-f742ccfcfc7e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:20:49.347864 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.347701    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-service-ca" (OuterVolumeSpecName: "service-ca") pod "19f777c8-505f-4696-b944-f742ccfcfc7e" (UID: "19f777c8-505f-4696-b944-f742ccfcfc7e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:20:49.347864 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.347745    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-console-config\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:49.348103 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.348076    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "19f777c8-505f-4696-b944-f742ccfcfc7e" (UID: "19f777c8-505f-4696-b944-f742ccfcfc7e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:20:49.348103 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.348086    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "19f777c8-505f-4696-b944-f742ccfcfc7e" (UID: "19f777c8-505f-4696-b944-f742ccfcfc7e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:20:49.349769 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.349715    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "19f777c8-505f-4696-b944-f742ccfcfc7e" (UID: "19f777c8-505f-4696-b944-f742ccfcfc7e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 09:20:49.349909 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.349851    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19f777c8-505f-4696-b944-f742ccfcfc7e-kube-api-access-bn4z8" (OuterVolumeSpecName: "kube-api-access-bn4z8") pod "19f777c8-505f-4696-b944-f742ccfcfc7e" (UID: "19f777c8-505f-4696-b944-f742ccfcfc7e"). InnerVolumeSpecName "kube-api-access-bn4z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:20:49.349970 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.349952    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "19f777c8-505f-4696-b944-f742ccfcfc7e" (UID: "19f777c8-505f-4696-b944-f742ccfcfc7e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 09:20:49.449046 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.449005    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-oauth-config\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:49.449046 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.449043    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-trusted-ca-bundle\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:49.449046 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.449053    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-oauth-serving-cert\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:49.449477 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.449074    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19f777c8-505f-4696-b944-f742ccfcfc7e-console-serving-cert\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:49.449477 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.449083    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19f777c8-505f-4696-b944-f742ccfcfc7e-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:49.449477 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.449091    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn4z8\" (UniqueName: \"kubernetes.io/projected/19f777c8-505f-4696-b944-f742ccfcfc7e-kube-api-access-bn4z8\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:20:49.788679 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.788648    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665b4f9778-wx6bk"
Jul 17 09:20:49.788679 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.788662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665b4f9778-wx6bk" event={"ID":"19f777c8-505f-4696-b944-f742ccfcfc7e","Type":"ContainerDied","Data":"ad814e0aa68319f40eef3b931bfb9753b150b604ffbdd5b812374bd767fce42b"}
Jul 17 09:20:49.788918 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.788729    2560 scope.go:117] "RemoveContainer" containerID="12e63b6576a28c3fd327f78377b098e9ef981768e306590e2f144a3128ab95e1"
Jul 17 09:20:49.809746 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.809721    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665b4f9778-wx6bk"]
Jul 17 09:20:49.814091 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:49.814070    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-665b4f9778-wx6bk"]
Jul 17 09:20:50.541125 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:50.541094    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:50.622037 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:50.622000    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:51.185057 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:51.185023    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19f777c8-505f-4696-b944-f742ccfcfc7e" path="/var/lib/kubelet/pods/19f777c8-505f-4696-b944-f742ccfcfc7e/volumes"
Jul 17 09:20:55.744664 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:55.744561    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" podUID="ab68f4e2-b00d-4309-bd07-1a533196a770" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 17 09:20:55.777523 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:55.777495    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sx2fn"
Jul 17 09:20:56.819564 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:56.819532    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:20:56.920934 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:20:56.920904    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:05.092743 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:05.092705    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:05.160035 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:05.159999    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:05.743964 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:05.743932    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" podUID="ab68f4e2-b00d-4309-bd07-1a533196a770" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 17 09:21:10.468506 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:10.468474    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:10.563193 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:10.563165    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:15.744306 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:15.744266    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" podUID="ab68f4e2-b00d-4309-bd07-1a533196a770" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 17 09:21:15.744762 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:15.744335    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj"
Jul 17 09:21:15.744848 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:15.744773    2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"163a6e697e545ea54816bea0beee4d5867469c0b34faed3357a649cfdd951853"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 17 09:21:15.744848 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:15.744840    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" podUID="ab68f4e2-b00d-4309-bd07-1a533196a770" containerName="service-proxy" containerID="cri-o://163a6e697e545ea54816bea0beee4d5867469c0b34faed3357a649cfdd951853" gracePeriod=30
Jul 17 09:21:15.878105 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:15.878081    2560 generic.go:356] "Generic (PLEG): container finished" podID="ab68f4e2-b00d-4309-bd07-1a533196a770" containerID="163a6e697e545ea54816bea0beee4d5867469c0b34faed3357a649cfdd951853" exitCode=2
Jul 17 09:21:15.878206 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:15.878127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" event={"ID":"ab68f4e2-b00d-4309-bd07-1a533196a770","Type":"ContainerDied","Data":"163a6e697e545ea54816bea0beee4d5867469c0b34faed3357a649cfdd951853"}
Jul 17 09:21:16.883534 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:16.883498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848f998cbf-gwcxj" event={"ID":"ab68f4e2-b00d-4309-bd07-1a533196a770","Type":"ContainerStarted","Data":"399337c2d3aef663a579cd694ea827bbf17de71176130a8e850a0c8fff47ccdb"}
Jul 17 09:21:23.400712 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:23.400679    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:24.636639 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:24.636608    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:21:24.651482 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:24.651458    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:21:24.924479 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:24.924452    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 09:21:37.374234 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:37.374198    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:37.734003 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:37.733973    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:45.865846 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:45.865813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:45.936838 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:45.936797    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:46.017435 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:46.017396    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:46.593241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:46.593204    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:52.695916 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:52.695883    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:21:52.759241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:21:52.759214    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:04.725985 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:04.725951    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:04.810268 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:04.810237    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:05.162228 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:05.162185    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-588bf84c9b-kmf5s"]
Jul 17 09:22:05.305390 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:05.305361    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:05.412531 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:05.412448    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:05.540123 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:05.540095    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:11.848740 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:11.848710    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:11.941742 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:11.941712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:25.465636 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:25.465551    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:25.533743 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:25.533704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:30.186506 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.186471    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-588bf84c9b-kmf5s" podUID="7d2fdd5f-6d8a-442c-b45b-dc919de74b32" containerName="console" containerID="cri-o://f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245" gracePeriod=15
Jul 17 09:22:30.425579 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.425554    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:22:30.491652 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.491563    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-oauth-serving-cert\") pod \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") "
Jul 17 09:22:30.491652 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.491624    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-config\") pod \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") "
Jul 17 09:22:30.491652 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.491651    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cnfp\" (UniqueName: \"kubernetes.io/projected/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-kube-api-access-9cnfp\") pod \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") "
Jul 17 09:22:30.491954 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.491829    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-trusted-ca-bundle\") pod \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") "
Jul 17 09:22:30.491954 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.491874    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-oauth-config\") pod \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") "
Jul 17 09:22:30.491954 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.491895    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-serving-cert\") pod \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") "
Jul 17 09:22:30.491954 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.491940    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-service-ca\") pod \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\" (UID: \"7d2fdd5f-6d8a-442c-b45b-dc919de74b32\") "
Jul 17 09:22:30.492195 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.492159    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-config" (OuterVolumeSpecName: "console-config") pod "7d2fdd5f-6d8a-442c-b45b-dc919de74b32" (UID: "7d2fdd5f-6d8a-442c-b45b-dc919de74b32"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:22:30.492195 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.492167    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d2fdd5f-6d8a-442c-b45b-dc919de74b32" (UID: "7d2fdd5f-6d8a-442c-b45b-dc919de74b32"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:22:30.492442 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.492276    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7d2fdd5f-6d8a-442c-b45b-dc919de74b32" (UID: "7d2fdd5f-6d8a-442c-b45b-dc919de74b32"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:22:30.492442 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.492386    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d2fdd5f-6d8a-442c-b45b-dc919de74b32" (UID: "7d2fdd5f-6d8a-442c-b45b-dc919de74b32"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:22:30.494055 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.494032    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d2fdd5f-6d8a-442c-b45b-dc919de74b32" (UID: "7d2fdd5f-6d8a-442c-b45b-dc919de74b32"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 09:22:30.494290 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.494263    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d2fdd5f-6d8a-442c-b45b-dc919de74b32" (UID: "7d2fdd5f-6d8a-442c-b45b-dc919de74b32"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 09:22:30.494380 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.494292    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-kube-api-access-9cnfp" (OuterVolumeSpecName: "kube-api-access-9cnfp") pod "7d2fdd5f-6d8a-442c-b45b-dc919de74b32" (UID: "7d2fdd5f-6d8a-442c-b45b-dc919de74b32"). InnerVolumeSpecName "kube-api-access-9cnfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:22:30.592885 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.592829    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-oauth-serving-cert\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:22:30.592885 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.592875    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-config\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:22:30.592885 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.592889    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cnfp\" (UniqueName: \"kubernetes.io/projected/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-kube-api-access-9cnfp\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:22:30.592885 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.592900    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-trusted-ca-bundle\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:22:30.593179 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.592913    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-oauth-config\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:22:30.593179 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.592924    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-console-serving-cert\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:22:30.593179 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:30.592936    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d2fdd5f-6d8a-442c-b45b-dc919de74b32-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:22:31.132649 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:31.132614    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d2fdd5f-6d8a-442c-b45b-dc919de74b32" containerID="f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245" exitCode=0
Jul 17 09:22:31.132846 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:31.132667    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588bf84c9b-kmf5s" event={"ID":"7d2fdd5f-6d8a-442c-b45b-dc919de74b32","Type":"ContainerDied","Data":"f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245"}
Jul 17 09:22:31.132846 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:31.132728    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588bf84c9b-kmf5s" event={"ID":"7d2fdd5f-6d8a-442c-b45b-dc919de74b32","Type":"ContainerDied","Data":"f610373c8d170dc981cdf0e8732a49eb0c5e5417f9ace5011ff92b3acd227962"}
Jul 17 09:22:31.132846 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:31.132671    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588bf84c9b-kmf5s"
Jul 17 09:22:31.132846 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:31.132747    2560 scope.go:117] "RemoveContainer" containerID="f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245"
Jul 17 09:22:31.141005 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:31.140986    2560 scope.go:117] "RemoveContainer" containerID="f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245"
Jul 17 09:22:31.141276 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:22:31.141255    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245\": container with ID starting with f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245 not found: ID does not exist" containerID="f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245"
Jul 17 09:22:31.141344 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:31.141282    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245"} err="failed to get container status \"f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245\": rpc error: code = NotFound desc = could not find container \"f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245\": container with ID starting with f52f0b8109733ec4a8aa9ba22524be0705434cdb44c8a7154fd0845dee4a5245 not found: ID does not exist"
Jul 17 09:22:31.156579 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:31.156557    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-588bf84c9b-kmf5s"]
Jul 17 09:22:31.159381 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:31.159359    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-588bf84c9b-kmf5s"]
Jul 17 09:22:31.182524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:31.182497    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d2fdd5f-6d8a-442c-b45b-dc919de74b32" path="/var/lib/kubelet/pods/7d2fdd5f-6d8a-442c-b45b-dc919de74b32/volumes"
Jul 17 09:22:41.517302 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:41.517252    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:57.184561 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:57.184531    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:22:57.295707 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:22:57.295668    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:23:00.930653 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:23:00.930619    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 09:23:29.267303 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:23:29.267265    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:23:29.586067 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:23:29.585985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:23:33.720341 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:23:33.720308    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:23:33.828770 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:23:33.828738    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:23:38.563997 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:23:38.563964    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:23:38.648608 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:23:38.648574    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:23:50.569458 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:23:50.569425    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:23:51.740125 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:23:51.740093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:23:52.926917 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:23:52.926885    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:23:53.151231 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:23:53.151197    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:00.534926 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:00.534876    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:05.937613 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:05.937575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:06.032327 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:06.032287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:11.341158 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:11.341121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:11.441133 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:11.441083    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:13.455726 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:13.455691    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:24.921465 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:24.921430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:25.000601 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:25.000574    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:28.844509 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:28.844476    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:28.985662 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:28.985630    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:29.450381 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.450349    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:29.714734 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.714658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:29.820340 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.820309    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:29.858669 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.858638    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"]
Jul 17 09:24:29.859115 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.858895    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19f777c8-505f-4696-b944-f742ccfcfc7e" containerName="console"
Jul 17 09:24:29.859115 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.858907    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="19f777c8-505f-4696-b944-f742ccfcfc7e" containerName="console"
Jul 17 09:24:29.859115 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.858915    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2fdd5f-6d8a-442c-b45b-dc919de74b32" containerName="console"
Jul 17 09:24:29.859115 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.858921    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2fdd5f-6d8a-442c-b45b-dc919de74b32" containerName="console"
Jul 17 09:24:29.859115 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.858991    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="19f777c8-505f-4696-b944-f742ccfcfc7e" containerName="console"
Jul 17 09:24:29.859115 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.858999    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d2fdd5f-6d8a-442c-b45b-dc919de74b32" containerName="console"
Jul 17 09:24:29.861821 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.861804    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:29.865481 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.865460    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 09:24:29.865481 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.865472    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 09:24:29.865654 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.865489    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 09:24:29.865654 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.865587    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 09:24:29.865654 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.865621    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pljhm\""
Jul 17 09:24:29.885658 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.885635    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"]
Jul 17 09:24:29.950863 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.950835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c5a9c54-1aba-49a0-a72a-bd19a512920e-manifests\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:29.951021 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.950883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c5a9c54-1aba-49a0-a72a-bd19a512920e-tmp\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:29.951021 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.950970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8kb8\" (UniqueName: \"kubernetes.io/projected/9c5a9c54-1aba-49a0-a72a-bd19a512920e-kube-api-access-m8kb8\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:29.951021 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.951008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c5a9c54-1aba-49a0-a72a-bd19a512920e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:29.951176 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.951074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c5a9c54-1aba-49a0-a72a-bd19a512920e-webhook-cert\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:29.997536 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:29.997465    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:30.051401 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.051372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8kb8\" (UniqueName: \"kubernetes.io/projected/9c5a9c54-1aba-49a0-a72a-bd19a512920e-kube-api-access-m8kb8\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:30.051504 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.051406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c5a9c54-1aba-49a0-a72a-bd19a512920e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:30.051504 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.051437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c5a9c54-1aba-49a0-a72a-bd19a512920e-webhook-cert\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:30.051504 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.051455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c5a9c54-1aba-49a0-a72a-bd19a512920e-manifests\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:30.051504 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.051483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c5a9c54-1aba-49a0-a72a-bd19a512920e-tmp\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:30.051916 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.051896    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c5a9c54-1aba-49a0-a72a-bd19a512920e-manifests\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:30.053749 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.053732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c5a9c54-1aba-49a0-a72a-bd19a512920e-tmp\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:30.053862 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.053839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c5a9c54-1aba-49a0-a72a-bd19a512920e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:30.053921 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.053880    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c5a9c54-1aba-49a0-a72a-bd19a512920e-webhook-cert\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:30.059234 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.059215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8kb8\" (UniqueName: \"kubernetes.io/projected/9c5a9c54-1aba-49a0-a72a-bd19a512920e-kube-api-access-m8kb8\") pod \"opendatahub-operator-controller-manager-76fdbb8988-tjpnz\" (UID: \"9c5a9c54-1aba-49a0-a72a-bd19a512920e\") " pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:30.093935 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.093914    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:30.171827 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.171805    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:30.191642 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.191617    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:30.292993 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.292962    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:30.301451 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.301421    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"]
Jul 17 09:24:30.306136 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:24:30.306106    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5a9c54_1aba_49a0_a72a_bd19a512920e.slice/crio-30b3e445f73d5b27694afd0a45b2080f3a43994d7552f0c2304998ffc0b8384f WatchSource:0}: Error finding container 30b3e445f73d5b27694afd0a45b2080f3a43994d7552f0c2304998ffc0b8384f: Status 404 returned error can't find the container with id 30b3e445f73d5b27694afd0a45b2080f3a43994d7552f0c2304998ffc0b8384f
Jul 17 09:24:30.307921 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.307903    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 09:24:30.391984 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.391941    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:30.494407 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.494376    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:30.514188 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:30.514119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz" event={"ID":"9c5a9c54-1aba-49a0-a72a-bd19a512920e","Type":"ContainerStarted","Data":"30b3e445f73d5b27694afd0a45b2080f3a43994d7552f0c2304998ffc0b8384f"}
Jul 17 09:24:33.528616 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:33.528539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz" event={"ID":"9c5a9c54-1aba-49a0-a72a-bd19a512920e","Type":"ContainerStarted","Data":"a4945a5e0e70f131d3ffe86db719d0f52f6fd15ae3f57e5d53c4b8fdc10983e6"}
Jul 17 09:24:34.533124 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:34.533084    2560 generic.go:356] "Generic (PLEG): container finished" podID="9c5a9c54-1aba-49a0-a72a-bd19a512920e" containerID="a4945a5e0e70f131d3ffe86db719d0f52f6fd15ae3f57e5d53c4b8fdc10983e6" exitCode=0
Jul 17 09:24:34.533479 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:34.533150    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz" event={"ID":"9c5a9c54-1aba-49a0-a72a-bd19a512920e","Type":"ContainerDied","Data":"a4945a5e0e70f131d3ffe86db719d0f52f6fd15ae3f57e5d53c4b8fdc10983e6"}
Jul 17 09:24:35.538970 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:35.538939    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz" event={"ID":"9c5a9c54-1aba-49a0-a72a-bd19a512920e","Type":"ContainerStarted","Data":"7d8cf8157ac81b600c87644e0e061c424bf57934e0971823a8749ac0ec2f59d2"}
Jul 17 09:24:35.539382 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:35.539058    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:35.566117 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:35.566075    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz" podStartSLOduration=2.132129385 podStartE2EDuration="6.566061067s" totalImagesPullingTime="3.38290139s" totalInitContainerRuntime="1.051030292s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:24:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:24:35.564486929 +0000 UTC m=+395.056181334" watchObservedRunningTime="2026-07-17 09:24:35.566061067 +0000 UTC m=+395.057755473"
Jul 17 09:24:39.703098 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:39.703070    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:39.817855 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:39.817822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:46.544686 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:46.544654    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76fdbb8988-tjpnz"
Jul 17 09:24:48.852281 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:48.852240    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:48.957443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:48.957410    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:49.958621 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:49.958582    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:50.050927 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:50.050887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:50.161213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:50.161180    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:50.483464 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:50.483431    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:50.700623 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:50.700593    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:51.483272 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.483231    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:51.572972 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.572943    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:51.576522 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.576497    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"]
Jul 17 09:24:51.586711 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.586688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.589011 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.588989    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 09:24:51.589178 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.588989    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 09:24:51.589178 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.589164    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 09:24:51.589300 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.589291    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 09:24:51.589351 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.589331    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kjwfh\""
Jul 17 09:24:51.592117 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.592096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"]
Jul 17 09:24:51.676286 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.676257    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:51.723460 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.723430    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6cg8\" (UniqueName: \"kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-kube-api-access-z6cg8\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.723631 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.723467    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.723631 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.723546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-istio-token\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.723631 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.723584    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-cacerts\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.723766 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.723635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16235d5-642e-451c-8d90-f393957b70fa-local-certs\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.723766 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.723683    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.723766 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.723711    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.824545 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.824452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16235d5-642e-451c-8d90-f393957b70fa-local-certs\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.824545 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.824500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.824545 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.824519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.824545 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.824540    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6cg8\" (UniqueName: \"kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-kube-api-access-z6cg8\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.824944 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.824653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.824944 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.824733    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-istio-token\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.824944 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.824759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-cacerts\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.825249 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.825229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.827479 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.827453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16235d5-642e-451c-8d90-f393957b70fa-local-certs\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.827582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.827475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.827582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.827533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-cacerts\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.827582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.827561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.836465 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.836445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-istio-token\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.836661 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.836635    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6cg8\" (UniqueName: \"kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-kube-api-access-z6cg8\") pod \"istiod-openshift-gateway-7574459656-knc9q\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:51.897667 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:51.897638    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:52.027715 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:52.027682    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"]
Jul 17 09:24:52.030739 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:24:52.030713    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16235d5_642e_451c_8d90_f393957b70fa.slice/crio-549768e00b069c8363a11991611672877c600df1d3ce942e9aeac39db312140e WatchSource:0}: Error finding container 549768e00b069c8363a11991611672877c600df1d3ce942e9aeac39db312140e: Status 404 returned error can't find the container with id 549768e00b069c8363a11991611672877c600df1d3ce942e9aeac39db312140e
Jul 17 09:24:52.595129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:52.595093    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q" event={"ID":"a16235d5-642e-451c-8d90-f393957b70fa","Type":"ContainerStarted","Data":"549768e00b069c8363a11991611672877c600df1d3ce942e9aeac39db312140e"}
Jul 17 09:24:52.950676 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:52.950622    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:54.629298 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:54.629257    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:24:54.629650 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:54.629334    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:24:55.108673 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:55.108591    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:55.220597 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:55.220561    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:55.613380 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:55.613339    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q" event={"ID":"a16235d5-642e-451c-8d90-f393957b70fa","Type":"ContainerStarted","Data":"fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6"}
Jul 17 09:24:55.613559 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:55.613539    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:55.615245 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:55.615217    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-knc9q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 09:24:55.615387 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:55.615267    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q" podUID="a16235d5-642e-451c-8d90-f393957b70fa" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 09:24:55.673991 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:55.673944    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q" podStartSLOduration=2.077670609 podStartE2EDuration="4.673930658s" totalImagesPullingTime="2.596260049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:24:55.673172404 +0000 UTC m=+415.164866810" watchObservedRunningTime="2026-07-17 09:24:55.673930658 +0000 UTC m=+415.165625062"
Jul 17 09:24:56.378198 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:56.378164    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:56.484643 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:56.484607    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:56.618015 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:56.617990    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:24:56.715950 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:56.715922    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:24:57.327418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.327388    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"]
Jul 17 09:24:57.330814 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.330768    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.338932 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.338913    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 09:24:57.339331 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.339308    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 09:24:57.339331 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.339317    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 09:24:57.339512 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.339334    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 09:24:57.339512 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.339346    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 09:24:57.339512 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.339318    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tfrnw\""
Jul 17 09:24:57.370446 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.370421    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8pnf\" (UniqueName: \"kubernetes.io/projected/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-kube-api-access-g8pnf\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.370580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.370490    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-manager-config\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.370580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.370517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-cert\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.370580 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.370546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-metrics-cert\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.374279 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.374259    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"]
Jul 17 09:24:57.471136 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.471104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8pnf\" (UniqueName: \"kubernetes.io/projected/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-kube-api-access-g8pnf\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.471335 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.471165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-manager-config\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.471412 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.471347    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-cert\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.471412 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.471396    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-metrics-cert\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.471865 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.471847    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-manager-config\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.473748 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.473720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-cert\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.473883 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.473799    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-metrics-cert\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.482882 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.482861    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8pnf\" (UniqueName: \"kubernetes.io/projected/f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba-kube-api-access-g8pnf\") pod \"lws-controller-manager-7dd756d967-46l2f\" (UID: \"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba\") " pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.638750 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.638725    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:24:57.810333 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:57.810298    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"]
Jul 17 09:24:57.810639 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:24:57.810363    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ab21e9_34d4_46c3_9e8f_4cb22274a8ba.slice/crio-86e6a4eb7d2cfe1a43ca3bbe1eb5f9c823241cc80a1242146c5faa10a67f60e1 WatchSource:0}: Error finding container 86e6a4eb7d2cfe1a43ca3bbe1eb5f9c823241cc80a1242146c5faa10a67f60e1: Status 404 returned error can't find the container with id 86e6a4eb7d2cfe1a43ca3bbe1eb5f9c823241cc80a1242146c5faa10a67f60e1
Jul 17 09:24:58.627126 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:24:58.627085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f" event={"ID":"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba","Type":"ContainerStarted","Data":"86e6a4eb7d2cfe1a43ca3bbe1eb5f9c823241cc80a1242146c5faa10a67f60e1"}
Jul 17 09:25:00.634660 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:00.634565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f" event={"ID":"f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba","Type":"ContainerStarted","Data":"ac9b9101693555f636cb3a1c8e610ef1cdab06158a9bfaa1a251d7fb43f11175"}
Jul 17 09:25:00.635066 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:00.634681    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:25:01.459737 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:01.459701    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:25:02.997611 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:02.997581    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:25:03.213181 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:03.213146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:25:03.368726 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:03.368649    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:25:04.070587 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:04.070556    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:25:04.190317 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:04.190287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:25:07.587966 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.587896    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f" podStartSLOduration=8.130834065 podStartE2EDuration="10.587872817s" totalImagesPullingTime="2.457038752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:25:00.701566469 +0000 UTC m=+420.193260874" watchObservedRunningTime="2026-07-17 09:25:07.587872817 +0000 UTC m=+427.079567223"
Jul 17 09:25:07.588440 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.588390    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"]
Jul 17 09:25:07.588626 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.588601    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q" podUID="a16235d5-642e-451c-8d90-f393957b70fa" containerName="discovery" containerID="cri-o://fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6" gracePeriod=30
Jul 17 09:25:07.820881 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.820859    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:25:07.851934 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.851871    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-dns-cert\") pod \"a16235d5-642e-451c-8d90-f393957b70fa\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") "
Jul 17 09:25:07.851934 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.851905    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-ca-configmap\") pod \"a16235d5-642e-451c-8d90-f393957b70fa\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") "
Jul 17 09:25:07.852156 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.851934    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-kubeconfig\") pod \"a16235d5-642e-451c-8d90-f393957b70fa\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") "
Jul 17 09:25:07.852156 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.851983    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6cg8\" (UniqueName: \"kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-kube-api-access-z6cg8\") pod \"a16235d5-642e-451c-8d90-f393957b70fa\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") "
Jul 17 09:25:07.852156 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.852002    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16235d5-642e-451c-8d90-f393957b70fa-local-certs\") pod \"a16235d5-642e-451c-8d90-f393957b70fa\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") "
Jul 17 09:25:07.852156 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.852029    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-istio-token\") pod \"a16235d5-642e-451c-8d90-f393957b70fa\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") "
Jul 17 09:25:07.852156 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.852112    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-cacerts\") pod \"a16235d5-642e-451c-8d90-f393957b70fa\" (UID: \"a16235d5-642e-451c-8d90-f393957b70fa\") "
Jul 17 09:25:07.852416 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.852238    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a16235d5-642e-451c-8d90-f393957b70fa" (UID: "a16235d5-642e-451c-8d90-f393957b70fa"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:25:07.852416 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.852374    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-ca-configmap\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:25:07.854212 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.854184    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16235d5-642e-451c-8d90-f393957b70fa-local-certs" (OuterVolumeSpecName: "local-certs") pod "a16235d5-642e-451c-8d90-f393957b70fa" (UID: "a16235d5-642e-451c-8d90-f393957b70fa"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 09:25:07.854326 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.854209    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-kube-api-access-z6cg8" (OuterVolumeSpecName: "kube-api-access-z6cg8") pod "a16235d5-642e-451c-8d90-f393957b70fa" (UID: "a16235d5-642e-451c-8d90-f393957b70fa"). InnerVolumeSpecName "kube-api-access-z6cg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:25:07.854388 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.854338    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a16235d5-642e-451c-8d90-f393957b70fa" (UID: "a16235d5-642e-451c-8d90-f393957b70fa"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 09:25:07.854388 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.854363    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "a16235d5-642e-451c-8d90-f393957b70fa" (UID: "a16235d5-642e-451c-8d90-f393957b70fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:25:07.854460 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.854413    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a16235d5-642e-451c-8d90-f393957b70fa" (UID: "a16235d5-642e-451c-8d90-f393957b70fa"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 09:25:07.854493 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.854459    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-cacerts" (OuterVolumeSpecName: "cacerts") pod "a16235d5-642e-451c-8d90-f393957b70fa" (UID: "a16235d5-642e-451c-8d90-f393957b70fa"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 09:25:07.953481 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.953449    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6cg8\" (UniqueName: \"kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-kube-api-access-z6cg8\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:25:07.953481 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.953478    2560 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a16235d5-642e-451c-8d90-f393957b70fa-local-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:25:07.953481 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.953486    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a16235d5-642e-451c-8d90-f393957b70fa-istio-token\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:25:07.953685 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.953493    2560 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-cacerts\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:25:07.953685 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.953501    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-csr-dns-cert\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:25:07.953685 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:07.953509    2560 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a16235d5-642e-451c-8d90-f393957b70fa-istio-kubeconfig\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:25:08.664294 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:08.664260    2560 generic.go:356] "Generic (PLEG): container finished" podID="a16235d5-642e-451c-8d90-f393957b70fa" containerID="fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6" exitCode=0
Jul 17 09:25:08.664767 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:08.664304    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"
Jul 17 09:25:08.664767 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:08.664351    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q" event={"ID":"a16235d5-642e-451c-8d90-f393957b70fa","Type":"ContainerDied","Data":"fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6"}
Jul 17 09:25:08.664767 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:08.664403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-knc9q" event={"ID":"a16235d5-642e-451c-8d90-f393957b70fa","Type":"ContainerDied","Data":"549768e00b069c8363a11991611672877c600df1d3ce942e9aeac39db312140e"}
Jul 17 09:25:08.664767 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:08.664431    2560 scope.go:117] "RemoveContainer" containerID="fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6"
Jul 17 09:25:08.672797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:08.672766    2560 scope.go:117] "RemoveContainer" containerID="fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6"
Jul 17 09:25:08.673029 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:25:08.673014    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6\": container with ID starting with fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6 not found: ID does not exist" containerID="fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6"
Jul 17 09:25:08.673078 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:08.673035    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6"} err="failed to get container status \"fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6\": rpc error: code = NotFound desc = could not find container \"fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6\": container with ID starting with fb6b96cb0c51271984e3b3e0586f7599d2a6f02b8eeacf6ae43a18da53b372a6 not found: ID does not exist"
Jul 17 09:25:08.686210 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:08.686188    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"]
Jul 17 09:25:08.690732 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:08.690711    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-knc9q"]
Jul 17 09:25:09.183526 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:09.183487    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a16235d5-642e-451c-8d90-f393957b70fa" path="/var/lib/kubelet/pods/a16235d5-642e-451c-8d90-f393957b70fa/volumes"
Jul 17 09:25:11.640622 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:11.640593    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7dd756d967-46l2f"
Jul 17 09:25:50.599186 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.599145    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:25:50.693059 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.693029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:25:50.700014 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.699989    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgs8z"]
Jul 17 09:25:50.700236 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.700226    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16235d5-642e-451c-8d90-f393957b70fa" containerName="discovery"
Jul 17 09:25:50.700277 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.700238    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16235d5-642e-451c-8d90-f393957b70fa" containerName="discovery"
Jul 17 09:25:50.700310 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.700290    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16235d5-642e-451c-8d90-f393957b70fa" containerName="discovery"
Jul 17 09:25:50.710335 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.710316    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dgs8z"
Jul 17 09:25:50.713009 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.712986    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 09:25:50.714006 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.713983    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 09:25:50.714105 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.713983    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-drv95\""
Jul 17 09:25:50.720472 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.720451    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgs8z"]
Jul 17 09:25:50.795807 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.795729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:25:50.883805 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.883715    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sb67\" (UniqueName: \"kubernetes.io/projected/a2674131-a181-4f74-b96d-15a71d62c646-kube-api-access-6sb67\") pod \"kuadrant-operator-catalog-dgs8z\" (UID: \"a2674131-a181-4f74-b96d-15a71d62c646\") " pod="kuadrant-system/kuadrant-operator-catalog-dgs8z"
Jul 17 09:25:50.984343 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.984310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sb67\" (UniqueName: \"kubernetes.io/projected/a2674131-a181-4f74-b96d-15a71d62c646-kube-api-access-6sb67\") pod \"kuadrant-operator-catalog-dgs8z\" (UID: \"a2674131-a181-4f74-b96d-15a71d62c646\") " pod="kuadrant-system/kuadrant-operator-catalog-dgs8z"
Jul 17 09:25:50.995750 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:50.995725    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sb67\" (UniqueName: \"kubernetes.io/projected/a2674131-a181-4f74-b96d-15a71d62c646-kube-api-access-6sb67\") pod \"kuadrant-operator-catalog-dgs8z\" (UID: \"a2674131-a181-4f74-b96d-15a71d62c646\") " pod="kuadrant-system/kuadrant-operator-catalog-dgs8z"
Jul 17 09:25:51.020442 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.020410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dgs8z"
Jul 17 09:25:51.063935 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.063906    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgs8z"]
Jul 17 09:25:51.143966 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.143944    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgs8z"]
Jul 17 09:25:51.146457 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:25:51.146424    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2674131_a181_4f74_b96d_15a71d62c646.slice/crio-3f2c24f63e1d7ada13590ac8e2be5f70a195f5a239e4bae6b6b3531f7b3a4a1a WatchSource:0}: Error finding container 3f2c24f63e1d7ada13590ac8e2be5f70a195f5a239e4bae6b6b3531f7b3a4a1a: Status 404 returned error can't find the container with id 3f2c24f63e1d7ada13590ac8e2be5f70a195f5a239e4bae6b6b3531f7b3a4a1a
Jul 17 09:25:51.275538 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.275503    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-98nns"]
Jul 17 09:25:51.279555 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.279539    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-98nns"
Jul 17 09:25:51.286517 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.286492    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-98nns"]
Jul 17 09:25:51.387866 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.387828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq4sk\" (UniqueName: \"kubernetes.io/projected/8177e619-4d07-4178-933c-119b9119bbcc-kube-api-access-nq4sk\") pod \"kuadrant-operator-catalog-98nns\" (UID: \"8177e619-4d07-4178-933c-119b9119bbcc\") " pod="kuadrant-system/kuadrant-operator-catalog-98nns"
Jul 17 09:25:51.488294 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.488208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq4sk\" (UniqueName: \"kubernetes.io/projected/8177e619-4d07-4178-933c-119b9119bbcc-kube-api-access-nq4sk\") pod \"kuadrant-operator-catalog-98nns\" (UID: \"8177e619-4d07-4178-933c-119b9119bbcc\") " pod="kuadrant-system/kuadrant-operator-catalog-98nns"
Jul 17 09:25:51.497787 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.497751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq4sk\" (UniqueName: \"kubernetes.io/projected/8177e619-4d07-4178-933c-119b9119bbcc-kube-api-access-nq4sk\") pod \"kuadrant-operator-catalog-98nns\" (UID: \"8177e619-4d07-4178-933c-119b9119bbcc\") " pod="kuadrant-system/kuadrant-operator-catalog-98nns"
Jul 17 09:25:51.524708 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.524663    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:25:51.588384 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.588344    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-98nns"
Jul 17 09:25:51.714089 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.714062    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-98nns"]
Jul 17 09:25:51.719220 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.719194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:25:51.754373 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:25:51.754309    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8177e619_4d07_4178_933c_119b9119bbcc.slice/crio-933f2084c142b4b1c892bd8fa3eba00afb5728b52974e97ee16b6f38f96e6aaf WatchSource:0}: Error finding container 933f2084c142b4b1c892bd8fa3eba00afb5728b52974e97ee16b6f38f96e6aaf: Status 404 returned error can't find the container with id 933f2084c142b4b1c892bd8fa3eba00afb5728b52974e97ee16b6f38f96e6aaf
Jul 17 09:25:51.821280 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.821244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dgs8z" event={"ID":"a2674131-a181-4f74-b96d-15a71d62c646","Type":"ContainerStarted","Data":"3f2c24f63e1d7ada13590ac8e2be5f70a195f5a239e4bae6b6b3531f7b3a4a1a"}
Jul 17 09:25:51.822257 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:51.822231    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-98nns" event={"ID":"8177e619-4d07-4178-933c-119b9119bbcc","Type":"ContainerStarted","Data":"933f2084c142b4b1c892bd8fa3eba00afb5728b52974e97ee16b6f38f96e6aaf"}
Jul 17 09:25:53.831730 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:53.831684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-98nns" event={"ID":"8177e619-4d07-4178-933c-119b9119bbcc","Type":"ContainerStarted","Data":"5b8463a6122c19e47df2af21398b293433ebd8a482ce3dd3669aacbc5eb5408c"}
Jul 17 09:25:53.833090 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:53.833063    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dgs8z" event={"ID":"a2674131-a181-4f74-b96d-15a71d62c646","Type":"ContainerStarted","Data":"6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0"}
Jul 17 09:25:53.833214 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:53.833157    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dgs8z" podUID="a2674131-a181-4f74-b96d-15a71d62c646" containerName="registry-server" containerID="cri-o://6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0" gracePeriod=2
Jul 17 09:25:53.853345 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:53.853294    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-98nns" podStartSLOduration=1.216324467 podStartE2EDuration="2.853279319s" totalImagesPullingTime="1.636954852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:25:53.852502984 +0000 UTC m=+473.344197401" watchObservedRunningTime="2026-07-17 09:25:53.853279319 +0000 UTC m=+473.344973728"
Jul 17 09:25:53.869519 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:53.869478    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dgs8z" podStartSLOduration=1.628165644 podStartE2EDuration="3.869465964s" totalImagesPullingTime="2.24130032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:25:53.868610682 +0000 UTC m=+473.360305088" watchObservedRunningTime="2026-07-17 09:25:53.869465964 +0000 UTC m=+473.361160368"
Jul 17 09:25:54.069711 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.069688    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dgs8z"
Jul 17 09:25:54.211876 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.211847    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sb67\" (UniqueName: \"kubernetes.io/projected/a2674131-a181-4f74-b96d-15a71d62c646-kube-api-access-6sb67\") pod \"a2674131-a181-4f74-b96d-15a71d62c646\" (UID: \"a2674131-a181-4f74-b96d-15a71d62c646\") "
Jul 17 09:25:54.213962 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.213937    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2674131-a181-4f74-b96d-15a71d62c646-kube-api-access-6sb67" (OuterVolumeSpecName: "kube-api-access-6sb67") pod "a2674131-a181-4f74-b96d-15a71d62c646" (UID: "a2674131-a181-4f74-b96d-15a71d62c646"). InnerVolumeSpecName "kube-api-access-6sb67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:25:54.312884 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.312851    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sb67\" (UniqueName: \"kubernetes.io/projected/a2674131-a181-4f74-b96d-15a71d62c646-kube-api-access-6sb67\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:25:54.837675 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.837641    2560 generic.go:356] "Generic (PLEG): container finished" podID="a2674131-a181-4f74-b96d-15a71d62c646" containerID="6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0" exitCode=0
Jul 17 09:25:54.838129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.837685    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dgs8z"
Jul 17 09:25:54.838129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.837720    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dgs8z" event={"ID":"a2674131-a181-4f74-b96d-15a71d62c646","Type":"ContainerDied","Data":"6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0"}
Jul 17 09:25:54.838129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.837767    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dgs8z" event={"ID":"a2674131-a181-4f74-b96d-15a71d62c646","Type":"ContainerDied","Data":"3f2c24f63e1d7ada13590ac8e2be5f70a195f5a239e4bae6b6b3531f7b3a4a1a"}
Jul 17 09:25:54.838129 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.837803    2560 scope.go:117] "RemoveContainer" containerID="6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0"
Jul 17 09:25:54.845600 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.845584    2560 scope.go:117] "RemoveContainer" containerID="6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0"
Jul 17 09:25:54.845835 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:25:54.845819    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0\": container with ID starting with 6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0 not found: ID does not exist" containerID="6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0"
Jul 17 09:25:54.845896 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.845842    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0"} err="failed to get container status \"6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0\": rpc error: code = NotFound desc = could not find container \"6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0\": container with ID starting with 6af28e2f88b80bc83675068605920258e11dc5f83557033a23eec20c99b67dd0 not found: ID does not exist"
Jul 17 09:25:54.860167 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.860147    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgs8z"]
Jul 17 09:25:54.867111 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:54.867092    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dgs8z"]
Jul 17 09:25:55.182363 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:25:55.182327    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2674131-a181-4f74-b96d-15a71d62c646" path="/var/lib/kubelet/pods/a2674131-a181-4f74-b96d-15a71d62c646/volumes"
Jul 17 09:26:01.589108 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:01.589067    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-98nns"
Jul 17 09:26:01.589531 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:01.589142    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-98nns"
Jul 17 09:26:01.610706 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:01.610675    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-98nns"
Jul 17 09:26:01.884699 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:01.884629    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-98nns"
Jul 17 09:26:15.131039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:15.131007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:15.199284 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:15.199255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:20.157971 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:20.157924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:22.603769 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:22.603733    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"]
Jul 17 09:26:22.604155 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:22.603999    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2674131-a181-4f74-b96d-15a71d62c646" containerName="registry-server"
Jul 17 09:26:22.604155 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:22.604012    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2674131-a181-4f74-b96d-15a71d62c646" containerName="registry-server"
Jul 17 09:26:22.604155 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:22.604056    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2674131-a181-4f74-b96d-15a71d62c646" containerName="registry-server"
Jul 17 09:26:22.610309 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:22.610290    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:22.613275 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:22.613254    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-822lc\""
Jul 17 09:26:22.618150 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:22.618125    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"]
Jul 17 09:26:22.709638 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:22.709611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z48vj\" (UniqueName: \"kubernetes.io/projected/ad4dd863-bcf5-4783-8dfd-f565dbff545f-kube-api-access-z48vj\") pod \"limitador-operator-controller-manager-859d7b78bd-wzxpp\" (UID: \"ad4dd863-bcf5-4783-8dfd-f565dbff545f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:22.810177 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:22.810148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z48vj\" (UniqueName: \"kubernetes.io/projected/ad4dd863-bcf5-4783-8dfd-f565dbff545f-kube-api-access-z48vj\") pod \"limitador-operator-controller-manager-859d7b78bd-wzxpp\" (UID: \"ad4dd863-bcf5-4783-8dfd-f565dbff545f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:22.826936 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:22.826909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z48vj\" (UniqueName: \"kubernetes.io/projected/ad4dd863-bcf5-4783-8dfd-f565dbff545f-kube-api-access-z48vj\") pod \"limitador-operator-controller-manager-859d7b78bd-wzxpp\" (UID: \"ad4dd863-bcf5-4783-8dfd-f565dbff545f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:22.920456 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:22.920431    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:23.047586 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:23.047563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"]
Jul 17 09:26:23.049509 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:26:23.049479    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4dd863_bcf5_4783_8dfd_f565dbff545f.slice/crio-d5e0e3e55a73208c08b960f1e61082829475930495e26891ceb460684e51feb7 WatchSource:0}: Error finding container d5e0e3e55a73208c08b960f1e61082829475930495e26891ceb460684e51feb7: Status 404 returned error can't find the container with id d5e0e3e55a73208c08b960f1e61082829475930495e26891ceb460684e51feb7
Jul 17 09:26:23.600983 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:23.600947    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:23.939601 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:23.939566    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp" event={"ID":"ad4dd863-bcf5-4783-8dfd-f565dbff545f","Type":"ContainerStarted","Data":"d5e0e3e55a73208c08b960f1e61082829475930495e26891ceb460684e51feb7"}
Jul 17 09:26:24.944787 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:24.944744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp" event={"ID":"ad4dd863-bcf5-4783-8dfd-f565dbff545f","Type":"ContainerStarted","Data":"3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d"}
Jul 17 09:26:24.945139 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:24.944871    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:24.990336 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:24.990287    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp" podStartSLOduration=1.475645001 podStartE2EDuration="2.99027443s" totalImagesPullingTime="1.514629429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:26:24.988766821 +0000 UTC m=+504.480461237" watchObservedRunningTime="2026-07-17 09:26:24.99027443 +0000 UTC m=+504.481968833"
Jul 17 09:26:27.894544 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:27.894510    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"]
Jul 17 09:26:27.900314 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:27.900294    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:27.902946 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:27.902921    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pqlcp\""
Jul 17 09:26:27.909998 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:27.909979    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"]
Jul 17 09:26:27.952306 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:27.952285    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" (UID: \"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:27.952424 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:27.952316    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g784x\" (UniqueName: \"kubernetes.io/projected/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-kube-api-access-g784x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" (UID: \"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:28.053304 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:28.053275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" (UID: \"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:28.053304 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:28.053308    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g784x\" (UniqueName: \"kubernetes.io/projected/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-kube-api-access-g784x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" (UID: \"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:28.053635 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:28.053614    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" (UID: \"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:28.074651 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:28.074621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g784x\" (UniqueName: \"kubernetes.io/projected/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-kube-api-access-g784x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" (UID: \"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:28.209463 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:28.209400    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:28.339264 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:28.339231    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"]
Jul 17 09:26:28.342758 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:26:28.342728    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99c62be_ca6b_4057_aa9b_0b7bfec4bca1.slice/crio-73fd560ffc193cbd90ac4c047403aab41f1363c0f0704f89115b5bea2d13caf3 WatchSource:0}: Error finding container 73fd560ffc193cbd90ac4c047403aab41f1363c0f0704f89115b5bea2d13caf3: Status 404 returned error can't find the container with id 73fd560ffc193cbd90ac4c047403aab41f1363c0f0704f89115b5bea2d13caf3
Jul 17 09:26:28.614053 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:28.613974    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:28.959878 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:28.959843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9" event={"ID":"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1","Type":"ContainerStarted","Data":"73fd560ffc193cbd90ac4c047403aab41f1363c0f0704f89115b5bea2d13caf3"}
Jul 17 09:26:29.150940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:29.150903    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:31.829719 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:31.829677    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:32.449834 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:32.449801    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:32.929559 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:32.929514    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:33.061385 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:33.061345    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:33.982934 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:33.982899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9" event={"ID":"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1","Type":"ContainerStarted","Data":"2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06"}
Jul 17 09:26:33.983403 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:33.982984    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:34.037772 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:34.037720    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9" podStartSLOduration=1.7533503559999999 podStartE2EDuration="7.037704256s" totalImagesPullingTime="5.2843539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:26:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:26:34.035498678 +0000 UTC m=+513.527193106" watchObservedRunningTime="2026-07-17 09:26:34.037704256 +0000 UTC m=+513.529398662"
Jul 17 09:26:34.633575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:34.633542    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:35.950051 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:35.950024    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:36.597689 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:36.597655    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:36.814402 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:36.814372    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:37.453071 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:37.453035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:37.656826 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:37.656795    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:37.819744 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:37.819658    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:41.393826 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:41.393795    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:41.508797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:41.508753    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:44.989517 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:44.989489    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:46.569911 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.569874    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"]
Jul 17 09:26:46.572892 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.572871    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:46.593891 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.593861    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"]
Jul 17 09:26:46.708721 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.708684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntcrx\" (UniqueName: \"kubernetes.io/projected/d5614a27-c653-46e3-8622-34ac104b660f-kube-api-access-ntcrx\") pod \"kuadrant-operator-controller-manager-86878c769f-vghlr\" (UID: \"d5614a27-c653-46e3-8622-34ac104b660f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:46.708721 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.708727    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5614a27-c653-46e3-8622-34ac104b660f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vghlr\" (UID: \"d5614a27-c653-46e3-8622-34ac104b660f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:46.720300 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.720268    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"]
Jul 17 09:26:46.720484 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.720445    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" containerName="manager" containerID="cri-o://2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06" gracePeriod=2
Jul 17 09:26:46.724849 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.724829    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"]
Jul 17 09:26:46.737342 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.737316    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"]
Jul 17 09:26:46.737569 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:46.737550    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-ntcrx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr" podUID="d5614a27-c653-46e3-8622-34ac104b660f"
Jul 17 09:26:46.750060 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.750028    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"]
Jul 17 09:26:46.752849 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.752828    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"]
Jul 17 09:26:46.753101 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.753087    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" containerName="manager"
Jul 17 09:26:46.753101 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.753102    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" containerName="manager"
Jul 17 09:26:46.753242 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.753159    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" containerName="manager"
Jul 17 09:26:46.755727 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.755708    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:26:46.763392 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.763371    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"]
Jul 17 09:26:46.763554 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.763532    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp" podUID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" containerName="manager" containerID="cri-o://3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d" gracePeriod=2
Jul 17 09:26:46.767320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.767293    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"]
Jul 17 09:26:46.770693 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.770665    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"]
Jul 17 09:26:46.770809 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.770744    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:26:46.773459 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.773435    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"]
Jul 17 09:26:46.785097 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.785071    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"]
Jul 17 09:26:46.805478 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.805448    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj"]
Jul 17 09:26:46.805736 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.805721    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" containerName="manager"
Jul 17 09:26:46.805736 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.805735    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" containerName="manager"
Jul 17 09:26:46.805889 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.805798    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" containerName="manager"
Jul 17 09:26:46.808452 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.808435    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj"
Jul 17 09:26:46.809639 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.809617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntcrx\" (UniqueName: \"kubernetes.io/projected/d5614a27-c653-46e3-8622-34ac104b660f-kube-api-access-ntcrx\") pod \"kuadrant-operator-controller-manager-86878c769f-vghlr\" (UID: \"d5614a27-c653-46e3-8622-34ac104b660f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:46.809739 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.809648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5614a27-c653-46e3-8622-34ac104b660f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vghlr\" (UID: \"d5614a27-c653-46e3-8622-34ac104b660f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:46.810040 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.810025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5614a27-c653-46e3-8622-34ac104b660f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vghlr\" (UID: \"d5614a27-c653-46e3-8622-34ac104b660f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:46.823383 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:46.823301    2560 projected.go:196] Error preparing data for projected volume kube-api-access-ntcrx for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-vghlr" not found
Jul 17 09:26:46.823525 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:46.823380    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5614a27-c653-46e3-8622-34ac104b660f-kube-api-access-ntcrx podName:d5614a27-c653-46e3-8622-34ac104b660f nodeName:}" failed. No retries permitted until 2026-07-17 09:26:47.323360974 +0000 UTC m=+526.815055364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ntcrx" (UniqueName: "kubernetes.io/projected/d5614a27-c653-46e3-8622-34ac104b660f-kube-api-access-ntcrx") pod "kuadrant-operator-controller-manager-86878c769f-vghlr" (UID: "d5614a27-c653-46e3-8622-34ac104b660f") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-vghlr" not found
Jul 17 09:26:46.823752 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:46.823723    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:46.824827 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.824804    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj"]
Jul 17 09:26:46.858884 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:46.858853    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wzxpp\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:46.880697 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:46.880664    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:46.910674 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.910640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5j7m\" (UniqueName: \"kubernetes.io/projected/50b215b9-6384-41a8-beb9-6e2446c84b92-kube-api-access-p5j7m\") pod \"limitador-operator-controller-manager-859d7b78bd-7gfhj\" (UID: \"50b215b9-6384-41a8-beb9-6e2446c84b92\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj"
Jul 17 09:26:46.910867 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.910689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e3b1801-7d0a-4fd1-819e-a59d48eca806-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vs9z8\" (UID: \"1e3b1801-7d0a-4fd1-819e-a59d48eca806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:26:46.910867 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.910752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttb9l\" (UniqueName: \"kubernetes.io/projected/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-kube-api-access-ttb9l\") pod \"kuadrant-operator-controller-manager-86878c769f-ql95w\" (UID: \"2eb6079d-c63a-4774-86ea-2bc4c4d28a48\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:26:46.910986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.910918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ql95w\" (UID: \"2eb6079d-c63a-4774-86ea-2bc4c4d28a48\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:26:46.910986 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.910962    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z5h8\" (UniqueName: \"kubernetes.io/projected/1e3b1801-7d0a-4fd1-819e-a59d48eca806-kube-api-access-9z5h8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vs9z8\" (UID: \"1e3b1801-7d0a-4fd1-819e-a59d48eca806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:26:46.994302 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.994276    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:46.997039 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:46.997009    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:46.998974 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:46.998949    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wzxpp\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:46.999448 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:46.999434    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:47.001269 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.001251    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wzxpp\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:47.003105 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.003083    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:47.011443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.011420    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttb9l\" (UniqueName: \"kubernetes.io/projected/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-kube-api-access-ttb9l\") pod \"kuadrant-operator-controller-manager-86878c769f-ql95w\" (UID: \"2eb6079d-c63a-4774-86ea-2bc4c4d28a48\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:26:47.011525 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.011495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ql95w\" (UID: \"2eb6079d-c63a-4774-86ea-2bc4c4d28a48\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:26:47.011584 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.011532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5h8\" (UniqueName: \"kubernetes.io/projected/1e3b1801-7d0a-4fd1-819e-a59d48eca806-kube-api-access-9z5h8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vs9z8\" (UID: \"1e3b1801-7d0a-4fd1-819e-a59d48eca806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:26:47.011584 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.011556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5j7m\" (UniqueName: \"kubernetes.io/projected/50b215b9-6384-41a8-beb9-6e2446c84b92-kube-api-access-p5j7m\") pod \"limitador-operator-controller-manager-859d7b78bd-7gfhj\" (UID: \"50b215b9-6384-41a8-beb9-6e2446c84b92\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj"
Jul 17 09:26:47.011735 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.011588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e3b1801-7d0a-4fd1-819e-a59d48eca806-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vs9z8\" (UID: \"1e3b1801-7d0a-4fd1-819e-a59d48eca806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:26:47.011914 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.011893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ql95w\" (UID: \"2eb6079d-c63a-4774-86ea-2bc4c4d28a48\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:26:47.011973 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.011953    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e3b1801-7d0a-4fd1-819e-a59d48eca806-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vs9z8\" (UID: \"1e3b1801-7d0a-4fd1-819e-a59d48eca806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:26:47.023245 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.023225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttb9l\" (UniqueName: \"kubernetes.io/projected/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-kube-api-access-ttb9l\") pod \"kuadrant-operator-controller-manager-86878c769f-ql95w\" (UID: \"2eb6079d-c63a-4774-86ea-2bc4c4d28a48\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:26:47.023530 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.023512    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5j7m\" (UniqueName: \"kubernetes.io/projected/50b215b9-6384-41a8-beb9-6e2446c84b92-kube-api-access-p5j7m\") pod \"limitador-operator-controller-manager-859d7b78bd-7gfhj\" (UID: \"50b215b9-6384-41a8-beb9-6e2446c84b92\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj"
Jul 17 09:26:47.023603 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.023559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z5h8\" (UniqueName: \"kubernetes.io/projected/1e3b1801-7d0a-4fd1-819e-a59d48eca806-kube-api-access-9z5h8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vs9z8\" (UID: \"1e3b1801-7d0a-4fd1-819e-a59d48eca806\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:26:47.034646 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.034618    2560 generic.go:356] "Generic (PLEG): container finished" podID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" containerID="3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d" exitCode=0
Jul 17 09:26:47.034738 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.034660    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:47.034738 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.034710    2560 scope.go:117] "RemoveContainer" containerID="3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d"
Jul 17 09:26:47.036012 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.035993    2560 generic.go:356] "Generic (PLEG): container finished" podID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" containerID="2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06" exitCode=0
Jul 17 09:26:47.036094 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.036040    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:47.036094 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.036053    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:47.038305 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.038278    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wzxpp\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:47.041133 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.041100    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:47.042300 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.042284    2560 scope.go:117] "RemoveContainer" containerID="3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d"
Jul 17 09:26:47.042510 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.042492    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d\": container with ID starting with 3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d not found: ID does not exist" containerID="3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d"
Jul 17 09:26:47.042547 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.042518    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d"} err="failed to get container status \"3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d\": rpc error: code = NotFound desc = could not find container \"3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d\": container with ID starting with 3418d731cdc7f00e89dafc0f9d7ad19b92984f0f2fdc4c62b08bc310cee64d1d not found: ID does not exist"
Jul 17 09:26:47.042547 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.042534    2560 scope.go:117] "RemoveContainer" containerID="2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06"
Jul 17 09:26:47.043427 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.043410    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:47.043610 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.043597    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:47.045843 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.045765    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-vghlr\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="d5614a27-c653-46e3-8622-34ac104b660f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:47.049294 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.049278    2560 scope.go:117] "RemoveContainer" containerID="2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06"
Jul 17 09:26:47.049512 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.049495    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06\": container with ID starting with 2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06 not found: ID does not exist" containerID="2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06"
Jul 17 09:26:47.049557 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.049519    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06"} err="failed to get container status \"2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06\": rpc error: code = NotFound desc = could not find container \"2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06\": container with ID starting with 2aadbe25366cd166b844a0b115ab07bc058ccb8c634eff502fd70415b99d6d06 not found: ID does not exist"
Jul 17 09:26:47.050544 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.050527    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wzxpp\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:47.052684 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.052662    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6b5r9\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6b5r9"
Jul 17 09:26:47.054606 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.054587    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-vghlr\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="d5614a27-c653-46e3-8622-34ac104b660f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:47.058403 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:47.058383    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wzxpp\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wzxpp"
Jul 17 09:26:47.112753 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.112680    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-extensions-socket-volume\") pod \"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1\" (UID: \"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1\") "
Jul 17 09:26:47.112753 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.112735    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z48vj\" (UniqueName: \"kubernetes.io/projected/ad4dd863-bcf5-4783-8dfd-f565dbff545f-kube-api-access-z48vj\") pod \"ad4dd863-bcf5-4783-8dfd-f565dbff545f\" (UID: \"ad4dd863-bcf5-4783-8dfd-f565dbff545f\") "
Jul 17 09:26:47.112979 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.112804    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5614a27-c653-46e3-8622-34ac104b660f-extensions-socket-volume\") pod \"d5614a27-c653-46e3-8622-34ac104b660f\" (UID: \"d5614a27-c653-46e3-8622-34ac104b660f\") "
Jul 17 09:26:47.112979 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.112836    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g784x\" (UniqueName: \"kubernetes.io/projected/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-kube-api-access-g784x\") pod \"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1\" (UID: \"e99c62be-ca6b-4057-aa9b-0b7bfec4bca1\") "
Jul 17 09:26:47.112979 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.112970    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntcrx\" (UniqueName: \"kubernetes.io/projected/d5614a27-c653-46e3-8622-34ac104b660f-kube-api-access-ntcrx\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:26:47.113176 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.113073    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5614a27-c653-46e3-8622-34ac104b660f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d5614a27-c653-46e3-8622-34ac104b660f" (UID: "d5614a27-c653-46e3-8622-34ac104b660f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 09:26:47.113212 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.113186    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" (UID: "e99c62be-ca6b-4057-aa9b-0b7bfec4bca1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 09:26:47.114792 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.114760    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4dd863-bcf5-4783-8dfd-f565dbff545f-kube-api-access-z48vj" (OuterVolumeSpecName: "kube-api-access-z48vj") pod "ad4dd863-bcf5-4783-8dfd-f565dbff545f" (UID: "ad4dd863-bcf5-4783-8dfd-f565dbff545f"). InnerVolumeSpecName "kube-api-access-z48vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:26:47.114854 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.114767    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-kube-api-access-g784x" (OuterVolumeSpecName: "kube-api-access-g784x") pod "e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" (UID: "e99c62be-ca6b-4057-aa9b-0b7bfec4bca1"). InnerVolumeSpecName "kube-api-access-g784x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:26:47.148446 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.148417    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:26:47.154667 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.154651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:26:47.161387 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.161365    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj"
Jul 17 09:26:47.183978 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.183946    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad4dd863-bcf5-4783-8dfd-f565dbff545f" path="/var/lib/kubelet/pods/ad4dd863-bcf5-4783-8dfd-f565dbff545f/volumes"
Jul 17 09:26:47.184271 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.184256    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5614a27-c653-46e3-8622-34ac104b660f" path="/var/lib/kubelet/pods/d5614a27-c653-46e3-8622-34ac104b660f/volumes"
Jul 17 09:26:47.184480 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.184467    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e99c62be-ca6b-4057-aa9b-0b7bfec4bca1" path="/var/lib/kubelet/pods/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1/volumes"
Jul 17 09:26:47.213712 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.213550    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z48vj\" (UniqueName: \"kubernetes.io/projected/ad4dd863-bcf5-4783-8dfd-f565dbff545f-kube-api-access-z48vj\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:26:47.213712 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.213582    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5614a27-c653-46e3-8622-34ac104b660f-extensions-socket-volume\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:26:47.213712 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.213596    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g784x\" (UniqueName: \"kubernetes.io/projected/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-kube-api-access-g784x\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:26:47.213712 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.213611    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99c62be-ca6b-4057-aa9b-0b7bfec4bca1-extensions-socket-volume\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:26:47.312115 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.312082    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"]
Jul 17 09:26:47.315398 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:26:47.315367    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3b1801_7d0a_4fd1_819e_a59d48eca806.slice/crio-872c4b3a912c8f2587df333a325f0301502f175489f4b2ec15f85dccf846f7aa WatchSource:0}: Error finding container 872c4b3a912c8f2587df333a325f0301502f175489f4b2ec15f85dccf846f7aa: Status 404 returned error can't find the container with id 872c4b3a912c8f2587df333a325f0301502f175489f4b2ec15f85dccf846f7aa
Jul 17 09:26:47.555442 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.555414    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj"]
Jul 17 09:26:47.559200 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:26:47.559172    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b215b9_6384_41a8_beb9_6e2446c84b92.slice/crio-bc9631b919cde360955f48ff3c1cf78ae26f98e633dca450bf2a601789a25947 WatchSource:0}: Error finding container bc9631b919cde360955f48ff3c1cf78ae26f98e633dca450bf2a601789a25947: Status 404 returned error can't find the container with id bc9631b919cde360955f48ff3c1cf78ae26f98e633dca450bf2a601789a25947
Jul 17 09:26:47.559754 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:47.559701    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"]
Jul 17 09:26:47.561906 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:26:47.561882    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb6079d_c63a_4774_86ea_2bc4c4d28a48.slice/crio-38d04dcc793ac9bb8d4d240840dd1ca9cf3ee6c0c5c2444bb1a6201ec74010aa WatchSource:0}: Error finding container 38d04dcc793ac9bb8d4d240840dd1ca9cf3ee6c0c5c2444bb1a6201ec74010aa: Status 404 returned error can't find the container with id 38d04dcc793ac9bb8d4d240840dd1ca9cf3ee6c0c5c2444bb1a6201ec74010aa
Jul 17 09:26:48.041126 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.041023    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8" event={"ID":"1e3b1801-7d0a-4fd1-819e-a59d48eca806","Type":"ContainerStarted","Data":"d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b"}
Jul 17 09:26:48.041126 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.041087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8" event={"ID":"1e3b1801-7d0a-4fd1-819e-a59d48eca806","Type":"ContainerStarted","Data":"872c4b3a912c8f2587df333a325f0301502f175489f4b2ec15f85dccf846f7aa"}
Jul 17 09:26:48.041126 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.041127    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:26:48.043299 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.043274    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj" event={"ID":"50b215b9-6384-41a8-beb9-6e2446c84b92","Type":"ContainerStarted","Data":"724cb166e8552b4d2a24c93052ce4cab60437fab4d7bf58cf4e24a3b1c7a7973"}
Jul 17 09:26:48.043419 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.043318    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj"
Jul 17 09:26:48.043419 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.043341    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj" event={"ID":"50b215b9-6384-41a8-beb9-6e2446c84b92","Type":"ContainerStarted","Data":"bc9631b919cde360955f48ff3c1cf78ae26f98e633dca450bf2a601789a25947"}
Jul 17 09:26:48.045579 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.045562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:48.045684 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.045593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w" event={"ID":"2eb6079d-c63a-4774-86ea-2bc4c4d28a48","Type":"ContainerStarted","Data":"1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178"}
Jul 17 09:26:48.045684 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.045620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w" event={"ID":"2eb6079d-c63a-4774-86ea-2bc4c4d28a48","Type":"ContainerStarted","Data":"38d04dcc793ac9bb8d4d240840dd1ca9cf3ee6c0c5c2444bb1a6201ec74010aa"}
Jul 17 09:26:48.045684 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.045648    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:26:48.087309 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.087260    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8" podStartSLOduration=2.0872447689999998 podStartE2EDuration="2.087244769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:26:48.086949302 +0000 UTC m=+527.578643699" watchObservedRunningTime="2026-07-17 09:26:48.087244769 +0000 UTC m=+527.578939174"
Jul 17 09:26:48.112839 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.112767    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w" podStartSLOduration=2.112751567 podStartE2EDuration="2.112751567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:26:48.111968672 +0000 UTC m=+527.603663076" watchObservedRunningTime="2026-07-17 09:26:48.112751567 +0000 UTC m=+527.604445971"
Jul 17 09:26:48.150336 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:48.150290    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj" podStartSLOduration=2.150274329 podStartE2EDuration="2.150274329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:26:48.149773379 +0000 UTC m=+527.641467784" watchObservedRunningTime="2026-07-17 09:26:48.150274329 +0000 UTC m=+527.641968734"
Jul 17 09:26:48.151902 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:26:48.151878    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-vghlr\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="d5614a27-c653-46e3-8622-34ac104b660f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vghlr"
Jul 17 09:26:49.027930 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:49.027894    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:49.148443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:49.148411    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:54.116733 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:54.116662    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:54.191096 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:54.191066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:54.458977 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:54.458937    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:54.717417 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:54.717323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:54.822121 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:54.822074    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:54.920577 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:54.920532    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:55.040151 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.040082    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-558879fd98-jvfgv"]
Jul 17 09:26:55.042993 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.042976    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.046156 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.046135    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wp7bs\""
Jul 17 09:26:55.046285 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.046213    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 09:26:55.047254 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.047237    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 09:26:55.047330 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.047280    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 09:26:55.047378 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.047349    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 09:26:55.047436 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.047395    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 09:26:55.047436 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.047399    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 09:26:55.047436 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.047348    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 09:26:55.054369 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.054352    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 17 09:26:55.110746 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.110718    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558879fd98-jvfgv"]
Jul 17 09:26:55.128169 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.128147    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:55.180064 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.180041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd88825f-c15c-404e-b0ac-cef6fa65f79a-console-serving-cert\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.180166 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.180071    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-console-config\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.180166 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.180091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4ww2\" (UniqueName: \"kubernetes.io/projected/dd88825f-c15c-404e-b0ac-cef6fa65f79a-kube-api-access-z4ww2\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.180166 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.180132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-oauth-serving-cert\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.180285 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.180217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-service-ca\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.180285 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.180243    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-trusted-ca-bundle\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.180362 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.180312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd88825f-c15c-404e-b0ac-cef6fa65f79a-console-oauth-config\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.273254 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.273221    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:55.281250 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.281230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd88825f-c15c-404e-b0ac-cef6fa65f79a-console-serving-cert\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.281321 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.281258    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-console-config\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.281321 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.281274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4ww2\" (UniqueName: \"kubernetes.io/projected/dd88825f-c15c-404e-b0ac-cef6fa65f79a-kube-api-access-z4ww2\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.281321 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.281298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-oauth-serving-cert\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.281459 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.281342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-service-ca\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.281459 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.281361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-trusted-ca-bundle\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.281459 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.281399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd88825f-c15c-404e-b0ac-cef6fa65f79a-console-oauth-config\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.282092 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.282072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-oauth-serving-cert\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.282180 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.282078    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-console-config\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.282220 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.282177    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-service-ca\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.282297 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.282281    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd88825f-c15c-404e-b0ac-cef6fa65f79a-trusted-ca-bundle\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.283770 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.283743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd88825f-c15c-404e-b0ac-cef6fa65f79a-console-oauth-config\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.283855 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.283807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd88825f-c15c-404e-b0ac-cef6fa65f79a-console-serving-cert\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.288878 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.288858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4ww2\" (UniqueName: \"kubernetes.io/projected/dd88825f-c15c-404e-b0ac-cef6fa65f79a-kube-api-access-z4ww2\") pod \"console-558879fd98-jvfgv\" (UID: \"dd88825f-c15c-404e-b0ac-cef6fa65f79a\") " pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.352060 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.351994    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:26:55.480143 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.480020    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558879fd98-jvfgv"]
Jul 17 09:26:55.482844 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:26:55.482816    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd88825f_c15c_404e_b0ac_cef6fa65f79a.slice/crio-f0e905af124fd78986028f9c3989a8939aa692870e47f16490aa9e0645f8d3b3 WatchSource:0}: Error finding container f0e905af124fd78986028f9c3989a8939aa692870e47f16490aa9e0645f8d3b3: Status 404 returned error can't find the container with id f0e905af124fd78986028f9c3989a8939aa692870e47f16490aa9e0645f8d3b3
Jul 17 09:26:55.844684 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.844617    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:55.944222 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:55.944190    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:56.080498 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:56.080466    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558879fd98-jvfgv" event={"ID":"dd88825f-c15c-404e-b0ac-cef6fa65f79a","Type":"ContainerStarted","Data":"5e06bbed26329a6091b10055cf1b329b9143067200adeeb2ecb099c19ef3c7e9"}
Jul 17 09:26:56.080667 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:56.080516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558879fd98-jvfgv" event={"ID":"dd88825f-c15c-404e-b0ac-cef6fa65f79a","Type":"ContainerStarted","Data":"f0e905af124fd78986028f9c3989a8939aa692870e47f16490aa9e0645f8d3b3"}
Jul 17 09:26:56.105103 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:56.104999    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-558879fd98-jvfgv" podStartSLOduration=1.104979203 podStartE2EDuration="1.104979203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:26:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:26:56.1032254 +0000 UTC m=+535.594919808" watchObservedRunningTime="2026-07-17 09:26:56.104979203 +0000 UTC m=+535.596673608"
Jul 17 09:26:57.173912 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:57.173878    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:57.285106 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:57.285074    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:59.052569 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.052523    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:26:59.053038 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.052975    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:26:59.053092 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.053071    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gfhj"
Jul 17 09:26:59.148663 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.148633    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"]
Jul 17 09:26:59.148882 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.148857    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8" podUID="1e3b1801-7d0a-4fd1-819e-a59d48eca806" containerName="manager" containerID="cri-o://d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b" gracePeriod=10
Jul 17 09:26:59.395429 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.395399    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:26:59.490533 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.490498    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:59.518487 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.518453    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e3b1801-7d0a-4fd1-819e-a59d48eca806-extensions-socket-volume\") pod \"1e3b1801-7d0a-4fd1-819e-a59d48eca806\" (UID: \"1e3b1801-7d0a-4fd1-819e-a59d48eca806\") "
Jul 17 09:26:59.518647 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.518523    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z5h8\" (UniqueName: \"kubernetes.io/projected/1e3b1801-7d0a-4fd1-819e-a59d48eca806-kube-api-access-9z5h8\") pod \"1e3b1801-7d0a-4fd1-819e-a59d48eca806\" (UID: \"1e3b1801-7d0a-4fd1-819e-a59d48eca806\") "
Jul 17 09:26:59.518906 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.518888    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e3b1801-7d0a-4fd1-819e-a59d48eca806-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1e3b1801-7d0a-4fd1-819e-a59d48eca806" (UID: "1e3b1801-7d0a-4fd1-819e-a59d48eca806"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 09:26:59.520531 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.520505    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3b1801-7d0a-4fd1-819e-a59d48eca806-kube-api-access-9z5h8" (OuterVolumeSpecName: "kube-api-access-9z5h8") pod "1e3b1801-7d0a-4fd1-819e-a59d48eca806" (UID: "1e3b1801-7d0a-4fd1-819e-a59d48eca806"). InnerVolumeSpecName "kube-api-access-9z5h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:26:59.588175 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.588097    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:26:59.619252 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.619224    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z5h8\" (UniqueName: \"kubernetes.io/projected/1e3b1801-7d0a-4fd1-819e-a59d48eca806-kube-api-access-9z5h8\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:26:59.619252 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:26:59.619249    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e3b1801-7d0a-4fd1-819e-a59d48eca806-extensions-socket-volume\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:27:00.101340 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:00.101302    2560 generic.go:356] "Generic (PLEG): container finished" podID="1e3b1801-7d0a-4fd1-819e-a59d48eca806" containerID="d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b" exitCode=0
Jul 17 09:27:00.101340 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:00.101343    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"
Jul 17 09:27:00.101837 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:00.101387    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8" event={"ID":"1e3b1801-7d0a-4fd1-819e-a59d48eca806","Type":"ContainerDied","Data":"d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b"}
Jul 17 09:27:00.101837 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:00.101434    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8" event={"ID":"1e3b1801-7d0a-4fd1-819e-a59d48eca806","Type":"ContainerDied","Data":"872c4b3a912c8f2587df333a325f0301502f175489f4b2ec15f85dccf846f7aa"}
Jul 17 09:27:00.101837 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:00.101458    2560 scope.go:117] "RemoveContainer" containerID="d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b"
Jul 17 09:27:00.112095 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:00.112074    2560 scope.go:117] "RemoveContainer" containerID="d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b"
Jul 17 09:27:00.112400 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:27:00.112371    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b\": container with ID starting with d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b not found: ID does not exist" containerID="d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b"
Jul 17 09:27:00.112465 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:00.112409    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b"} err="failed to get container status \"d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b\": rpc error: code = NotFound desc = could not find container \"d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b\": container with ID starting with d969852608c0e13f98db7a728701c414d29df256fda731b1f28f92e9a4859d3b not found: ID does not exist"
Jul 17 09:27:00.132249 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:00.132224    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"]
Jul 17 09:27:00.138415 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:00.138395    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vs9z8"]
Jul 17 09:27:01.183272 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:01.183240    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e3b1801-7d0a-4fd1-819e-a59d48eca806" path="/var/lib/kubelet/pods/1e3b1801-7d0a-4fd1-819e-a59d48eca806/volumes"
Jul 17 09:27:05.352410 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:05.352370    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:27:05.352914 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:05.352435    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:27:05.357264 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:05.357243    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:27:05.892517 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:05.892486    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:05.994524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:05.994488    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:06.126870 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:06.126838    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-558879fd98-jvfgv"
Jul 17 09:27:06.310677 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:06.310603    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:06.410600 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:06.410569    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:06.512441 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:06.512413    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:12.443734 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:12.443693    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:12.541360 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:12.541323    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:12.642018 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:12.641985    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:15.017459 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.017430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:15.117883 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.117844    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:15.514983 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.514953    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"]
Jul 17 09:27:15.515230 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.515219    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3b1801-7d0a-4fd1-819e-a59d48eca806" containerName="manager"
Jul 17 09:27:15.515280 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.515233    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3b1801-7d0a-4fd1-819e-a59d48eca806" containerName="manager"
Jul 17 09:27:15.515320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.515297    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3b1801-7d0a-4fd1-819e-a59d48eca806" containerName="manager"
Jul 17 09:27:15.517746 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.517727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.520567 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.520547    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v5pkd\""
Jul 17 09:27:15.521020 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.521002    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 09:27:15.531337 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.531312    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"]
Jul 17 09:27:15.552489 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.552461    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:15.648814 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.648761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/591010c8-b78d-46a5-b828-05ecf61a7429-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.648959 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.648819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs9rs\" (UniqueName: \"kubernetes.io/projected/591010c8-b78d-46a5-b828-05ecf61a7429-kube-api-access-cs9rs\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.648959 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.648884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.648959 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.648929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.648959 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.648949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.649091 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.649006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.649091 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.649051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/591010c8-b78d-46a5-b828-05ecf61a7429-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.649164 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.649090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/591010c8-b78d-46a5-b828-05ecf61a7429-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.649164 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.649129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.749653 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.749627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.749843 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.749669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/591010c8-b78d-46a5-b828-05ecf61a7429-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.749843 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.749697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/591010c8-b78d-46a5-b828-05ecf61a7429-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.749843 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.749721    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.749843 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.749741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/591010c8-b78d-46a5-b828-05ecf61a7429-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.749843 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.749763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs9rs\" (UniqueName: \"kubernetes.io/projected/591010c8-b78d-46a5-b828-05ecf61a7429-kube-api-access-cs9rs\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.749843 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.749822    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.750154 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.749864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.750154 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.749895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.750266 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.750174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.750266 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.750217    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.750370 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.750270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.750423 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.750379    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.750698 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.750670    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/591010c8-b78d-46a5-b828-05ecf61a7429-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.751974 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.751956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/591010c8-b78d-46a5-b828-05ecf61a7429-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.752192 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.752175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/591010c8-b78d-46a5-b828-05ecf61a7429-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.758850 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.758826    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/591010c8-b78d-46a5-b828-05ecf61a7429-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.759128 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.759112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs9rs\" (UniqueName: \"kubernetes.io/projected/591010c8-b78d-46a5-b828-05ecf61a7429-kube-api-access-cs9rs\") pod \"maas-default-gateway-openshift-default-56654dcf7-fhm4m\" (UID: \"591010c8-b78d-46a5-b828-05ecf61a7429\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.828112 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.828053    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:15.952234 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.952208    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:15.961133 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:15.961099    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"]
Jul 17 09:27:15.964527 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:27:15.964500    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591010c8_b78d_46a5_b828_05ecf61a7429.slice/crio-437b41afba3bff35131ea1be65ef3afc73e29e8f38105463ad51ff90b5889ccc WatchSource:0}: Error finding container 437b41afba3bff35131ea1be65ef3afc73e29e8f38105463ad51ff90b5889ccc: Status 404 returned error can't find the container with id 437b41afba3bff35131ea1be65ef3afc73e29e8f38105463ad51ff90b5889ccc
Jul 17 09:27:16.162082 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:16.162050    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m" event={"ID":"591010c8-b78d-46a5-b828-05ecf61a7429","Type":"ContainerStarted","Data":"437b41afba3bff35131ea1be65ef3afc73e29e8f38105463ad51ff90b5889ccc"}
Jul 17 09:27:17.815984 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:17.815948    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:17.915378 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:17.915346    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:18.574379 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:18.574341    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:27:18.574455 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:18.574412    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:27:18.574455 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:18.574450    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:27:19.175939 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:19.175905    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m" event={"ID":"591010c8-b78d-46a5-b828-05ecf61a7429","Type":"ContainerStarted","Data":"5d8a293e5df80b2af4e9ddb806d856ea3e6c93991aa50a9fd9c9d797ed14025d"}
Jul 17 09:27:19.201328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:19.201272    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m" podStartSLOduration=1.593883912 podStartE2EDuration="4.201252933s" totalImagesPullingTime="2.607369021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:27:19.200564151 +0000 UTC m=+558.692258557" watchObservedRunningTime="2026-07-17 09:27:19.201252933 +0000 UTC m=+558.692947341"
Jul 17 09:27:19.828525 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:19.828486    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:19.833293 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:19.833270    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:20.180356 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.180326    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:20.181390 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.181373    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:27:20.287711 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.287674    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:20.387106 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.387076    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:20.487158 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.487086    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:20.644887 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.644855    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:27:20.647126 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.647107    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"
Jul 17 09:27:20.649548 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.649524    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 09:27:20.649675 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.649603    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xwls4\""
Jul 17 09:27:20.656961 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.656936    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:27:20.692174 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.692142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7ztk\" (UniqueName: \"kubernetes.io/projected/de9d0914-fc96-444c-89f9-3c8c359db686-kube-api-access-k7ztk\") pod \"limitador-limitador-54d6d988d5-vgs7v\" (UID: \"de9d0914-fc96-444c-89f9-3c8c359db686\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"
Jul 17 09:27:20.692349 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.692194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de9d0914-fc96-444c-89f9-3c8c359db686-config-file\") pod \"limitador-limitador-54d6d988d5-vgs7v\" (UID: \"de9d0914-fc96-444c-89f9-3c8c359db686\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"
Jul 17 09:27:20.703922 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.703892    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:27:20.792629 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.792552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de9d0914-fc96-444c-89f9-3c8c359db686-config-file\") pod \"limitador-limitador-54d6d988d5-vgs7v\" (UID: \"de9d0914-fc96-444c-89f9-3c8c359db686\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"
Jul 17 09:27:20.792629 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.792616    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ztk\" (UniqueName: \"kubernetes.io/projected/de9d0914-fc96-444c-89f9-3c8c359db686-kube-api-access-k7ztk\") pod \"limitador-limitador-54d6d988d5-vgs7v\" (UID: \"de9d0914-fc96-444c-89f9-3c8c359db686\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"
Jul 17 09:27:20.793205 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.793186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/de9d0914-fc96-444c-89f9-3c8c359db686-config-file\") pod \"limitador-limitador-54d6d988d5-vgs7v\" (UID: \"de9d0914-fc96-444c-89f9-3c8c359db686\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"
Jul 17 09:27:20.801191 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.801170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7ztk\" (UniqueName: \"kubernetes.io/projected/de9d0914-fc96-444c-89f9-3c8c359db686-kube-api-access-k7ztk\") pod \"limitador-limitador-54d6d988d5-vgs7v\" (UID: \"de9d0914-fc96-444c-89f9-3c8c359db686\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"
Jul 17 09:27:20.958236 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:20.958195    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"
Jul 17 09:27:21.093363 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.093337    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:27:21.095893 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:27:21.095861    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9d0914_fc96_444c_89f9_3c8c359db686.slice/crio-1cd1d94848c7c654f4d22aac5e1137b9db0a670d5ea9f60cebe9220d5172c51b WatchSource:0}: Error finding container 1cd1d94848c7c654f4d22aac5e1137b9db0a670d5ea9f60cebe9220d5172c51b: Status 404 returned error can't find the container with id 1cd1d94848c7c654f4d22aac5e1137b9db0a670d5ea9f60cebe9220d5172c51b
Jul 17 09:27:21.132665 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.132632    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:21.184852 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.184807    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v" event={"ID":"de9d0914-fc96-444c-89f9-3c8c359db686","Type":"ContainerStarted","Data":"1cd1d94848c7c654f4d22aac5e1137b9db0a670d5ea9f60cebe9220d5172c51b"}
Jul 17 09:27:21.228400 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.228369    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:21.401326 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.401288    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-67hsz"]
Jul 17 09:27:21.405323 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.405304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-67hsz"
Jul 17 09:27:21.407836 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.407815    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b89mc\""
Jul 17 09:27:21.414138 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.414117    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-67hsz"]
Jul 17 09:27:21.499397 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.499354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v84s\" (UniqueName: \"kubernetes.io/projected/33367f56-bfb3-475c-bd1e-8d6a9b7b7740-kube-api-access-6v84s\") pod \"authorino-75d556bd77-67hsz\" (UID: \"33367f56-bfb3-475c-bd1e-8d6a9b7b7740\") " pod="kuadrant-system/authorino-75d556bd77-67hsz"
Jul 17 09:27:21.600807 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.600758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v84s\" (UniqueName: \"kubernetes.io/projected/33367f56-bfb3-475c-bd1e-8d6a9b7b7740-kube-api-access-6v84s\") pod \"authorino-75d556bd77-67hsz\" (UID: \"33367f56-bfb3-475c-bd1e-8d6a9b7b7740\") " pod="kuadrant-system/authorino-75d556bd77-67hsz"
Jul 17 09:27:21.610555 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.610523    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v84s\" (UniqueName: \"kubernetes.io/projected/33367f56-bfb3-475c-bd1e-8d6a9b7b7740-kube-api-access-6v84s\") pod \"authorino-75d556bd77-67hsz\" (UID: \"33367f56-bfb3-475c-bd1e-8d6a9b7b7740\") " pod="kuadrant-system/authorino-75d556bd77-67hsz"
Jul 17 09:27:21.714618 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.714531    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-67hsz"
Jul 17 09:27:21.903889 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:21.903200    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-67hsz"]
Jul 17 09:27:21.906620 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:27:21.906588    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33367f56_bfb3_475c_bd1e_8d6a9b7b7740.slice/crio-9c9a0185473f15dba812b6eec6ffb9353d399179241dc652ad7d76f0871bb036 WatchSource:0}: Error finding container 9c9a0185473f15dba812b6eec6ffb9353d399179241dc652ad7d76f0871bb036: Status 404 returned error can't find the container with id 9c9a0185473f15dba812b6eec6ffb9353d399179241dc652ad7d76f0871bb036
Jul 17 09:27:22.190953 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:22.190918    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-67hsz" event={"ID":"33367f56-bfb3-475c-bd1e-8d6a9b7b7740","Type":"ContainerStarted","Data":"9c9a0185473f15dba812b6eec6ffb9353d399179241dc652ad7d76f0871bb036"}
Jul 17 09:27:24.202636 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:24.202595    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v" event={"ID":"de9d0914-fc96-444c-89f9-3c8c359db686","Type":"ContainerStarted","Data":"f75701ad70417bf1d6d73e74722e350279974b651aa7850c9fcdb458a181edf9"}
Jul 17 09:27:24.203136 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:24.202687    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"
Jul 17 09:27:24.239238 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:24.239159    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v" podStartSLOduration=1.4953720750000001 podStartE2EDuration="4.239134272s" totalImagesPullingTime="2.743762197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:27:24.234978034 +0000 UTC m=+563.726672423" watchObservedRunningTime="2026-07-17 09:27:24.239134272 +0000 UTC m=+563.730828681"
Jul 17 09:27:24.892136 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:24.892096    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:24.969643 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:24.969606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:26.214023 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:26.213934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-67hsz" event={"ID":"33367f56-bfb3-475c-bd1e-8d6a9b7b7740","Type":"ContainerStarted","Data":"0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35"}
Jul 17 09:27:26.232272 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:26.232221    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-67hsz" podStartSLOduration=1.205762168 podStartE2EDuration="5.232205592s" totalImagesPullingTime="4.026443424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:27:26.231654827 +0000 UTC m=+565.723349236" watchObservedRunningTime="2026-07-17 09:27:26.232205592 +0000 UTC m=+565.723899998"
Jul 17 09:27:31.309930 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:31.309890    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:31.426993 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:31.426959    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:35.208937 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:35.208910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"
Jul 17 09:27:36.405514 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:36.405482    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:36.496036 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:36.496002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:36.883477 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:36.883387    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:48.740740 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:48.740703    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:49.116547 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:49.116465    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:50.690538 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:50.690508    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-67hsz"]
Jul 17 09:27:50.690936 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:50.690687    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-67hsz" podUID="33367f56-bfb3-475c-bd1e-8d6a9b7b7740" containerName="authorino" containerID="cri-o://0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35" gracePeriod=30
Jul 17 09:27:50.927582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:50.927557    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-67hsz"
Jul 17 09:27:51.052929 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.052839    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v84s\" (UniqueName: \"kubernetes.io/projected/33367f56-bfb3-475c-bd1e-8d6a9b7b7740-kube-api-access-6v84s\") pod \"33367f56-bfb3-475c-bd1e-8d6a9b7b7740\" (UID: \"33367f56-bfb3-475c-bd1e-8d6a9b7b7740\") "
Jul 17 09:27:51.055159 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.055123    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33367f56-bfb3-475c-bd1e-8d6a9b7b7740-kube-api-access-6v84s" (OuterVolumeSpecName: "kube-api-access-6v84s") pod "33367f56-bfb3-475c-bd1e-8d6a9b7b7740" (UID: "33367f56-bfb3-475c-bd1e-8d6a9b7b7740"). InnerVolumeSpecName "kube-api-access-6v84s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:27:51.154414 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.154382    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v84s\" (UniqueName: \"kubernetes.io/projected/33367f56-bfb3-475c-bd1e-8d6a9b7b7740-kube-api-access-6v84s\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:27:51.317602 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.317522    2560 generic.go:356] "Generic (PLEG): container finished" podID="33367f56-bfb3-475c-bd1e-8d6a9b7b7740" containerID="0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35" exitCode=0
Jul 17 09:27:51.317602 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.317568    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-67hsz"
Jul 17 09:27:51.317602 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.317594    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-67hsz" event={"ID":"33367f56-bfb3-475c-bd1e-8d6a9b7b7740","Type":"ContainerDied","Data":"0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35"}
Jul 17 09:27:51.317892 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.317624    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-67hsz" event={"ID":"33367f56-bfb3-475c-bd1e-8d6a9b7b7740","Type":"ContainerDied","Data":"9c9a0185473f15dba812b6eec6ffb9353d399179241dc652ad7d76f0871bb036"}
Jul 17 09:27:51.317892 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.317642    2560 scope.go:117] "RemoveContainer" containerID="0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35"
Jul 17 09:27:51.325703 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.325683    2560 scope.go:117] "RemoveContainer" containerID="0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35"
Jul 17 09:27:51.326017 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:27:51.325991    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35\": container with ID starting with 0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35 not found: ID does not exist" containerID="0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35"
Jul 17 09:27:51.326130 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.326023    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35"} err="failed to get container status \"0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35\": rpc error: code = NotFound desc = could not find container \"0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35\": container with ID starting with 0054d831f0a04a57ec6e4542daff489b79aab2729f218a2709c1a963d140db35 not found: ID does not exist"
Jul 17 09:27:51.345140 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.345102    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-67hsz"]
Jul 17 09:27:51.353039 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:51.353013    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-67hsz"]
Jul 17 09:27:53.182979 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:53.182947    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33367f56-bfb3-475c-bd1e-8d6a9b7b7740" path="/var/lib/kubelet/pods/33367f56-bfb3-475c-bd1e-8d6a9b7b7740/volumes"
Jul 17 09:27:55.545823 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:55.545769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:55.652577 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:55.652546    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:55.734406 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:55.734378    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:59.180366 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:59.180327    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:27:59.366625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:27:59.366598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:28:29.686976 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:29.686934    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:28:30.332403 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:30.332368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:28:30.468801 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:30.468740    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:28:30.990005 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:30.989970    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:28:31.106628 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:31.106575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:28:31.554556 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:31.554517    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:28:31.600983 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:31.600955    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:28:31.686951 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:31.686919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:28:39.525066 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:39.525030    2560 generic.go:356] "Generic (PLEG): container finished" podID="591010c8-b78d-46a5-b828-05ecf61a7429" containerID="5d8a293e5df80b2af4e9ddb806d856ea3e6c93991aa50a9fd9c9d797ed14025d" exitCode=0
Jul 17 09:28:39.525475 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:39.525079    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m" event={"ID":"591010c8-b78d-46a5-b828-05ecf61a7429","Type":"ContainerDied","Data":"5d8a293e5df80b2af4e9ddb806d856ea3e6c93991aa50a9fd9c9d797ed14025d"}
Jul 17 09:28:39.525516 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:39.525481    2560 scope.go:117] "RemoveContainer" containerID="5d8a293e5df80b2af4e9ddb806d856ea3e6c93991aa50a9fd9c9d797ed14025d"
Jul 17 09:28:39.526508 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:39.526475    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:28:39.526564 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:39.526551    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:28:39.526602 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:39.526585    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:28:40.531203 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:40.531171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m" event={"ID":"591010c8-b78d-46a5-b828-05ecf61a7429","Type":"ContainerStarted","Data":"00bf0d9713b44b63e30961e01fd1733f3aa65ccb76cf9ac808d76967242ff497"}
Jul 17 09:28:40.679175 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:40.679142    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:28:40.828732 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:40.828651    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:28:40.828892 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:40.828835    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-fhm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 17 09:28:40.828940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:40.828890    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m" podUID="591010c8-b78d-46a5-b828-05ecf61a7429" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 17 09:28:40.845586 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:40.845549    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:28:41.829275 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:41.829238    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-fhm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 17 09:28:41.829678 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:41.829303    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m" podUID="591010c8-b78d-46a5-b828-05ecf61a7429" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 17 09:28:42.828646 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:42.828607    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-fhm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 17 09:28:42.828894 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:42.828684    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m" podUID="591010c8-b78d-46a5-b828-05ecf61a7429" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 17 09:28:43.828957 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:43.828915    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-fhm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 17 09:28:43.829384 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:43.828974    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m" podUID="591010c8-b78d-46a5-b828-05ecf61a7429" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 17 09:28:44.828432 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:44.828394    2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-fhm4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 17 09:28:44.828617 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:44.828447    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m" podUID="591010c8-b78d-46a5-b828-05ecf61a7429" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 17 09:28:45.204916 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.204886    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"]
Jul 17 09:28:45.205293 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.205168    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33367f56-bfb3-475c-bd1e-8d6a9b7b7740" containerName="authorino"
Jul 17 09:28:45.205293 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.205179    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="33367f56-bfb3-475c-bd1e-8d6a9b7b7740" containerName="authorino"
Jul 17 09:28:45.205293 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.205238    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="33367f56-bfb3-475c-bd1e-8d6a9b7b7740" containerName="authorino"
Jul 17 09:28:45.208423 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.208400    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.215097 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.214882    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mj6v8\""
Jul 17 09:28:45.215097 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.214913    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 17 09:28:45.215826 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.215805    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 09:28:45.215930 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.215833    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 09:28:45.225479 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.225451    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"]
Jul 17 09:28:45.251521 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.251492    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:28:45.326101 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.326063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.326101 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.326100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.326344 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.326119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dffbg\" (UniqueName: \"kubernetes.io/projected/4293bab8-dc3c-48c4-b091-151c60619cd2-kube-api-access-dffbg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.326344 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.326145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.326344 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.326285    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.326344 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.326309    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4293bab8-dc3c-48c4-b091-151c60619cd2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.427423 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.427384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.427423 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.427428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.427652 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.427452    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dffbg\" (UniqueName: \"kubernetes.io/projected/4293bab8-dc3c-48c4-b091-151c60619cd2-kube-api-access-dffbg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.427652 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.427491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.427652 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.427531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.427652 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.427569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4293bab8-dc3c-48c4-b091-151c60619cd2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.427872 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.427848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.427940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.427923    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.428023 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.428004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.429741 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.429720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4293bab8-dc3c-48c4-b091-151c60619cd2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.430042 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.430019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4293bab8-dc3c-48c4-b091-151c60619cd2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.449823 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.449802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dffbg\" (UniqueName: \"kubernetes.io/projected/4293bab8-dc3c-48c4-b091-151c60619cd2-kube-api-access-dffbg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9\" (UID: \"4293bab8-dc3c-48c4-b091-151c60619cd2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.518566 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.518491    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:45.657678 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.657654    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"]
Jul 17 09:28:45.659982 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:28:45.659957    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4293bab8_dc3c_48c4_b091_151c60619cd2.slice/crio-8f19fe63c65864746ed51842f3424d0c0ecb254ff57e029a25b55f89ac9e98cd WatchSource:0}: Error finding container 8f19fe63c65864746ed51842f3424d0c0ecb254ff57e029a25b55f89ac9e98cd: Status 404 returned error can't find the container with id 8f19fe63c65864746ed51842f3424d0c0ecb254ff57e029a25b55f89ac9e98cd
Jul 17 09:28:45.680632 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.680603    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:28:45.833165 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.833083    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:28:45.833402 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.833371    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:28:45.834012 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:45.833998    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-fhm4m"
Jul 17 09:28:46.557568 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:46.557536    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9" event={"ID":"4293bab8-dc3c-48c4-b091-151c60619cd2","Type":"ContainerStarted","Data":"8f19fe63c65864746ed51842f3424d0c0ecb254ff57e029a25b55f89ac9e98cd"}
Jul 17 09:28:47.563253 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:47.563219    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9" event={"ID":"4293bab8-dc3c-48c4-b091-151c60619cd2","Type":"ContainerStarted","Data":"42aa93f991bf4f3d3601f65cf4f408baa1f598d3a38d3050c3eeab3aa3e4b382"}
Jul 17 09:28:47.585827 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:47.585755    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9" podStartSLOduration=1.3828939089999999 podStartE2EDuration="2.585738556s" totalImagesPullingTime="1.202844647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:28:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:28:47.584993312 +0000 UTC m=+647.076687717" watchObservedRunningTime="2026-07-17 09:28:47.585738556 +0000 UTC m=+647.077432962"
Jul 17 09:28:55.519509 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:55.519473    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:55.519919 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:55.519529    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:55.531856 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:55.531830    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:28:55.608465 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:28:55.608442    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9"
Jul 17 09:29:13.262852 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:13.262820    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:29:14.053267 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:14.053226    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:29:17.901642 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:17.901598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:29:19.064629 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:19.064592    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:29:23.538022 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:23.537981    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:29:25.053840 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:25.053801    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:29:26.689964 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:26.689931    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:29:35.344472 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:35.344427    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:29:36.693165 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:36.693124    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:29:37.174800 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:37.174745    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:29:41.924555 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:41.924522    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:29:42.026160 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:42.026127    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:29:58.668130 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:29:58.668039    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:30:01.166264 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:30:01.166230    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:30:08.981569 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:30:08.981534    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:30:09.090770 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:30:09.090729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:31:12.802708 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:12.802673    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-857df49f64-5fw8t"]
Jul 17 09:31:12.804637 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:12.804618    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-857df49f64-5fw8t"
Jul 17 09:31:12.808074 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:12.808055    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b89mc\""
Jul 17 09:31:12.808175 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:12.808104    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 09:31:12.814346 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:12.814325    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-857df49f64-5fw8t"]
Jul 17 09:31:12.971729 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:12.971695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zn8r\" (UniqueName: \"kubernetes.io/projected/b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab-kube-api-access-7zn8r\") pod \"authorino-857df49f64-5fw8t\" (UID: \"b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab\") " pod="kuadrant-system/authorino-857df49f64-5fw8t"
Jul 17 09:31:12.971921 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:12.971736    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab-tls-cert\") pod \"authorino-857df49f64-5fw8t\" (UID: \"b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab\") " pod="kuadrant-system/authorino-857df49f64-5fw8t"
Jul 17 09:31:13.073131 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:13.073039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zn8r\" (UniqueName: \"kubernetes.io/projected/b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab-kube-api-access-7zn8r\") pod \"authorino-857df49f64-5fw8t\" (UID: \"b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab\") " pod="kuadrant-system/authorino-857df49f64-5fw8t"
Jul 17 09:31:13.073131 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:13.073091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab-tls-cert\") pod \"authorino-857df49f64-5fw8t\" (UID: \"b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab\") " pod="kuadrant-system/authorino-857df49f64-5fw8t"
Jul 17 09:31:13.075546 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:13.075513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab-tls-cert\") pod \"authorino-857df49f64-5fw8t\" (UID: \"b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab\") " pod="kuadrant-system/authorino-857df49f64-5fw8t"
Jul 17 09:31:13.081385 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:13.081356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zn8r\" (UniqueName: \"kubernetes.io/projected/b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab-kube-api-access-7zn8r\") pod \"authorino-857df49f64-5fw8t\" (UID: \"b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab\") " pod="kuadrant-system/authorino-857df49f64-5fw8t"
Jul 17 09:31:13.113743 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:13.113710    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-857df49f64-5fw8t"
Jul 17 09:31:13.165844 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:13.165799    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:31:13.256841 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:13.256818    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-857df49f64-5fw8t"]
Jul 17 09:31:13.259422 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:31:13.259398    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4d0aafe_fd68_426c_aaf9_8e9b16ee5bab.slice/crio-397054799f1ab5be669225983d31443588ed490954c4f1389fcf2c0362fcf1a7 WatchSource:0}: Error finding container 397054799f1ab5be669225983d31443588ed490954c4f1389fcf2c0362fcf1a7: Status 404 returned error can't find the container with id 397054799f1ab5be669225983d31443588ed490954c4f1389fcf2c0362fcf1a7
Jul 17 09:31:13.261013 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:13.260992    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 09:31:13.338111 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:13.338021    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:31:14.173533 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:14.173489    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-857df49f64-5fw8t" event={"ID":"b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab","Type":"ContainerStarted","Data":"8ecff5109986c100eb57af48450dbd3230fd1c48ebf975c43a925f02ee618b5e"}
Jul 17 09:31:14.173940 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:14.173542    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-857df49f64-5fw8t" event={"ID":"b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab","Type":"ContainerStarted","Data":"397054799f1ab5be669225983d31443588ed490954c4f1389fcf2c0362fcf1a7"}
Jul 17 09:31:14.193751 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:14.193691    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-857df49f64-5fw8t" podStartSLOduration=1.700406653 podStartE2EDuration="2.193671529s" totalImagesPullingTime="493.264876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:31:14.193138737 +0000 UTC m=+793.684833144" watchObservedRunningTime="2026-07-17 09:31:14.193671529 +0000 UTC m=+793.685365914"
Jul 17 09:31:14.843914 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:14.843870    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:31:15.396984 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:15.396955    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:31:43.566448 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:43.566413    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:31:55.456030 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:31:55.455992    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:32:05.454707 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:32:05.454670    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:32:21.567007 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:32:21.566957    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:33:24.780575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:33:24.780538    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:33:26.022764 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:33:26.022731    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:33:52.263742 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:33:52.263704    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:34:04.448097 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:34:04.448057    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:34:08.697495 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:34:08.697464    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:34:08.797624 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:34:08.797593    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:34:08.923431 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:34:08.923402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:34:15.628194 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:34:15.628154    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:34:18.187271 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:34:18.187213    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:34:22.464310 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:34:22.464268    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:34:22.584002 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:34:22.583968    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:34:40.348374 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:34:40.348290    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:34:49.255215 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:34:49.255182    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:34:58.948320 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:34:58.948284    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:35:04.543356 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:35:04.543323    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:35:14.560562 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:35:14.560524    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:35:22.760416 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:35:22.760382    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:35:22.947683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:35:22.947639    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:35:23.861494 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:35:23.861449    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:35:34.706738 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:35:34.706703    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:35:34.957388 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:35:34.957308    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:35:44.447715 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:35:44.447681    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:36:07.656590 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:36:07.656496    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:36:16.797472 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:36:16.797436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:36:42.057095 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:36:42.057063    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:36:54.549006 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:36:54.548975    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:37:09.954664 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:37:09.954633    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:37:19.667858 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:37:19.667825    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:37:28.946318 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:37:28.946237    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:37:38.449362 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:37:38.449324    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:37:48.248170 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:37:48.248134    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:38:08.783244 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:08.783207    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:38:16.138022 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:16.137991    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"]
Jul 17 09:38:16.138552 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:16.138191    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w" podUID="2eb6079d-c63a-4774-86ea-2bc4c4d28a48" containerName="manager" containerID="cri-o://1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178" gracePeriod=10
Jul 17 09:38:19.694577 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.694548    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:38:19.841833 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.841716    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-extensions-socket-volume\") pod \"2eb6079d-c63a-4774-86ea-2bc4c4d28a48\" (UID: \"2eb6079d-c63a-4774-86ea-2bc4c4d28a48\") "
Jul 17 09:38:19.842016 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.841880    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttb9l\" (UniqueName: \"kubernetes.io/projected/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-kube-api-access-ttb9l\") pod \"2eb6079d-c63a-4774-86ea-2bc4c4d28a48\" (UID: \"2eb6079d-c63a-4774-86ea-2bc4c4d28a48\") "
Jul 17 09:38:19.842181 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.842156    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2eb6079d-c63a-4774-86ea-2bc4c4d28a48" (UID: "2eb6079d-c63a-4774-86ea-2bc4c4d28a48"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 09:38:19.843932 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.843906    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-kube-api-access-ttb9l" (OuterVolumeSpecName: "kube-api-access-ttb9l") pod "2eb6079d-c63a-4774-86ea-2bc4c4d28a48" (UID: "2eb6079d-c63a-4774-86ea-2bc4c4d28a48"). InnerVolumeSpecName "kube-api-access-ttb9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:38:19.943166 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.943130    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttb9l\" (UniqueName: \"kubernetes.io/projected/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-kube-api-access-ttb9l\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:38:19.943166 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.943159    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2eb6079d-c63a-4774-86ea-2bc4c4d28a48-extensions-socket-volume\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:38:19.993068 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.993034    2560 generic.go:356] "Generic (PLEG): container finished" podID="2eb6079d-c63a-4774-86ea-2bc4c4d28a48" containerID="1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178" exitCode=0
Jul 17 09:38:19.993255 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.993079    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"
Jul 17 09:38:19.993255 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.993107    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w" event={"ID":"2eb6079d-c63a-4774-86ea-2bc4c4d28a48","Type":"ContainerDied","Data":"1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178"}
Jul 17 09:38:19.993255 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.993173    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w" event={"ID":"2eb6079d-c63a-4774-86ea-2bc4c4d28a48","Type":"ContainerDied","Data":"38d04dcc793ac9bb8d4d240840dd1ca9cf3ee6c0c5c2444bb1a6201ec74010aa"}
Jul 17 09:38:19.993255 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:19.993196    2560 scope.go:117] "RemoveContainer" containerID="1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178"
Jul 17 09:38:20.002725 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:20.002704    2560 scope.go:117] "RemoveContainer" containerID="1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178"
Jul 17 09:38:20.003023 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:38:20.003003    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178\": container with ID starting with 1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178 not found: ID does not exist" containerID="1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178"
Jul 17 09:38:20.003095 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:20.003031    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178"} err="failed to get container status \"1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178\": rpc error: code = NotFound desc = could not find container \"1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178\": container with ID starting with 1c04fb16f0ecd7fbbc75225cdd10a923b0fd276a31977250a71e8138b5025178 not found: ID does not exist"
Jul 17 09:38:20.016675 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:20.016648    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"]
Jul 17 09:38:20.020304 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:20.020280    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ql95w"]
Jul 17 09:38:21.184006 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:38:21.183973    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eb6079d-c63a-4774-86ea-2bc4c4d28a48" path="/var/lib/kubelet/pods/2eb6079d-c63a-4774-86ea-2bc4c4d28a48/volumes"
Jul 17 09:39:17.310635 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.310598    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"]
Jul 17 09:39:17.311120 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.310927    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb6079d-c63a-4774-86ea-2bc4c4d28a48" containerName="manager"
Jul 17 09:39:17.311120 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.310939    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb6079d-c63a-4774-86ea-2bc4c4d28a48" containerName="manager"
Jul 17 09:39:17.311120 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.310992    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eb6079d-c63a-4774-86ea-2bc4c4d28a48" containerName="manager"
Jul 17 09:39:17.315220 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.315194    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"
Jul 17 09:39:17.317942 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.317921    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pqlcp\""
Jul 17 09:39:17.330204 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.330180    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"]
Jul 17 09:39:17.445449 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.445406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5df833c0-a751-4bc6-ab22-cf8189d3d119-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m8dql\" (UID: \"5df833c0-a751-4bc6-ab22-cf8189d3d119\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"
Jul 17 09:39:17.445621 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.445555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwmn6\" (UniqueName: \"kubernetes.io/projected/5df833c0-a751-4bc6-ab22-cf8189d3d119-kube-api-access-pwmn6\") pod \"kuadrant-operator-controller-manager-86878c769f-m8dql\" (UID: \"5df833c0-a751-4bc6-ab22-cf8189d3d119\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"
Jul 17 09:39:17.546370 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.546321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwmn6\" (UniqueName: \"kubernetes.io/projected/5df833c0-a751-4bc6-ab22-cf8189d3d119-kube-api-access-pwmn6\") pod \"kuadrant-operator-controller-manager-86878c769f-m8dql\" (UID: \"5df833c0-a751-4bc6-ab22-cf8189d3d119\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"
Jul 17 09:39:17.546370 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.546378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5df833c0-a751-4bc6-ab22-cf8189d3d119-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m8dql\" (UID: \"5df833c0-a751-4bc6-ab22-cf8189d3d119\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"
Jul 17 09:39:17.546733 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.546717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5df833c0-a751-4bc6-ab22-cf8189d3d119-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m8dql\" (UID: \"5df833c0-a751-4bc6-ab22-cf8189d3d119\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"
Jul 17 09:39:17.557166 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.557140    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwmn6\" (UniqueName: \"kubernetes.io/projected/5df833c0-a751-4bc6-ab22-cf8189d3d119-kube-api-access-pwmn6\") pod \"kuadrant-operator-controller-manager-86878c769f-m8dql\" (UID: \"5df833c0-a751-4bc6-ab22-cf8189d3d119\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"
Jul 17 09:39:17.624831 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.624730    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"
Jul 17 09:39:17.761291 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:17.761263    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"]
Jul 17 09:39:17.763052 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:39:17.763025    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df833c0_a751_4bc6_ab22_cf8189d3d119.slice/crio-d2cd6708ffbeb557afc42344d09b85b728aecb735de7f95e57594dcc054347af WatchSource:0}: Error finding container d2cd6708ffbeb557afc42344d09b85b728aecb735de7f95e57594dcc054347af: Status 404 returned error can't find the container with id d2cd6708ffbeb557afc42344d09b85b728aecb735de7f95e57594dcc054347af
Jul 17 09:39:18.241069 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:18.241037    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql" event={"ID":"5df833c0-a751-4bc6-ab22-cf8189d3d119","Type":"ContainerStarted","Data":"ce1179c8b32f5e7a44a457094a826ea903e2d948b49c13f4052c0bd3901871cb"}
Jul 17 09:39:18.241271 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:18.241091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql" event={"ID":"5df833c0-a751-4bc6-ab22-cf8189d3d119","Type":"ContainerStarted","Data":"d2cd6708ffbeb557afc42344d09b85b728aecb735de7f95e57594dcc054347af"}
Jul 17 09:39:18.241271 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:18.241147    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"
Jul 17 09:39:18.291595 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:18.291539    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql" podStartSLOduration=1.2915235360000001 podStartE2EDuration="1.291523536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:39:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:39:18.289604176 +0000 UTC m=+1277.781298585" watchObservedRunningTime="2026-07-17 09:39:18.291523536 +0000 UTC m=+1277.783217940"
Jul 17 09:39:20.749643 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:20.749602    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:39:29.247576 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:29.247540    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m8dql"
Jul 17 09:39:40.165659 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:40.165625    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:39:49.656973 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:39:49.656942    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:40:01.754895 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:40:01.754855    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:40:13.367448 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:40:13.367410    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:40:25.260340 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:40:25.260262    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:40:34.384479 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:40:34.384444    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:40:44.225607 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:40:44.225564    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:40:54.544691 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:40:54.544655    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:41:05.171330 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:41:05.171291    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:41:15.654719 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:41:15.654684    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:41:29.271669 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:41:29.271635    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:41:47.263672 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:41:47.263638    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:41:56.560238 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:41:56.560159    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:42:08.351066 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:42:08.351030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:42:16.255604 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:42:16.255569    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:42:27.164037 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:42:27.164004    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:42:45.061825 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:42:45.061794    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:42:54.258640 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:42:54.258600    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:43:03.452439 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:43:03.452401    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:43:13.462951 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:43:13.462915    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:43:22.448178 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:43:22.448145    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:43:31.166697 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:43:31.166618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:43:31.654324 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:43:31.654297    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:43:44.858117 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:43:44.858070    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:43:49.135700 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:43:49.135663    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:43:49.196340 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:43:49.196308    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:43:54.152469 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:43:54.152429    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:44:03.859844 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:44:03.859800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:44:12.148959 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:44:12.148917    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:44:21.185125 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:44:21.185085    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:44:34.054810 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:44:34.054750    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:44:52.563385 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:44:52.563346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:45:04.052389 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:04.052309    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:45:14.820530 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:14.820496    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:45:17.146549 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:17.146518    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:24.601332 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:24.601290    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:27.776441 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:27.776403    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:45:32.851564 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:32.851528    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:36.347933 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:36.347900    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:45:37.949271 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:37.949234    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:38.272142 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:38.272062    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:38.435121 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:38.435087    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:40.804793 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:40.804741    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:40.903969 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:40.903935    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:41.232003 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:41.231971    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:47.260923 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:47.260885    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:45:47.951006 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:47.950974    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:48.020601 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:48.020568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:48.198843 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:48.198811    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:48.295399 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:48.295326    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:49.313397 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:49.313368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:49.405667 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:49.405642    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:49.578612 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:49.578546    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:49.797602 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:49.797570    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:50.105818 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:50.105770    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:50.205606 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:50.205576    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:52.052609 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:52.052548    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:45:54.353422 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.353385    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"]
Jul 17 09:45:54.356627 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.356610    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"
Jul 17 09:45:54.359278 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.359253    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:45:54.359278 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.359271    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:45:54.364955 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.364923    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"]
Jul 17 09:45:54.457443 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.457414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf\" (UID: \"c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"
Jul 17 09:45:54.558842 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.558808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf\" (UID: \"c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"
Jul 17 09:45:54.559354 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.559335    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf\" (UID: \"c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"
Jul 17 09:45:54.667314 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.667286    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"
Jul 17 09:45:54.800884 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.800850    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"]
Jul 17 09:45:54.803620 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:45:54.803591    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ef4bf2_48cb_4bbc_b4c7_6fae53fff3c8.slice/crio-09aca48114a0a9aed4720fca3ee33e1a7e33ced0cea9a4ea90dfe6a0dbd2f839 WatchSource:0}: Error finding container 09aca48114a0a9aed4720fca3ee33e1a7e33ced0cea9a4ea90dfe6a0dbd2f839: Status 404 returned error can't find the container with id 09aca48114a0a9aed4720fca3ee33e1a7e33ced0cea9a4ea90dfe6a0dbd2f839
Jul 17 09:45:54.805411 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.805394    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 09:45:54.922154 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:54.922080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf" event={"ID":"c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8","Type":"ContainerStarted","Data":"09aca48114a0a9aed4720fca3ee33e1a7e33ced0cea9a4ea90dfe6a0dbd2f839"}
Jul 17 09:45:57.940556 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:57.940522    2560 generic.go:356] "Generic (PLEG): container finished" podID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerID="d3192f7251273e9e09d039d9004145d92de83dfd2ba50c64c1fe8cab207934fc" exitCode=7
Jul 17 09:45:57.941060 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:57.940572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf" event={"ID":"c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8","Type":"ContainerDied","Data":"d3192f7251273e9e09d039d9004145d92de83dfd2ba50c64c1fe8cab207934fc"}
Jul 17 09:45:57.941060 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:57.940838    2560 scope.go:117] "RemoveContainer" containerID="d3192f7251273e9e09d039d9004145d92de83dfd2ba50c64c1fe8cab207934fc"
Jul 17 09:45:58.344103 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:58.344079    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:45:58.946449 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:58.946418    2560 generic.go:356] "Generic (PLEG): container finished" podID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerID="62ec4e1ef730764b0774d408e5bcf04ae1af9f51b92ae2fe8edb2de82785819d" exitCode=7
Jul 17 09:45:58.946954 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:58.946453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf" event={"ID":"c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8","Type":"ContainerDied","Data":"62ec4e1ef730764b0774d408e5bcf04ae1af9f51b92ae2fe8edb2de82785819d"}
Jul 17 09:45:58.946954 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:58.946498    2560 scope.go:117] "RemoveContainer" containerID="d3192f7251273e9e09d039d9004145d92de83dfd2ba50c64c1fe8cab207934fc"
Jul 17 09:45:58.946954 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:58.946727    2560 scope.go:117] "RemoveContainer" containerID="62ec4e1ef730764b0774d408e5bcf04ae1af9f51b92ae2fe8edb2de82785819d"
Jul 17 09:45:58.947117 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:45:58.946987    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf_odh-ai-gateway-infra(c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8"
Jul 17 09:45:59.952057 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:45:59.952028    2560 scope.go:117] "RemoveContainer" containerID="62ec4e1ef730764b0774d408e5bcf04ae1af9f51b92ae2fe8edb2de82785819d"
Jul 17 09:45:59.952407 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:45:59.952214    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf_odh-ai-gateway-infra(c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8"
Jul 17 09:46:11.179846 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:11.179813    2560 scope.go:117] "RemoveContainer" containerID="62ec4e1ef730764b0774d408e5bcf04ae1af9f51b92ae2fe8edb2de82785819d"
Jul 17 09:46:12.005333 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:12.005304    2560 generic.go:356] "Generic (PLEG): container finished" podID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerID="374aa867897e9af4806537f740dd4836ba8e928015bd92a34542934929d88ee5" exitCode=7
Jul 17 09:46:12.005474 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:12.005373    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf" event={"ID":"c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8","Type":"ContainerDied","Data":"374aa867897e9af4806537f740dd4836ba8e928015bd92a34542934929d88ee5"}
Jul 17 09:46:12.005474 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:12.005431    2560 scope.go:117] "RemoveContainer" containerID="62ec4e1ef730764b0774d408e5bcf04ae1af9f51b92ae2fe8edb2de82785819d"
Jul 17 09:46:12.005658 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:12.005644    2560 scope.go:117] "RemoveContainer" containerID="374aa867897e9af4806537f740dd4836ba8e928015bd92a34542934929d88ee5"
Jul 17 09:46:12.005879 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:46:12.005861    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf_odh-ai-gateway-infra(c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8"
Jul 17 09:46:13.034318 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:13.034287    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"]
Jul 17 09:46:13.163586 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:13.163562    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"
Jul 17 09:46:13.212552 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:13.212526    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8-maas-api-service-ca\") pod \"c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8\" (UID: \"c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8\") "
Jul 17 09:46:13.212879 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:13.212858    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" (UID: "c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:46:13.314017 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:13.313956    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:46:14.016304 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:14.016276    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"
Jul 17 09:46:14.016454 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:14.016282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf" event={"ID":"c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8","Type":"ContainerDied","Data":"09aca48114a0a9aed4720fca3ee33e1a7e33ced0cea9a4ea90dfe6a0dbd2f839"}
Jul 17 09:46:14.016454 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:14.016409    2560 scope.go:117] "RemoveContainer" containerID="374aa867897e9af4806537f740dd4836ba8e928015bd92a34542934929d88ee5"
Jul 17 09:46:14.039201 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:14.039175    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"]
Jul 17 09:46:14.045542 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:14.045519    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-xqhpf"]
Jul 17 09:46:15.183224 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:15.183186    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" path="/var/lib/kubelet/pods/c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8/volumes"
Jul 17 09:46:37.000667 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:37.000599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:46:44.419343 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.419309    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"]
Jul 17 09:46:44.419730 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.419650    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerName="revoke-keys"
Jul 17 09:46:44.419730 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.419662    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerName="revoke-keys"
Jul 17 09:46:44.419730 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.419693    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerName="revoke-keys"
Jul 17 09:46:44.419730 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.419699    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerName="revoke-keys"
Jul 17 09:46:44.419907 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.419753    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerName="revoke-keys"
Jul 17 09:46:44.419907 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.419792    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerName="revoke-keys"
Jul 17 09:46:44.419907 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.419801    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerName="revoke-keys"
Jul 17 09:46:44.422838 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.422819    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"
Jul 17 09:46:44.425900 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.425880    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:46:44.426081 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.426069    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:46:44.431600 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.431580    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"]
Jul 17 09:46:44.564669 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.564642    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff33c56-6c4f-47c7-93d0-1f5767060fa6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2\" (UID: \"0ff33c56-6c4f-47c7-93d0-1f5767060fa6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"
Jul 17 09:46:44.665905 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.665880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff33c56-6c4f-47c7-93d0-1f5767060fa6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2\" (UID: \"0ff33c56-6c4f-47c7-93d0-1f5767060fa6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"
Jul 17 09:46:44.666477 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.666458    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff33c56-6c4f-47c7-93d0-1f5767060fa6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2\" (UID: \"0ff33c56-6c4f-47c7-93d0-1f5767060fa6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"
Jul 17 09:46:44.733222 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:44.733173    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"
Jul 17 09:46:45.062258 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:45.062235    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"]
Jul 17 09:46:45.064406 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:46:45.064377    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff33c56_6c4f_47c7_93d0_1f5767060fa6.slice/crio-db83bb9e93227f35b545c2bc1149be2a9dc82a8a7bbefe807d9942d76bdaeede WatchSource:0}: Error finding container db83bb9e93227f35b545c2bc1149be2a9dc82a8a7bbefe807d9942d76bdaeede: Status 404 returned error can't find the container with id db83bb9e93227f35b545c2bc1149be2a9dc82a8a7bbefe807d9942d76bdaeede
Jul 17 09:46:45.145951 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:45.145926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2" event={"ID":"0ff33c56-6c4f-47c7-93d0-1f5767060fa6","Type":"ContainerStarted","Data":"db83bb9e93227f35b545c2bc1149be2a9dc82a8a7bbefe807d9942d76bdaeede"}
Jul 17 09:46:46.151383 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:46.151349    2560 generic.go:356] "Generic (PLEG): container finished" podID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerID="ad6338cf15f10aa5d9c6980e74429a262d3772e29bb98130be40cfd60d70e76f" exitCode=7
Jul 17 09:46:46.151762 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:46.151398    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2" event={"ID":"0ff33c56-6c4f-47c7-93d0-1f5767060fa6","Type":"ContainerDied","Data":"ad6338cf15f10aa5d9c6980e74429a262d3772e29bb98130be40cfd60d70e76f"}
Jul 17 09:46:46.151762 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:46.151648    2560 scope.go:117] "RemoveContainer" containerID="ad6338cf15f10aa5d9c6980e74429a262d3772e29bb98130be40cfd60d70e76f"
Jul 17 09:46:47.157763 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:47.157728    2560 generic.go:356] "Generic (PLEG): container finished" podID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerID="b5882f0992ee12296bd1e0f1e5fe4103b4124833247d5ad567d645412f468d0b" exitCode=7
Jul 17 09:46:47.158270 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:47.157812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2" event={"ID":"0ff33c56-6c4f-47c7-93d0-1f5767060fa6","Type":"ContainerDied","Data":"b5882f0992ee12296bd1e0f1e5fe4103b4124833247d5ad567d645412f468d0b"}
Jul 17 09:46:47.158270 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:47.157916    2560 scope.go:117] "RemoveContainer" containerID="ad6338cf15f10aa5d9c6980e74429a262d3772e29bb98130be40cfd60d70e76f"
Jul 17 09:46:47.158270 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:47.158129    2560 scope.go:117] "RemoveContainer" containerID="b5882f0992ee12296bd1e0f1e5fe4103b4124833247d5ad567d645412f468d0b"
Jul 17 09:46:47.158475 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:46:47.158305    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2_odh-ai-gateway-infra(0ff33c56-6c4f-47c7-93d0-1f5767060fa6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6"
Jul 17 09:46:48.163365 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:46:48.163339    2560 scope.go:117] "RemoveContainer" containerID="b5882f0992ee12296bd1e0f1e5fe4103b4124833247d5ad567d645412f468d0b"
Jul 17 09:46:48.163745 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:46:48.163527    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2_odh-ai-gateway-infra(0ff33c56-6c4f-47c7-93d0-1f5767060fa6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6"
Jul 17 09:47:03.178670 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:03.178639    2560 scope.go:117] "RemoveContainer" containerID="b5882f0992ee12296bd1e0f1e5fe4103b4124833247d5ad567d645412f468d0b"
Jul 17 09:47:04.234603 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:04.234570    2560 generic.go:356] "Generic (PLEG): container finished" podID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerID="6f81c906345e48dd839d37e8cb86a015b4c2e59514c9e0b92dcff12279c42c14" exitCode=7
Jul 17 09:47:04.235057 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:04.234644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2" event={"ID":"0ff33c56-6c4f-47c7-93d0-1f5767060fa6","Type":"ContainerDied","Data":"6f81c906345e48dd839d37e8cb86a015b4c2e59514c9e0b92dcff12279c42c14"}
Jul 17 09:47:04.235057 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:04.234705    2560 scope.go:117] "RemoveContainer" containerID="b5882f0992ee12296bd1e0f1e5fe4103b4124833247d5ad567d645412f468d0b"
Jul 17 09:47:04.235057 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:04.235026    2560 scope.go:117] "RemoveContainer" containerID="6f81c906345e48dd839d37e8cb86a015b4c2e59514c9e0b92dcff12279c42c14"
Jul 17 09:47:04.235248 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:47:04.235225    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2_odh-ai-gateway-infra(0ff33c56-6c4f-47c7-93d0-1f5767060fa6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6"
Jul 17 09:47:05.267442 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:05.267408    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"]
Jul 17 09:47:05.397425 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:05.397400    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"
Jul 17 09:47:05.421362 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:05.421334    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff33c56-6c4f-47c7-93d0-1f5767060fa6-maas-api-service-ca\") pod \"0ff33c56-6c4f-47c7-93d0-1f5767060fa6\" (UID: \"0ff33c56-6c4f-47c7-93d0-1f5767060fa6\") "
Jul 17 09:47:05.421642 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:05.421620    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ff33c56-6c4f-47c7-93d0-1f5767060fa6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0ff33c56-6c4f-47c7-93d0-1f5767060fa6" (UID: "0ff33c56-6c4f-47c7-93d0-1f5767060fa6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:47:05.522499 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:05.522435    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff33c56-6c4f-47c7-93d0-1f5767060fa6-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:47:06.245558 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:06.245532    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"
Jul 17 09:47:06.245558 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:06.245547    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2" event={"ID":"0ff33c56-6c4f-47c7-93d0-1f5767060fa6","Type":"ContainerDied","Data":"db83bb9e93227f35b545c2bc1149be2a9dc82a8a7bbefe807d9942d76bdaeede"}
Jul 17 09:47:06.245800 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:06.245603    2560 scope.go:117] "RemoveContainer" containerID="6f81c906345e48dd839d37e8cb86a015b4c2e59514c9e0b92dcff12279c42c14"
Jul 17 09:47:06.267584 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:06.267558    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"]
Jul 17 09:47:06.272065 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:06.272046    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-wdhq2"]
Jul 17 09:47:07.183641 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:07.183602    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" path="/var/lib/kubelet/pods/0ff33c56-6c4f-47c7-93d0-1f5767060fa6/volumes"
Jul 17 09:47:44.502134 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.502104    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"]
Jul 17 09:47:44.502582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.502383    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerName="revoke-keys"
Jul 17 09:47:44.502582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.502393    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerName="revoke-keys"
Jul 17 09:47:44.502582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.502401    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerName="revoke-keys"
Jul 17 09:47:44.502582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.502407    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerName="revoke-keys"
Jul 17 09:47:44.502582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.502419    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerName="revoke-keys"
Jul 17 09:47:44.502582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.502425    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ef4bf2-48cb-4bbc-b4c7-6fae53fff3c8" containerName="revoke-keys"
Jul 17 09:47:44.502582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.502470    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerName="revoke-keys"
Jul 17 09:47:44.502582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.502478    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerName="revoke-keys"
Jul 17 09:47:44.502582 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.502484    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerName="revoke-keys"
Jul 17 09:47:44.505418 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.505402    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"
Jul 17 09:47:44.508909 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.508881    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:47:44.509911 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.509891    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:47:44.526400 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.526375    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"]
Jul 17 09:47:44.623209 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.623184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5da76fa4-97e2-474e-9e0e-72ffadf55b19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb\" (UID: \"5da76fa4-97e2-474e-9e0e-72ffadf55b19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"
Jul 17 09:47:44.724023 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.723995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5da76fa4-97e2-474e-9e0e-72ffadf55b19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb\" (UID: \"5da76fa4-97e2-474e-9e0e-72ffadf55b19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"
Jul 17 09:47:44.724608 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.724590    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5da76fa4-97e2-474e-9e0e-72ffadf55b19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb\" (UID: \"5da76fa4-97e2-474e-9e0e-72ffadf55b19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"
Jul 17 09:47:44.815550 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.815492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"
Jul 17 09:47:44.963512 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:44.963486    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"]
Jul 17 09:47:44.965452 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:47:44.965428    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da76fa4_97e2_474e_9e0e_72ffadf55b19.slice/crio-376bca4c236fa6331b4f09e15bf0ab67f6c4c46bd1d9154a1f71880f1a3e27e2 WatchSource:0}: Error finding container 376bca4c236fa6331b4f09e15bf0ab67f6c4c46bd1d9154a1f71880f1a3e27e2: Status 404 returned error can't find the container with id 376bca4c236fa6331b4f09e15bf0ab67f6c4c46bd1d9154a1f71880f1a3e27e2
Jul 17 09:47:45.408460 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:45.408428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb" event={"ID":"5da76fa4-97e2-474e-9e0e-72ffadf55b19","Type":"ContainerStarted","Data":"8dd6e9a08eb073151ee81fe6d64438c1387b0acfdeb8eb8f714abeb4e7dc648e"}
Jul 17 09:47:45.408621 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:45.408476    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb" event={"ID":"5da76fa4-97e2-474e-9e0e-72ffadf55b19","Type":"ContainerStarted","Data":"376bca4c236fa6331b4f09e15bf0ab67f6c4c46bd1d9154a1f71880f1a3e27e2"}
Jul 17 09:47:45.427623 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:45.427575    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb" podStartSLOduration=1.427556299 podStartE2EDuration="1.427556299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:47:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:47:45.427501317 +0000 UTC m=+1784.919195748" watchObservedRunningTime="2026-07-17 09:47:45.427556299 +0000 UTC m=+1784.919250701"
Jul 17 09:47:46.413960 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:46.413926    2560 generic.go:356] "Generic (PLEG): container finished" podID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerID="8dd6e9a08eb073151ee81fe6d64438c1387b0acfdeb8eb8f714abeb4e7dc648e" exitCode=7
Jul 17 09:47:46.414316 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:46.413980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb" event={"ID":"5da76fa4-97e2-474e-9e0e-72ffadf55b19","Type":"ContainerDied","Data":"8dd6e9a08eb073151ee81fe6d64438c1387b0acfdeb8eb8f714abeb4e7dc648e"}
Jul 17 09:47:46.414316 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:46.414211    2560 scope.go:117] "RemoveContainer" containerID="8dd6e9a08eb073151ee81fe6d64438c1387b0acfdeb8eb8f714abeb4e7dc648e"
Jul 17 09:47:47.419520 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:47.419482    2560 generic.go:356] "Generic (PLEG): container finished" podID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerID="3b25770d8b496e6221532c9053f7f33b12423a9087fb64f26710b5a5048114a9" exitCode=7
Jul 17 09:47:47.419975 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:47.419568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb" event={"ID":"5da76fa4-97e2-474e-9e0e-72ffadf55b19","Type":"ContainerDied","Data":"3b25770d8b496e6221532c9053f7f33b12423a9087fb64f26710b5a5048114a9"}
Jul 17 09:47:47.419975 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:47.419644    2560 scope.go:117] "RemoveContainer" containerID="8dd6e9a08eb073151ee81fe6d64438c1387b0acfdeb8eb8f714abeb4e7dc648e"
Jul 17 09:47:47.419975 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:47.419749    2560 scope.go:117] "RemoveContainer" containerID="3b25770d8b496e6221532c9053f7f33b12423a9087fb64f26710b5a5048114a9"
Jul 17 09:47:47.419975 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:47:47.419960    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb_odh-ai-gateway-infra(5da76fa4-97e2-474e-9e0e-72ffadf55b19)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19"
Jul 17 09:47:48.425097 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:47:48.425068    2560 scope.go:117] "RemoveContainer" containerID="3b25770d8b496e6221532c9053f7f33b12423a9087fb64f26710b5a5048114a9"
Jul 17 09:47:48.425474 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:47:48.425243    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb_odh-ai-gateway-infra(5da76fa4-97e2-474e-9e0e-72ffadf55b19)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19"
Jul 17 09:48:03.178726 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:03.178690    2560 scope.go:117] "RemoveContainer" containerID="3b25770d8b496e6221532c9053f7f33b12423a9087fb64f26710b5a5048114a9"
Jul 17 09:48:04.491510 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:04.491480    2560 generic.go:356] "Generic (PLEG): container finished" podID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerID="d4572ba3e2bc3706405a01c719763bb5a6a92673c3994dac542863aea12ea0ef" exitCode=7
Jul 17 09:48:04.491919 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:04.491552    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb" event={"ID":"5da76fa4-97e2-474e-9e0e-72ffadf55b19","Type":"ContainerDied","Data":"d4572ba3e2bc3706405a01c719763bb5a6a92673c3994dac542863aea12ea0ef"}
Jul 17 09:48:04.491919 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:04.491609    2560 scope.go:117] "RemoveContainer" containerID="3b25770d8b496e6221532c9053f7f33b12423a9087fb64f26710b5a5048114a9"
Jul 17 09:48:04.492019 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:04.491926    2560 scope.go:117] "RemoveContainer" containerID="d4572ba3e2bc3706405a01c719763bb5a6a92673c3994dac542863aea12ea0ef"
Jul 17 09:48:04.492114 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:48:04.492092    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb_odh-ai-gateway-infra(5da76fa4-97e2-474e-9e0e-72ffadf55b19)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19"
Jul 17 09:48:05.520366 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:05.520334    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"]
Jul 17 09:48:05.654432 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:05.654410    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"
Jul 17 09:48:05.685278 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:05.685255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5da76fa4-97e2-474e-9e0e-72ffadf55b19-maas-api-service-ca\") pod \"5da76fa4-97e2-474e-9e0e-72ffadf55b19\" (UID: \"5da76fa4-97e2-474e-9e0e-72ffadf55b19\") "
Jul 17 09:48:05.685558 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:05.685535    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5da76fa4-97e2-474e-9e0e-72ffadf55b19-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5da76fa4-97e2-474e-9e0e-72ffadf55b19" (UID: "5da76fa4-97e2-474e-9e0e-72ffadf55b19"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:48:05.786440 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:05.786363    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5da76fa4-97e2-474e-9e0e-72ffadf55b19-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:48:06.507756 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:06.507724    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"
Jul 17 09:48:06.507932 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:06.507718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb" event={"ID":"5da76fa4-97e2-474e-9e0e-72ffadf55b19","Type":"ContainerDied","Data":"376bca4c236fa6331b4f09e15bf0ab67f6c4c46bd1d9154a1f71880f1a3e27e2"}
Jul 17 09:48:06.507932 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:06.507887    2560 scope.go:117] "RemoveContainer" containerID="d4572ba3e2bc3706405a01c719763bb5a6a92673c3994dac542863aea12ea0ef"
Jul 17 09:48:06.529935 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:06.529911    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"]
Jul 17 09:48:06.534959 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:06.534939    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-qzxcb"]
Jul 17 09:48:07.183001 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:07.182972    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" path="/var/lib/kubelet/pods/5da76fa4-97e2-474e-9e0e-72ffadf55b19/volumes"
Jul 17 09:48:44.544614 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.544574    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"]
Jul 17 09:48:44.545328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.544898    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerName="revoke-keys"
Jul 17 09:48:44.545328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.544913    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerName="revoke-keys"
Jul 17 09:48:44.545328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.544925    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerName="revoke-keys"
Jul 17 09:48:44.545328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.544930    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff33c56-6c4f-47c7-93d0-1f5767060fa6" containerName="revoke-keys"
Jul 17 09:48:44.545328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.544939    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerName="revoke-keys"
Jul 17 09:48:44.545328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.544945    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerName="revoke-keys"
Jul 17 09:48:44.545328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.544953    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerName="revoke-keys"
Jul 17 09:48:44.545328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.544959    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerName="revoke-keys"
Jul 17 09:48:44.545328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.545006    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerName="revoke-keys"
Jul 17 09:48:44.545328 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.545016    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerName="revoke-keys"
Jul 17 09:48:44.548080 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.548064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"
Jul 17 09:48:44.550991 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.550964    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:48:44.551125 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.551048    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:48:44.557254 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.557232    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"]
Jul 17 09:48:44.690658 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.690611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c57ca87-fd76-4718-a133-d49da95e3fc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp\" (UID: \"5c57ca87-fd76-4718-a133-d49da95e3fc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"
Jul 17 09:48:44.791921 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.791894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c57ca87-fd76-4718-a133-d49da95e3fc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp\" (UID: \"5c57ca87-fd76-4718-a133-d49da95e3fc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"
Jul 17 09:48:44.792460 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.792442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c57ca87-fd76-4718-a133-d49da95e3fc0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp\" (UID: \"5c57ca87-fd76-4718-a133-d49da95e3fc0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"
Jul 17 09:48:44.858612 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.858564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"
Jul 17 09:48:44.997701 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:44.993835    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"]
Jul 17 09:48:44.999293 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:48:44.999258    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c57ca87_fd76_4718_a133_d49da95e3fc0.slice/crio-1e6d9ce2c151bb1c0f06f6dd427205d1598c7e3107caed05bcd1cfadf925fa81 WatchSource:0}: Error finding container 1e6d9ce2c151bb1c0f06f6dd427205d1598c7e3107caed05bcd1cfadf925fa81: Status 404 returned error can't find the container with id 1e6d9ce2c151bb1c0f06f6dd427205d1598c7e3107caed05bcd1cfadf925fa81
Jul 17 09:48:45.666142 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:45.666113    2560 generic.go:356] "Generic (PLEG): container finished" podID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerID="ac4aea452e022add0ad83c56beb6607af6d2abef632e798b228f3fccad0ec340" exitCode=7
Jul 17 09:48:45.666492 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:45.666197    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp" event={"ID":"5c57ca87-fd76-4718-a133-d49da95e3fc0","Type":"ContainerDied","Data":"ac4aea452e022add0ad83c56beb6607af6d2abef632e798b228f3fccad0ec340"}
Jul 17 09:48:45.666492 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:45.666264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp" event={"ID":"5c57ca87-fd76-4718-a133-d49da95e3fc0","Type":"ContainerStarted","Data":"1e6d9ce2c151bb1c0f06f6dd427205d1598c7e3107caed05bcd1cfadf925fa81"}
Jul 17 09:48:45.666492 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:45.666339    2560 scope.go:117] "RemoveContainer" containerID="ac4aea452e022add0ad83c56beb6607af6d2abef632e798b228f3fccad0ec340"
Jul 17 09:48:46.671734 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:46.671696    2560 generic.go:356] "Generic (PLEG): container finished" podID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerID="e8e412e3d60aa66b97f8a0582706525f240f00b787a71c6092e2bd42bc3831f8" exitCode=7
Jul 17 09:48:46.672191 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:46.671793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp" event={"ID":"5c57ca87-fd76-4718-a133-d49da95e3fc0","Type":"ContainerDied","Data":"e8e412e3d60aa66b97f8a0582706525f240f00b787a71c6092e2bd42bc3831f8"}
Jul 17 09:48:46.672191 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:46.671847    2560 scope.go:117] "RemoveContainer" containerID="ac4aea452e022add0ad83c56beb6607af6d2abef632e798b228f3fccad0ec340"
Jul 17 09:48:46.672191 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:46.672033    2560 scope.go:117] "RemoveContainer" containerID="e8e412e3d60aa66b97f8a0582706525f240f00b787a71c6092e2bd42bc3831f8"
Jul 17 09:48:46.672354 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:48:46.672267    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp_odh-ai-gateway-infra(5c57ca87-fd76-4718-a133-d49da95e3fc0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0"
Jul 17 09:48:47.677795 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:47.677760    2560 scope.go:117] "RemoveContainer" containerID="e8e412e3d60aa66b97f8a0582706525f240f00b787a71c6092e2bd42bc3831f8"
Jul 17 09:48:47.678254 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:48:47.678021    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp_odh-ai-gateway-infra(5c57ca87-fd76-4718-a133-d49da95e3fc0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0"
Jul 17 09:48:50.188595 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:50.188568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:48:50.318884 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:50.318852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:48:54.554469 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:54.554438    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:48:54.652966 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:54.652938    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:48:57.376563 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:48:57.376530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:49:01.190708 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:01.190674    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:01.440882 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:01.440854    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:02.178659 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:02.178630    2560 scope.go:117] "RemoveContainer" containerID="e8e412e3d60aa66b97f8a0582706525f240f00b787a71c6092e2bd42bc3831f8"
Jul 17 09:49:02.738998 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:02.738966    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp" event={"ID":"5c57ca87-fd76-4718-a133-d49da95e3fc0","Type":"ContainerStarted","Data":"a39c3f1bf76164dffce5b8aaef1960ad50e8724f14c993130608fbf208c82928"}
Jul 17 09:49:02.756607 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:02.756533    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp" podStartSLOduration=18.756519226 podStartE2EDuration="18.756519226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:48:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:49:02.756328989 +0000 UTC m=+1862.248023394" watchObservedRunningTime="2026-07-17 09:49:02.756519226 +0000 UTC m=+1862.248213629"
Jul 17 09:49:03.744455 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:03.744423    2560 generic.go:356] "Generic (PLEG): container finished" podID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerID="a39c3f1bf76164dffce5b8aaef1960ad50e8724f14c993130608fbf208c82928" exitCode=6
Jul 17 09:49:03.744905 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:03.744477    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp" event={"ID":"5c57ca87-fd76-4718-a133-d49da95e3fc0","Type":"ContainerDied","Data":"a39c3f1bf76164dffce5b8aaef1960ad50e8724f14c993130608fbf208c82928"}
Jul 17 09:49:03.744905 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:03.744524    2560 scope.go:117] "RemoveContainer" containerID="e8e412e3d60aa66b97f8a0582706525f240f00b787a71c6092e2bd42bc3831f8"
Jul 17 09:49:03.744905 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:03.744762    2560 scope.go:117] "RemoveContainer" containerID="a39c3f1bf76164dffce5b8aaef1960ad50e8724f14c993130608fbf208c82928"
Jul 17 09:49:03.745042 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:49:03.744977    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp_odh-ai-gateway-infra(5c57ca87-fd76-4718-a133-d49da95e3fc0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0"
Jul 17 09:49:03.766445 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:03.766423    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"]
Jul 17 09:49:04.874319 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:04.874297    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"
Jul 17 09:49:05.054258 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:05.054183    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c57ca87-fd76-4718-a133-d49da95e3fc0-maas-api-service-ca\") pod \"5c57ca87-fd76-4718-a133-d49da95e3fc0\" (UID: \"5c57ca87-fd76-4718-a133-d49da95e3fc0\") "
Jul 17 09:49:05.054485 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:05.054464    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c57ca87-fd76-4718-a133-d49da95e3fc0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5c57ca87-fd76-4718-a133-d49da95e3fc0" (UID: "5c57ca87-fd76-4718-a133-d49da95e3fc0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:49:05.155066 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:05.155030    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c57ca87-fd76-4718-a133-d49da95e3fc0-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:49:05.763060 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:05.763026    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"
Jul 17 09:49:05.763237 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:05.763060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp" event={"ID":"5c57ca87-fd76-4718-a133-d49da95e3fc0","Type":"ContainerDied","Data":"1e6d9ce2c151bb1c0f06f6dd427205d1598c7e3107caed05bcd1cfadf925fa81"}
Jul 17 09:49:05.763237 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:05.763132    2560 scope.go:117] "RemoveContainer" containerID="a39c3f1bf76164dffce5b8aaef1960ad50e8724f14c993130608fbf208c82928"
Jul 17 09:49:05.781541 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:05.781517    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"]
Jul 17 09:49:05.788084 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:05.788065    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-cbqfp"]
Jul 17 09:49:06.274270 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:06.274237    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:07.183527 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:07.183488    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0" path="/var/lib/kubelet/pods/5c57ca87-fd76-4718-a133-d49da95e3fc0/volumes"
Jul 17 09:49:07.862540 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:07.862508    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:07.962215 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:07.962185    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:08.152866 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:08.152838    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:08.247262 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:08.247238    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:08.398311 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:08.398281    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:08.538870 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:08.538769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:09.822388 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:09.822352    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:10.066363 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:10.066312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:10.182002 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:10.181690    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:10.764073 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:10.764038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:10.851490 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:10.851456    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:12.000806 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:12.000177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:49:12.003804 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:12.001249    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:49:14.246545 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.246515    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"]
Jul 17 09:49:14.246933 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.246805    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerName="revoke-keys"
Jul 17 09:49:14.246933 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.246816    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerName="revoke-keys"
Jul 17 09:49:14.246933 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.246831    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerName="revoke-keys"
Jul 17 09:49:14.246933 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.246836    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerName="revoke-keys"
Jul 17 09:49:14.246933 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.246880    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5da76fa4-97e2-474e-9e0e-72ffadf55b19" containerName="revoke-keys"
Jul 17 09:49:14.246933 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.246888    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerName="revoke-keys"
Jul 17 09:49:14.246933 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.246897    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerName="revoke-keys"
Jul 17 09:49:14.251303 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.251285    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"
Jul 17 09:49:14.254378 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.254356    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:49:14.254755 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.254739    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:49:14.268537 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.268508    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"]
Jul 17 09:49:14.321253 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.321222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58\" (UID: \"9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"
Jul 17 09:49:14.421959 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.421932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58\" (UID: \"9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"
Jul 17 09:49:14.422500 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.422482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58\" (UID: \"9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"
Jul 17 09:49:14.561691 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.561619    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"
Jul 17 09:49:14.700069 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.700045    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"]
Jul 17 09:49:14.701614 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:49:14.701589    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8cd3c3_075b_46b5_bfcb_3025f4e4d7d4.slice/crio-8468bd6bfc13a3f0939e2f86c641b169cbd42c62fe677029a3e49c5f20617291 WatchSource:0}: Error finding container 8468bd6bfc13a3f0939e2f86c641b169cbd42c62fe677029a3e49c5f20617291: Status 404 returned error can't find the container with id 8468bd6bfc13a3f0939e2f86c641b169cbd42c62fe677029a3e49c5f20617291
Jul 17 09:49:14.802738 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:14.802710    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58" event={"ID":"9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4","Type":"ContainerStarted","Data":"8468bd6bfc13a3f0939e2f86c641b169cbd42c62fe677029a3e49c5f20617291"}
Jul 17 09:49:15.808309 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:15.808279    2560 generic.go:356] "Generic (PLEG): container finished" podID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerID="9b4251e4e31354497325a2019a5fcd07cd622c56539cf4a4c81c24bfdb52b474" exitCode=7
Jul 17 09:49:15.808680 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:15.808343    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58" event={"ID":"9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4","Type":"ContainerDied","Data":"9b4251e4e31354497325a2019a5fcd07cd622c56539cf4a4c81c24bfdb52b474"}
Jul 17 09:49:15.808680 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:15.808494    2560 scope.go:117] "RemoveContainer" containerID="9b4251e4e31354497325a2019a5fcd07cd622c56539cf4a4c81c24bfdb52b474"
Jul 17 09:49:16.814485 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:16.814451    2560 generic.go:356] "Generic (PLEG): container finished" podID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerID="0312f8e78ce91eb51cc1612bb722b6fd5d55cd6120bfa126cbad0cfffc721ca8" exitCode=7
Jul 17 09:49:16.814916 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:16.814537    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58" event={"ID":"9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4","Type":"ContainerDied","Data":"0312f8e78ce91eb51cc1612bb722b6fd5d55cd6120bfa126cbad0cfffc721ca8"}
Jul 17 09:49:16.814916 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:16.814598    2560 scope.go:117] "RemoveContainer" containerID="9b4251e4e31354497325a2019a5fcd07cd622c56539cf4a4c81c24bfdb52b474"
Jul 17 09:49:16.814916 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:16.814845    2560 scope.go:117] "RemoveContainer" containerID="0312f8e78ce91eb51cc1612bb722b6fd5d55cd6120bfa126cbad0cfffc721ca8"
Jul 17 09:49:16.815053 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:49:16.815032    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58_odh-ai-gateway-infra(9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4"
Jul 17 09:49:17.820323 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:17.820299    2560 scope.go:117] "RemoveContainer" containerID="0312f8e78ce91eb51cc1612bb722b6fd5d55cd6120bfa126cbad0cfffc721ca8"
Jul 17 09:49:17.820712 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:49:17.820478    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58_odh-ai-gateway-infra(9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4"
Jul 17 09:49:32.178647 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:32.178574    2560 scope.go:117] "RemoveContainer" containerID="0312f8e78ce91eb51cc1612bb722b6fd5d55cd6120bfa126cbad0cfffc721ca8"
Jul 17 09:49:32.890631 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:32.890603    2560 generic.go:356] "Generic (PLEG): container finished" podID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerID="8d4355cee99945532607df9713a3bfa7d4e91c4ba41bb0020a8f076b58eaea68" exitCode=7
Jul 17 09:49:32.890740 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:32.890675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58" event={"ID":"9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4","Type":"ContainerDied","Data":"8d4355cee99945532607df9713a3bfa7d4e91c4ba41bb0020a8f076b58eaea68"}
Jul 17 09:49:32.890740 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:32.890735    2560 scope.go:117] "RemoveContainer" containerID="0312f8e78ce91eb51cc1612bb722b6fd5d55cd6120bfa126cbad0cfffc721ca8"
Jul 17 09:49:32.891031 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:32.891017    2560 scope.go:117] "RemoveContainer" containerID="8d4355cee99945532607df9713a3bfa7d4e91c4ba41bb0020a8f076b58eaea68"
Jul 17 09:49:32.891227 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:49:32.891209    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58_odh-ai-gateway-infra(9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4"
Jul 17 09:49:33.939606 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:33.939572    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"]
Jul 17 09:49:34.063706 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:34.063684    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"
Jul 17 09:49:34.182517 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:34.182493    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4-maas-api-service-ca\") pod \"9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4\" (UID: \"9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4\") "
Jul 17 09:49:34.182827 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:34.182806    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" (UID: "9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:49:34.283764 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:34.283707    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:49:34.901815 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:34.901771    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"
Jul 17 09:49:34.902008 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:34.901812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58" event={"ID":"9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4","Type":"ContainerDied","Data":"8468bd6bfc13a3f0939e2f86c641b169cbd42c62fe677029a3e49c5f20617291"}
Jul 17 09:49:34.902008 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:34.901874    2560 scope.go:117] "RemoveContainer" containerID="8d4355cee99945532607df9713a3bfa7d4e91c4ba41bb0020a8f076b58eaea68"
Jul 17 09:49:34.941544 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:34.941520    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"]
Jul 17 09:49:34.947686 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:34.947666    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-2pk58"]
Jul 17 09:49:35.183832 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:35.183752    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" path="/var/lib/kubelet/pods/9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4/volumes"
Jul 17 09:49:44.646166 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646137    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"]
Jul 17 09:49:44.646538 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646452    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerName="revoke-keys"
Jul 17 09:49:44.646538 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646464    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerName="revoke-keys"
Jul 17 09:49:44.646538 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646476    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerName="revoke-keys"
Jul 17 09:49:44.646538 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646483    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerName="revoke-keys"
Jul 17 09:49:44.646538 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646493    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerName="revoke-keys"
Jul 17 09:49:44.646538 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646502    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerName="revoke-keys"
Jul 17 09:49:44.646538 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646516    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerName="revoke-keys"
Jul 17 09:49:44.646538 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646521    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerName="revoke-keys"
Jul 17 09:49:44.646823 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646565    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerName="revoke-keys"
Jul 17 09:49:44.646823 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646575    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c57ca87-fd76-4718-a133-d49da95e3fc0" containerName="revoke-keys"
Jul 17 09:49:44.646823 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.646583    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerName="revoke-keys"
Jul 17 09:49:44.650198 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.650181    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"
Jul 17 09:49:44.657196 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.656755    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:49:44.657196 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.656909    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:49:44.665432 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.665403    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"]
Jul 17 09:49:44.764677 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.764647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fa8e98c-edb0-419b-98a4-bd6b47323cdc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz\" (UID: \"7fa8e98c-edb0-419b-98a4-bd6b47323cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"
Jul 17 09:49:44.865074 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.865044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fa8e98c-edb0-419b-98a4-bd6b47323cdc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz\" (UID: \"7fa8e98c-edb0-419b-98a4-bd6b47323cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"
Jul 17 09:49:44.865824 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.865802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fa8e98c-edb0-419b-98a4-bd6b47323cdc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz\" (UID: \"7fa8e98c-edb0-419b-98a4-bd6b47323cdc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"
Jul 17 09:49:44.964415 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:44.964347    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"
Jul 17 09:49:45.092535 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:45.092509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"]
Jul 17 09:49:45.094948 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:49:45.094918    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa8e98c_edb0_419b_98a4_bd6b47323cdc.slice/crio-85eec4923f6de8312fb631116e957c177e4f156ba0bcf10550fc6032670f043c WatchSource:0}: Error finding container 85eec4923f6de8312fb631116e957c177e4f156ba0bcf10550fc6032670f043c: Status 404 returned error can't find the container with id 85eec4923f6de8312fb631116e957c177e4f156ba0bcf10550fc6032670f043c
Jul 17 09:49:45.949850 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:45.949817    2560 generic.go:356] "Generic (PLEG): container finished" podID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerID="9b33aa7e0e10741b594f0475082c6c9d74b9917d3edd1a559fb2d5556f22989d" exitCode=6
Jul 17 09:49:45.950224 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:45.949854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz" event={"ID":"7fa8e98c-edb0-419b-98a4-bd6b47323cdc","Type":"ContainerDied","Data":"9b33aa7e0e10741b594f0475082c6c9d74b9917d3edd1a559fb2d5556f22989d"}
Jul 17 09:49:45.950224 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:45.949907    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz" event={"ID":"7fa8e98c-edb0-419b-98a4-bd6b47323cdc","Type":"ContainerStarted","Data":"85eec4923f6de8312fb631116e957c177e4f156ba0bcf10550fc6032670f043c"}
Jul 17 09:49:45.950224 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:45.950116    2560 scope.go:117] "RemoveContainer" containerID="9b33aa7e0e10741b594f0475082c6c9d74b9917d3edd1a559fb2d5556f22989d"
Jul 17 09:49:46.956306 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:46.956221    2560 generic.go:356] "Generic (PLEG): container finished" podID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerID="811fa529611f0a213c641718ab54765b33977b65091ff67039f74277a920f255" exitCode=6
Jul 17 09:49:46.956695 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:46.956305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz" event={"ID":"7fa8e98c-edb0-419b-98a4-bd6b47323cdc","Type":"ContainerDied","Data":"811fa529611f0a213c641718ab54765b33977b65091ff67039f74277a920f255"}
Jul 17 09:49:46.956695 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:46.956396    2560 scope.go:117] "RemoveContainer" containerID="9b33aa7e0e10741b594f0475082c6c9d74b9917d3edd1a559fb2d5556f22989d"
Jul 17 09:49:46.956695 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:46.956581    2560 scope.go:117] "RemoveContainer" containerID="811fa529611f0a213c641718ab54765b33977b65091ff67039f74277a920f255"
Jul 17 09:49:46.956916 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:49:46.956752    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz_odh-ai-gateway-infra(7fa8e98c-edb0-419b-98a4-bd6b47323cdc)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc"
Jul 17 09:49:47.961941 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:49:47.961913    2560 scope.go:117] "RemoveContainer" containerID="811fa529611f0a213c641718ab54765b33977b65091ff67039f74277a920f255"
Jul 17 09:49:47.962331 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:49:47.962105    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz_odh-ai-gateway-infra(7fa8e98c-edb0-419b-98a4-bd6b47323cdc)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc"
Jul 17 09:50:00.178073 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:00.178045    2560 scope.go:117] "RemoveContainer" containerID="811fa529611f0a213c641718ab54765b33977b65091ff67039f74277a920f255"
Jul 17 09:50:01.021132 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:01.021089    2560 generic.go:356] "Generic (PLEG): container finished" podID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerID="d34ca4f80df7612e41c80dbe36ea0f0045b792e8790fdc17ab1cff171da1fe21" exitCode=6
Jul 17 09:50:01.021326 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:01.021163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz" event={"ID":"7fa8e98c-edb0-419b-98a4-bd6b47323cdc","Type":"ContainerDied","Data":"d34ca4f80df7612e41c80dbe36ea0f0045b792e8790fdc17ab1cff171da1fe21"}
Jul 17 09:50:01.021326 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:01.021220    2560 scope.go:117] "RemoveContainer" containerID="811fa529611f0a213c641718ab54765b33977b65091ff67039f74277a920f255"
Jul 17 09:50:01.021523 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:01.021509    2560 scope.go:117] "RemoveContainer" containerID="d34ca4f80df7612e41c80dbe36ea0f0045b792e8790fdc17ab1cff171da1fe21"
Jul 17 09:50:01.021705 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:50:01.021686    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz_odh-ai-gateway-infra(7fa8e98c-edb0-419b-98a4-bd6b47323cdc)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc"
Jul 17 09:50:02.062030 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:02.061995    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"]
Jul 17 09:50:02.187335 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:02.187304    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"
Jul 17 09:50:02.306042 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:02.306013    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fa8e98c-edb0-419b-98a4-bd6b47323cdc-maas-api-service-ca\") pod \"7fa8e98c-edb0-419b-98a4-bd6b47323cdc\" (UID: \"7fa8e98c-edb0-419b-98a4-bd6b47323cdc\") "
Jul 17 09:50:02.306356 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:02.306335    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fa8e98c-edb0-419b-98a4-bd6b47323cdc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7fa8e98c-edb0-419b-98a4-bd6b47323cdc" (UID: "7fa8e98c-edb0-419b-98a4-bd6b47323cdc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:50:02.406706 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:02.406682    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fa8e98c-edb0-419b-98a4-bd6b47323cdc-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:50:03.032166 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:03.032138    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"
Jul 17 09:50:03.032166 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:03.032153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz" event={"ID":"7fa8e98c-edb0-419b-98a4-bd6b47323cdc","Type":"ContainerDied","Data":"85eec4923f6de8312fb631116e957c177e4f156ba0bcf10550fc6032670f043c"}
Jul 17 09:50:03.032510 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:03.032207    2560 scope.go:117] "RemoveContainer" containerID="d34ca4f80df7612e41c80dbe36ea0f0045b792e8790fdc17ab1cff171da1fe21"
Jul 17 09:50:03.052696 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:03.052674    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"]
Jul 17 09:50:03.057017 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:03.056998    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-ncnzz"]
Jul 17 09:50:03.188466 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:03.188416    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" path="/var/lib/kubelet/pods/7fa8e98c-edb0-419b-98a4-bd6b47323cdc/volumes"
Jul 17 09:50:14.322758 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.322728    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"]
Jul 17 09:50:14.323134 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.323034    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerName="revoke-keys"
Jul 17 09:50:14.323134 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.323045    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerName="revoke-keys"
Jul 17 09:50:14.323134 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.323056    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerName="revoke-keys"
Jul 17 09:50:14.323134 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.323061    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerName="revoke-keys"
Jul 17 09:50:14.323134 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.323070    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerName="revoke-keys"
Jul 17 09:50:14.323134 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.323075    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerName="revoke-keys"
Jul 17 09:50:14.323134 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.323123    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerName="revoke-keys"
Jul 17 09:50:14.323134 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.323131    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerName="revoke-keys"
Jul 17 09:50:14.323134 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.323137    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8cd3c3-075b-46b5-bfcb-3025f4e4d7d4" containerName="revoke-keys"
Jul 17 09:50:14.326169 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.326140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"
Jul 17 09:50:14.328723 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.328696    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:50:14.328886 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.328766    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:50:14.334536 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.334513    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"]
Jul 17 09:50:14.376758 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.376725    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:14.404014 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.403987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b64ef131-28cc-4d85-a8e7-3d2f43add5bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz\" (UID: \"b64ef131-28cc-4d85-a8e7-3d2f43add5bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"
Jul 17 09:50:14.476195 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.476168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:14.504454 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.504426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b64ef131-28cc-4d85-a8e7-3d2f43add5bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz\" (UID: \"b64ef131-28cc-4d85-a8e7-3d2f43add5bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"
Jul 17 09:50:14.505068 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.505044    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b64ef131-28cc-4d85-a8e7-3d2f43add5bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz\" (UID: \"b64ef131-28cc-4d85-a8e7-3d2f43add5bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"
Jul 17 09:50:14.637028 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.637010    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"
Jul 17 09:50:14.764279 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:14.764256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"]
Jul 17 09:50:14.766409 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:50:14.766381    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64ef131_28cc_4d85_a8e7_3d2f43add5bf.slice/crio-c07ee720de7d73908fa591e88c1523f3fb7480ebff61f84ceb8b21a9151b3f35 WatchSource:0}: Error finding container c07ee720de7d73908fa591e88c1523f3fb7480ebff61f84ceb8b21a9151b3f35: Status 404 returned error can't find the container with id c07ee720de7d73908fa591e88c1523f3fb7480ebff61f84ceb8b21a9151b3f35
Jul 17 09:50:15.088680 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:15.088644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz" event={"ID":"b64ef131-28cc-4d85-a8e7-3d2f43add5bf","Type":"ContainerStarted","Data":"c07ee720de7d73908fa591e88c1523f3fb7480ebff61f84ceb8b21a9151b3f35"}
Jul 17 09:50:16.095007 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:16.094967    2560 generic.go:356] "Generic (PLEG): container finished" podID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerID="134ec714aa30f9503a8cffa3f46cf7c0297647d0bb4c3513318dc11b670b2f64" exitCode=7
Jul 17 09:50:16.095471 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:16.095055    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz" event={"ID":"b64ef131-28cc-4d85-a8e7-3d2f43add5bf","Type":"ContainerDied","Data":"134ec714aa30f9503a8cffa3f46cf7c0297647d0bb4c3513318dc11b670b2f64"}
Jul 17 09:50:16.095471 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:16.095182    2560 scope.go:117] "RemoveContainer" containerID="134ec714aa30f9503a8cffa3f46cf7c0297647d0bb4c3513318dc11b670b2f64"
Jul 17 09:50:16.843797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:16.843748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:50:17.100934 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:17.100849    2560 generic.go:356] "Generic (PLEG): container finished" podID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerID="f7b3e8dd9a3ace2b6e52f6f57ec7322d9059aeb0dc60aaa9568e27ce288abae7" exitCode=7
Jul 17 09:50:17.101333 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:17.100933    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz" event={"ID":"b64ef131-28cc-4d85-a8e7-3d2f43add5bf","Type":"ContainerDied","Data":"f7b3e8dd9a3ace2b6e52f6f57ec7322d9059aeb0dc60aaa9568e27ce288abae7"}
Jul 17 09:50:17.101333 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:17.100988    2560 scope.go:117] "RemoveContainer" containerID="134ec714aa30f9503a8cffa3f46cf7c0297647d0bb4c3513318dc11b670b2f64"
Jul 17 09:50:17.101333 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:17.101164    2560 scope.go:117] "RemoveContainer" containerID="f7b3e8dd9a3ace2b6e52f6f57ec7322d9059aeb0dc60aaa9568e27ce288abae7"
Jul 17 09:50:17.101449 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:50:17.101385    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz_odh-ai-gateway-infra(b64ef131-28cc-4d85-a8e7-3d2f43add5bf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf"
Jul 17 09:50:18.107044 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:18.107015    2560 scope.go:117] "RemoveContainer" containerID="f7b3e8dd9a3ace2b6e52f6f57ec7322d9059aeb0dc60aaa9568e27ce288abae7"
Jul 17 09:50:18.107481 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:50:18.107265    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz_odh-ai-gateway-infra(b64ef131-28cc-4d85-a8e7-3d2f43add5bf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf"
Jul 17 09:50:20.078022 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:20.077947    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:21.506027 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:21.505990    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:26.925759 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:26.925726    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:27.027370 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.027337    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:27.121300 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.121275    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"]
Jul 17 09:50:27.121650 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.121636    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fa8e98c-edb0-419b-98a4-bd6b47323cdc" containerName="revoke-keys"
Jul 17 09:50:27.124735 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.124714    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.127618 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.127597    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-58adf1ce-openshift-default-dockercfg-np8jr\""
Jul 17 09:50:27.139144 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.139121    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"]
Jul 17 09:50:27.154707 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.154680    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:27.217508 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.217443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/118fa08b-1ebc-491a-a270-b2f79855d907-istiod-ca-cert\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.217508 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.217484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-data\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.217508 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.217510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-certs\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.217700 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.217541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/118fa08b-1ebc-491a-a270-b2f79855d907-istio-podinfo\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.217700 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.217573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-envoy\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.217700 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.217591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-credential-socket\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.217700 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.217616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29b4m\" (UniqueName: \"kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-kube-api-access-29b4m\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.217700 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.217640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-socket\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.217700 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.217663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-istio-token\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.237721 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.237701    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:27.318949 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.318923    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-data\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319088 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.318960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-certs\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319088 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.318993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/118fa08b-1ebc-491a-a270-b2f79855d907-istio-podinfo\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319088 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.319031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-envoy\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319088 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.319047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-credential-socket\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319265 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.319176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29b4m\" (UniqueName: \"kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-kube-api-access-29b4m\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319265 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.319241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-socket\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319372 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.319287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-istio-token\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319372 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.319344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/118fa08b-1ebc-491a-a270-b2f79855d907-istiod-ca-cert\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319477 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.319371    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-data\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319536 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.319507    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-credential-socket\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319663 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.319634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-socket\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.319772 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.319753    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-certs\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.320112 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.320090    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/118fa08b-1ebc-491a-a270-b2f79855d907-istiod-ca-cert\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.321346 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.321327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-envoy\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.321437 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.321421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/118fa08b-1ebc-491a-a270-b2f79855d907-istio-podinfo\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.330135 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.330113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29b4m\" (UniqueName: \"kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-kube-api-access-29b4m\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.330220 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.330147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-istio-token\") pod \"e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") " pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.435203 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.435178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:27.571260 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.571238    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"]
Jul 17 09:50:27.573994 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:50:27.573965    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118fa08b_1ebc_491a_a270_b2f79855d907.slice/crio-a3528e6eb4e2b5f5617f136a89891343bfb6e379b2c0203bf7c27ba19088df2f WatchSource:0}: Error finding container a3528e6eb4e2b5f5617f136a89891343bfb6e379b2c0203bf7c27ba19088df2f: Status 404 returned error can't find the container with id a3528e6eb4e2b5f5617f136a89891343bfb6e379b2c0203bf7c27ba19088df2f
Jul 17 09:50:27.576103 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.576069    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:50:27.576213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.576149    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:50:27.576213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:27.576192    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:50:28.149297 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:28.149261    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" event={"ID":"118fa08b-1ebc-491a-a270-b2f79855d907","Type":"ContainerStarted","Data":"fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65"}
Jul 17 09:50:28.149658 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:28.149322    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" event={"ID":"118fa08b-1ebc-491a-a270-b2f79855d907","Type":"ContainerStarted","Data":"a3528e6eb4e2b5f5617f136a89891343bfb6e379b2c0203bf7c27ba19088df2f"}
Jul 17 09:50:28.191831 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:28.191756    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" podStartSLOduration=1.191735099 podStartE2EDuration="1.191735099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:50:28.189364148 +0000 UTC m=+1947.681058566" watchObservedRunningTime="2026-07-17 09:50:28.191735099 +0000 UTC m=+1947.683429505"
Jul 17 09:50:28.391761 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:28.391707    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:28.435386 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:28.435320    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:28.439929 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:28.439907    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:28.566005 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:28.565978    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:28.674483 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:28.674450    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:28.790232 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:28.790134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:29.153970 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:29.153944    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:29.154865 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:29.154846    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:29.495407 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:29.495325    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:29.602888 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:29.602855    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:30.671491 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:30.671462    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:50:30.961998 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:30.961967    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:50:31.179883 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:31.179860    2560 scope.go:117] "RemoveContainer" containerID="f7b3e8dd9a3ace2b6e52f6f57ec7322d9059aeb0dc60aaa9568e27ce288abae7"
Jul 17 09:50:32.167277 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:32.167236    2560 generic.go:356] "Generic (PLEG): container finished" podID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerID="b319902cb5cfc3d6d4d52c3540aeb43e9aed476ef79aeed76b59f49fdf84e65a" exitCode=6
Jul 17 09:50:32.167277 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:32.167275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz" event={"ID":"b64ef131-28cc-4d85-a8e7-3d2f43add5bf","Type":"ContainerDied","Data":"b319902cb5cfc3d6d4d52c3540aeb43e9aed476ef79aeed76b59f49fdf84e65a"}
Jul 17 09:50:32.167712 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:32.167327    2560 scope.go:117] "RemoveContainer" containerID="f7b3e8dd9a3ace2b6e52f6f57ec7322d9059aeb0dc60aaa9568e27ce288abae7"
Jul 17 09:50:32.167712 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:32.167692    2560 scope.go:117] "RemoveContainer" containerID="b319902cb5cfc3d6d4d52c3540aeb43e9aed476ef79aeed76b59f49fdf84e65a"
Jul 17 09:50:32.167936 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:50:32.167915    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz_odh-ai-gateway-infra(b64ef131-28cc-4d85-a8e7-3d2f43add5bf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf"
Jul 17 09:50:33.199969 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:33.199936    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"]
Jul 17 09:50:33.373530 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:33.373505    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"
Jul 17 09:50:33.474252 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:33.474166    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b64ef131-28cc-4d85-a8e7-3d2f43add5bf-maas-api-service-ca\") pod \"b64ef131-28cc-4d85-a8e7-3d2f43add5bf\" (UID: \"b64ef131-28cc-4d85-a8e7-3d2f43add5bf\") "
Jul 17 09:50:33.474498 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:33.474476    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b64ef131-28cc-4d85-a8e7-3d2f43add5bf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b64ef131-28cc-4d85-a8e7-3d2f43add5bf" (UID: "b64ef131-28cc-4d85-a8e7-3d2f43add5bf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:50:33.575101 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:33.575068    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b64ef131-28cc-4d85-a8e7-3d2f43add5bf-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:50:34.177933 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:34.177902    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"
Jul 17 09:50:34.178110 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:34.177928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz" event={"ID":"b64ef131-28cc-4d85-a8e7-3d2f43add5bf","Type":"ContainerDied","Data":"c07ee720de7d73908fa591e88c1523f3fb7480ebff61f84ceb8b21a9151b3f35"}
Jul 17 09:50:34.178110 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:34.177975    2560 scope.go:117] "RemoveContainer" containerID="b319902cb5cfc3d6d4d52c3540aeb43e9aed476ef79aeed76b59f49fdf84e65a"
Jul 17 09:50:34.204733 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:34.204690    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"]
Jul 17 09:50:34.212271 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:34.212249    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-67tlz"]
Jul 17 09:50:35.185925 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:35.185888    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" path="/var/lib/kubelet/pods/b64ef131-28cc-4d85-a8e7-3d2f43add5bf/volumes"
Jul 17 09:50:38.199813 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:38.199770    2560 generic.go:356] "Generic (PLEG): container finished" podID="118fa08b-1ebc-491a-a270-b2f79855d907" containerID="fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65" exitCode=0
Jul 17 09:50:38.200163 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:38.199808    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" event={"ID":"118fa08b-1ebc-491a-a270-b2f79855d907","Type":"ContainerDied","Data":"fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65"}
Jul 17 09:50:38.200211 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:38.200186    2560 scope.go:117] "RemoveContainer" containerID="fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65"
Jul 17 09:50:38.201254 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:38.201223    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:50:38.201332 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:38.201295    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:50:38.201375 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:38.201330    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 09:50:39.209601 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:39.209561    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" event={"ID":"118fa08b-1ebc-491a-a270-b2f79855d907","Type":"ContainerStarted","Data":"710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9"}
Jul 17 09:50:39.436305 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:39.436262    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:39.437374 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:39.437332    2560 patch_prober.go:28] interesting pod/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 17 09:50:39.437513 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:39.437390    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 17 09:50:40.436069 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:40.436030    2560 patch_prober.go:28] interesting pod/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 17 09:50:40.436453 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:40.436091    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 17 09:50:41.436322 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:41.436285    2560 patch_prober.go:28] interesting pod/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 17 09:50:41.436711 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:41.436355    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 17 09:50:42.435893 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:42.435859    2560 patch_prober.go:28] interesting pod/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 17 09:50:42.436088 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:42.435919    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 17 09:50:43.439467 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:43.439429    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:43.439903 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:43.439796    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:50:43.440388 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:50:43.440374    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:51:22.688079 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:51:22.688040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:51:22.763884 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:51:22.763816    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:51:27.516543 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:51:27.516511    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:53:51.187785 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:53:51.187739    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:53:51.277822 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:53:51.277792    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:53:56.807342 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:53:56.807262    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:53:56.908845 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:53:56.908763    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:55:40.895879 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:55:40.895843    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:33.614154 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:33.614115    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"]
Jul 17 09:56:33.615216 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:33.615149    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" containerName="istio-proxy" containerID="cri-o://710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9" gracePeriod=30
Jul 17 09:56:33.645182 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:33.645136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:33.745881 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:33.745740    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:36.449178 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:36.449133    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:56:38.866405 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:38.866380    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:56:39.064207 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064174    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/118fa08b-1ebc-491a-a270-b2f79855d907-istiod-ca-cert\") pod \"118fa08b-1ebc-491a-a270-b2f79855d907\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") "
Jul 17 09:56:39.064404 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064229    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-credential-socket\") pod \"118fa08b-1ebc-491a-a270-b2f79855d907\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") "
Jul 17 09:56:39.064404 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064254    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-istio-token\") pod \"118fa08b-1ebc-491a-a270-b2f79855d907\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") "
Jul 17 09:56:39.064404 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064298    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/118fa08b-1ebc-491a-a270-b2f79855d907-istio-podinfo\") pod \"118fa08b-1ebc-491a-a270-b2f79855d907\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") "
Jul 17 09:56:39.064404 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064323    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-socket\") pod \"118fa08b-1ebc-491a-a270-b2f79855d907\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") "
Jul 17 09:56:39.064610 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064432    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-certs\") pod \"118fa08b-1ebc-491a-a270-b2f79855d907\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") "
Jul 17 09:56:39.064610 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064479    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29b4m\" (UniqueName: \"kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-kube-api-access-29b4m\") pod \"118fa08b-1ebc-491a-a270-b2f79855d907\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") "
Jul 17 09:56:39.064610 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064558    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "118fa08b-1ebc-491a-a270-b2f79855d907" (UID: "118fa08b-1ebc-491a-a270-b2f79855d907"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 09:56:39.064610 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064550    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-envoy\") pod \"118fa08b-1ebc-491a-a270-b2f79855d907\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") "
Jul 17 09:56:39.064831 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064617    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "118fa08b-1ebc-491a-a270-b2f79855d907" (UID: "118fa08b-1ebc-491a-a270-b2f79855d907"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 09:56:39.064831 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064637    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/118fa08b-1ebc-491a-a270-b2f79855d907-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "118fa08b-1ebc-491a-a270-b2f79855d907" (UID: "118fa08b-1ebc-491a-a270-b2f79855d907"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:56:39.064831 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064703    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-data\") pod \"118fa08b-1ebc-491a-a270-b2f79855d907\" (UID: \"118fa08b-1ebc-491a-a270-b2f79855d907\") "
Jul 17 09:56:39.064831 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064724    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "118fa08b-1ebc-491a-a270-b2f79855d907" (UID: "118fa08b-1ebc-491a-a270-b2f79855d907"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 09:56:39.065049 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.064982    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:56:39.065049 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.065006    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-workload-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:56:39.065049 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.065022    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/118fa08b-1ebc-491a-a270-b2f79855d907-istiod-ca-cert\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:56:39.065049 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.065034    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-credential-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:56:39.065593 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.065565    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-data" (OuterVolumeSpecName: "istio-data") pod "118fa08b-1ebc-491a-a270-b2f79855d907" (UID: "118fa08b-1ebc-491a-a270-b2f79855d907"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 09:56:39.066512 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.066476    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-istio-token" (OuterVolumeSpecName: "istio-token") pod "118fa08b-1ebc-491a-a270-b2f79855d907" (UID: "118fa08b-1ebc-491a-a270-b2f79855d907"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:56:39.066606 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.066550    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/118fa08b-1ebc-491a-a270-b2f79855d907-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "118fa08b-1ebc-491a-a270-b2f79855d907" (UID: "118fa08b-1ebc-491a-a270-b2f79855d907"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 09:56:39.066606 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.066562    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "118fa08b-1ebc-491a-a270-b2f79855d907" (UID: "118fa08b-1ebc-491a-a270-b2f79855d907"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 09:56:39.066689 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.066640    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-kube-api-access-29b4m" (OuterVolumeSpecName: "kube-api-access-29b4m") pod "118fa08b-1ebc-491a-a270-b2f79855d907" (UID: "118fa08b-1ebc-491a-a270-b2f79855d907"). InnerVolumeSpecName "kube-api-access-29b4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 09:56:39.166207 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.166172    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-istio-token\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:56:39.166207 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.166201    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/118fa08b-1ebc-491a-a270-b2f79855d907-istio-podinfo\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:56:39.166207 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.166210    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29b4m\" (UniqueName: \"kubernetes.io/projected/118fa08b-1ebc-491a-a270-b2f79855d907-kube-api-access-29b4m\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:56:39.166447 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.166221    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-envoy\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:56:39.166447 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.166230    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/118fa08b-1ebc-491a-a270-b2f79855d907-istio-data\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:56:39.732107 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.732069    2560 generic.go:356] "Generic (PLEG): container finished" podID="118fa08b-1ebc-491a-a270-b2f79855d907" containerID="710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9" exitCode=0
Jul 17 09:56:39.732300 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.732140    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"
Jul 17 09:56:39.732300 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.732144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" event={"ID":"118fa08b-1ebc-491a-a270-b2f79855d907","Type":"ContainerDied","Data":"710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9"}
Jul 17 09:56:39.732300 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.732201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f" event={"ID":"118fa08b-1ebc-491a-a270-b2f79855d907","Type":"ContainerDied","Data":"a3528e6eb4e2b5f5617f136a89891343bfb6e379b2c0203bf7c27ba19088df2f"}
Jul 17 09:56:39.732300 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.732223    2560 scope.go:117] "RemoveContainer" containerID="710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9"
Jul 17 09:56:39.740433 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.740224    2560 scope.go:117] "RemoveContainer" containerID="fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65"
Jul 17 09:56:39.747149 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.747133    2560 scope.go:117] "RemoveContainer" containerID="710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9"
Jul 17 09:56:39.747395 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:56:39.747378    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9\": container with ID starting with 710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9 not found: ID does not exist" containerID="710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9"
Jul 17 09:56:39.747453 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.747403    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9"} err="failed to get container status \"710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9\": rpc error: code = NotFound desc = could not find container \"710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9\": container with ID starting with 710cb5d0c1c07ba518689c81f2462e2faa528b3aac904fb6944b48a318fef1e9 not found: ID does not exist"
Jul 17 09:56:39.747453 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.747428    2560 scope.go:117] "RemoveContainer" containerID="fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65"
Jul 17 09:56:39.747650 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:56:39.747633    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65\": container with ID starting with fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65 not found: ID does not exist" containerID="fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65"
Jul 17 09:56:39.747690 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.747664    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65"} err="failed to get container status \"fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65\": rpc error: code = NotFound desc = could not find container \"fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65\": container with ID starting with fe28811db554b9cef4fae0e025a2c01f1e688a14436190105b648d05e2b55f65 not found: ID does not exist"
Jul 17 09:56:39.750331 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.750312    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"]
Jul 17 09:56:39.755042 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.755021    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-58adf1ce-openshift-default-7c9695bdd5-bkd8f"]
Jul 17 09:56:39.821703 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:39.821670    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:40.282147 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:40.282112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:41.182916 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:41.182885    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" path="/var/lib/kubelet/pods/118fa08b-1ebc-491a-a270-b2f79855d907/volumes"
Jul 17 09:56:46.731080 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:46.731043    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:46.813290 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:46.813260    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:47.084122 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:47.084089    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:48.257567 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:48.257536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:48.351141 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:48.351105    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:48.444448 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:48.444403    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:48.675179 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:48.675143    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:49.195104 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:49.195071    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:49.306122 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:49.306082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:50.218010 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:50.217965    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:50.297144 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:50.297107    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:50.874797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:50.874745    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:56:52.629816 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.629767    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"]
Jul 17 09:56:52.630200 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.630064    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" containerName="istio-proxy"
Jul 17 09:56:52.630200 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.630075    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" containerName="istio-proxy"
Jul 17 09:56:52.630200 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.630091    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerName="revoke-keys"
Jul 17 09:56:52.630200 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.630096    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerName="revoke-keys"
Jul 17 09:56:52.630200 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.630105    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" containerName="istio-proxy"
Jul 17 09:56:52.630200 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.630112    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" containerName="istio-proxy"
Jul 17 09:56:52.630200 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.630119    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerName="revoke-keys"
Jul 17 09:56:52.630200 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.630124    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerName="revoke-keys"
Jul 17 09:56:52.630200 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.630173    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerName="revoke-keys"
Jul 17 09:56:52.630200 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.630181    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerName="revoke-keys"
Jul 17 09:56:52.630200 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.630187    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" containerName="istio-proxy"
Jul 17 09:56:52.634797 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.634759    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"
Jul 17 09:56:52.637822 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.637798    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:56:52.637949 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.637835    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:56:52.644880 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.644793    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"]
Jul 17 09:56:52.678864 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.678837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/682fc683-1746-4f43-9b4c-989c6103e816-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k\" (UID: \"682fc683-1746-4f43-9b4c-989c6103e816\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"
Jul 17 09:56:52.779746 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.779710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/682fc683-1746-4f43-9b4c-989c6103e816-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k\" (UID: \"682fc683-1746-4f43-9b4c-989c6103e816\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"
Jul 17 09:56:52.780401 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.780382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/682fc683-1746-4f43-9b4c-989c6103e816-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k\" (UID: \"682fc683-1746-4f43-9b4c-989c6103e816\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"
Jul 17 09:56:52.950177 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:52.950133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"
Jul 17 09:56:53.070963 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:53.070937    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"]
Jul 17 09:56:53.072860 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:56:53.072834    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682fc683_1746_4f43_9b4c_989c6103e816.slice/crio-8b0b9148e0887f7ccd563ab983c5cf51c435350a422e838eda98670766a2fd68 WatchSource:0}: Error finding container 8b0b9148e0887f7ccd563ab983c5cf51c435350a422e838eda98670766a2fd68: Status 404 returned error can't find the container with id 8b0b9148e0887f7ccd563ab983c5cf51c435350a422e838eda98670766a2fd68
Jul 17 09:56:53.751718 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:53.751687    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:56:53.794791 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:53.794748    2560 generic.go:356] "Generic (PLEG): container finished" podID="682fc683-1746-4f43-9b4c-989c6103e816" containerID="7aced3d054bee1ec184f0c77097d1711c58c5520eab6fdd6c482671598bd0778" exitCode=7
Jul 17 09:56:53.794935 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:53.794805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k" event={"ID":"682fc683-1746-4f43-9b4c-989c6103e816","Type":"ContainerDied","Data":"7aced3d054bee1ec184f0c77097d1711c58c5520eab6fdd6c482671598bd0778"}
Jul 17 09:56:53.794935 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:53.794853    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k" event={"ID":"682fc683-1746-4f43-9b4c-989c6103e816","Type":"ContainerStarted","Data":"8b0b9148e0887f7ccd563ab983c5cf51c435350a422e838eda98670766a2fd68"}
Jul 17 09:56:53.795062 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:53.795048    2560 scope.go:117] "RemoveContainer" containerID="7aced3d054bee1ec184f0c77097d1711c58c5520eab6fdd6c482671598bd0778"
Jul 17 09:56:54.801215 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:54.801180    2560 generic.go:356] "Generic (PLEG): container finished" podID="682fc683-1746-4f43-9b4c-989c6103e816" containerID="b62d6d77d13dc17589f0fde732273332ebb40d327b4b0181f04099bafa4653f0" exitCode=7
Jul 17 09:56:54.801625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:54.801303    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k" event={"ID":"682fc683-1746-4f43-9b4c-989c6103e816","Type":"ContainerDied","Data":"b62d6d77d13dc17589f0fde732273332ebb40d327b4b0181f04099bafa4653f0"}
Jul 17 09:56:54.801625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:54.801366    2560 scope.go:117] "RemoveContainer" containerID="7aced3d054bee1ec184f0c77097d1711c58c5520eab6fdd6c482671598bd0778"
Jul 17 09:56:54.801625 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:54.801444    2560 scope.go:117] "RemoveContainer" containerID="b62d6d77d13dc17589f0fde732273332ebb40d327b4b0181f04099bafa4653f0"
Jul 17 09:56:54.801767 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:56:54.801656    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k_odh-ai-gateway-infra(682fc683-1746-4f43-9b4c-989c6103e816)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k" podUID="682fc683-1746-4f43-9b4c-989c6103e816"
Jul 17 09:56:55.807606 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:56:55.807580    2560 scope.go:117] "RemoveContainer" containerID="b62d6d77d13dc17589f0fde732273332ebb40d327b4b0181f04099bafa4653f0"
Jul 17 09:56:55.808019 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:56:55.807748    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k_odh-ai-gateway-infra(682fc683-1746-4f43-9b4c-989c6103e816)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k" podUID="682fc683-1746-4f43-9b4c-989c6103e816"
Jul 17 09:57:07.178438 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:07.178408    2560 scope.go:117] "RemoveContainer" containerID="b62d6d77d13dc17589f0fde732273332ebb40d327b4b0181f04099bafa4653f0"
Jul 17 09:57:07.862608 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:07.862577    2560 generic.go:356] "Generic (PLEG): container finished" podID="682fc683-1746-4f43-9b4c-989c6103e816" containerID="5bcc479b545ef26357ce0c6b646c417025cdc758457081f59a1018aab1ffc532" exitCode=7
Jul 17 09:57:07.862741 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:07.862644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k" event={"ID":"682fc683-1746-4f43-9b4c-989c6103e816","Type":"ContainerDied","Data":"5bcc479b545ef26357ce0c6b646c417025cdc758457081f59a1018aab1ffc532"}
Jul 17 09:57:07.862741 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:07.862699    2560 scope.go:117] "RemoveContainer" containerID="b62d6d77d13dc17589f0fde732273332ebb40d327b4b0181f04099bafa4653f0"
Jul 17 09:57:07.862961 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:07.862947    2560 scope.go:117] "RemoveContainer" containerID="5bcc479b545ef26357ce0c6b646c417025cdc758457081f59a1018aab1ffc532"
Jul 17 09:57:07.863148 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:57:07.863130    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k_odh-ai-gateway-infra(682fc683-1746-4f43-9b4c-989c6103e816)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k" podUID="682fc683-1746-4f43-9b4c-989c6103e816"
Jul 17 09:57:08.901978 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:08.901946    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"]
Jul 17 09:57:09.031488 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:09.031462    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"
Jul 17 09:57:09.124575 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:09.124543    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/682fc683-1746-4f43-9b4c-989c6103e816-maas-api-service-ca\") pod \"682fc683-1746-4f43-9b4c-989c6103e816\" (UID: \"682fc683-1746-4f43-9b4c-989c6103e816\") "
Jul 17 09:57:09.124946 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:09.124919    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/682fc683-1746-4f43-9b4c-989c6103e816-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "682fc683-1746-4f43-9b4c-989c6103e816" (UID: "682fc683-1746-4f43-9b4c-989c6103e816"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:57:09.225158 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:09.225125    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/682fc683-1746-4f43-9b4c-989c6103e816-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:57:09.873294 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:09.873267    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"
Jul 17 09:57:09.873294 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:09.873282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k" event={"ID":"682fc683-1746-4f43-9b4c-989c6103e816","Type":"ContainerDied","Data":"8b0b9148e0887f7ccd563ab983c5cf51c435350a422e838eda98670766a2fd68"}
Jul 17 09:57:09.873521 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:09.873344    2560 scope.go:117] "RemoveContainer" containerID="5bcc479b545ef26357ce0c6b646c417025cdc758457081f59a1018aab1ffc532"
Jul 17 09:57:09.894471 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:09.894440    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"]
Jul 17 09:57:09.898856 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:09.898832    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-lkv7k"]
Jul 17 09:57:11.183841 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:11.183809    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="682fc683-1746-4f43-9b4c-989c6103e816" path="/var/lib/kubelet/pods/682fc683-1746-4f43-9b4c-989c6103e816/volumes"
Jul 17 09:57:42.678074 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678035    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"]
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678467    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerName="revoke-keys"
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678485    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerName="revoke-keys"
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678499    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="682fc683-1746-4f43-9b4c-989c6103e816" containerName="revoke-keys"
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678508    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="682fc683-1746-4f43-9b4c-989c6103e816" containerName="revoke-keys"
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678522    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="682fc683-1746-4f43-9b4c-989c6103e816" containerName="revoke-keys"
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678531    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="682fc683-1746-4f43-9b4c-989c6103e816" containerName="revoke-keys"
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678546    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="682fc683-1746-4f43-9b4c-989c6103e816" containerName="revoke-keys"
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678554    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="682fc683-1746-4f43-9b4c-989c6103e816" containerName="revoke-keys"
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678640    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="682fc683-1746-4f43-9b4c-989c6103e816" containerName="revoke-keys"
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678655    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="682fc683-1746-4f43-9b4c-989c6103e816" containerName="revoke-keys"
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678666    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b64ef131-28cc-4d85-a8e7-3d2f43add5bf" containerName="revoke-keys"
Jul 17 09:57:42.678683 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.678674    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="118fa08b-1ebc-491a-a270-b2f79855d907" containerName="istio-proxy"
Jul 17 09:57:42.681555 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.681535    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"
Jul 17 09:57:42.684228 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.684207    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:57:42.684347 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.684252    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:57:42.692680 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.692657    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"]
Jul 17 09:57:42.814713 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.814677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9411b683-fb02-4d7e-a98f-cd9d94f4989c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd\" (UID: \"9411b683-fb02-4d7e-a98f-cd9d94f4989c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"
Jul 17 09:57:42.915559 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.915521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9411b683-fb02-4d7e-a98f-cd9d94f4989c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd\" (UID: \"9411b683-fb02-4d7e-a98f-cd9d94f4989c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"
Jul 17 09:57:42.916166 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.916146    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9411b683-fb02-4d7e-a98f-cd9d94f4989c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd\" (UID: \"9411b683-fb02-4d7e-a98f-cd9d94f4989c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"
Jul 17 09:57:42.991370 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:42.991292    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"
Jul 17 09:57:43.326506 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:43.326481    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"]
Jul 17 09:57:43.328956 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:57:43.328924    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9411b683_fb02_4d7e_a98f_cd9d94f4989c.slice/crio-a39e28f46613d5cb7a74d5c4ece8881c1667a3eb863cc8472af809930c16b546 WatchSource:0}: Error finding container a39e28f46613d5cb7a74d5c4ece8881c1667a3eb863cc8472af809930c16b546: Status 404 returned error can't find the container with id a39e28f46613d5cb7a74d5c4ece8881c1667a3eb863cc8472af809930c16b546
Jul 17 09:57:44.020633 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:44.020600    2560 generic.go:356] "Generic (PLEG): container finished" podID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerID="c389b1b0f3c0678dfeaba10cbf407540ba9b63f51f9219446896b4885ddf83d0" exitCode=7
Jul 17 09:57:44.021138 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:44.020648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd" event={"ID":"9411b683-fb02-4d7e-a98f-cd9d94f4989c","Type":"ContainerDied","Data":"c389b1b0f3c0678dfeaba10cbf407540ba9b63f51f9219446896b4885ddf83d0"}
Jul 17 09:57:44.021138 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:44.020702    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd" event={"ID":"9411b683-fb02-4d7e-a98f-cd9d94f4989c","Type":"ContainerStarted","Data":"a39e28f46613d5cb7a74d5c4ece8881c1667a3eb863cc8472af809930c16b546"}
Jul 17 09:57:44.021138 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:44.020953    2560 scope.go:117] "RemoveContainer" containerID="c389b1b0f3c0678dfeaba10cbf407540ba9b63f51f9219446896b4885ddf83d0"
Jul 17 09:57:44.792157 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:44.792120    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"]
Jul 17 09:57:44.792484 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:44.792472    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="682fc683-1746-4f43-9b4c-989c6103e816" containerName="revoke-keys"
Jul 17 09:57:44.795286 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:44.795271    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"
Jul 17 09:57:44.804100 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:44.804057    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"]
Jul 17 09:57:44.933510 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:44.933475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b36ea6-787a-4a34-b237-d6d1829452bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w\" (UID: \"15b36ea6-787a-4a34-b237-d6d1829452bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"
Jul 17 09:57:45.026267 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:45.026233    2560 generic.go:356] "Generic (PLEG): container finished" podID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerID="2cf5d917b5b8c5e55b6fcee8b83e03bfde273ad2652134bb2fd117c7ea41515b" exitCode=7
Jul 17 09:57:45.026696 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:45.026319    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd" event={"ID":"9411b683-fb02-4d7e-a98f-cd9d94f4989c","Type":"ContainerDied","Data":"2cf5d917b5b8c5e55b6fcee8b83e03bfde273ad2652134bb2fd117c7ea41515b"}
Jul 17 09:57:45.026696 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:45.026382    2560 scope.go:117] "RemoveContainer" containerID="c389b1b0f3c0678dfeaba10cbf407540ba9b63f51f9219446896b4885ddf83d0"
Jul 17 09:57:45.026696 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:45.026622    2560 scope.go:117] "RemoveContainer" containerID="2cf5d917b5b8c5e55b6fcee8b83e03bfde273ad2652134bb2fd117c7ea41515b"
Jul 17 09:57:45.026907 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:57:45.026887    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd_odh-ai-gateway-infra(9411b683-fb02-4d7e-a98f-cd9d94f4989c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c"
Jul 17 09:57:45.034354 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:45.034331    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b36ea6-787a-4a34-b237-d6d1829452bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w\" (UID: \"15b36ea6-787a-4a34-b237-d6d1829452bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"
Jul 17 09:57:45.034935 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:45.034917    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b36ea6-787a-4a34-b237-d6d1829452bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w\" (UID: \"15b36ea6-787a-4a34-b237-d6d1829452bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"
Jul 17 09:57:45.106975 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:45.106946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"
Jul 17 09:57:45.245976 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:45.245875    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"]
Jul 17 09:57:45.248650 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:57:45.248602    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b36ea6_787a_4a34_b237_d6d1829452bf.slice/crio-87801b7d51103d3ed404ecf02e9d0ff5e4ea6085cf43ad9355abe514620af887 WatchSource:0}: Error finding container 87801b7d51103d3ed404ecf02e9d0ff5e4ea6085cf43ad9355abe514620af887: Status 404 returned error can't find the container with id 87801b7d51103d3ed404ecf02e9d0ff5e4ea6085cf43ad9355abe514620af887
Jul 17 09:57:46.032464 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:46.032433    2560 scope.go:117] "RemoveContainer" containerID="2cf5d917b5b8c5e55b6fcee8b83e03bfde273ad2652134bb2fd117c7ea41515b"
Jul 17 09:57:46.032951 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:57:46.032655    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd_odh-ai-gateway-infra(9411b683-fb02-4d7e-a98f-cd9d94f4989c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c"
Jul 17 09:57:46.034051 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:46.034019    2560 generic.go:356] "Generic (PLEG): container finished" podID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerID="450019c91f7272cf2493c38648cd77ac69c26430eb41aedcb7d0d00495b0525d" exitCode=6
Jul 17 09:57:46.034197 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:46.034059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w" event={"ID":"15b36ea6-787a-4a34-b237-d6d1829452bf","Type":"ContainerDied","Data":"450019c91f7272cf2493c38648cd77ac69c26430eb41aedcb7d0d00495b0525d"}
Jul 17 09:57:46.034197 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:46.034125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w" event={"ID":"15b36ea6-787a-4a34-b237-d6d1829452bf","Type":"ContainerStarted","Data":"87801b7d51103d3ed404ecf02e9d0ff5e4ea6085cf43ad9355abe514620af887"}
Jul 17 09:57:46.034323 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:46.034307    2560 scope.go:117] "RemoveContainer" containerID="450019c91f7272cf2493c38648cd77ac69c26430eb41aedcb7d0d00495b0525d"
Jul 17 09:57:47.040051 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:47.040013    2560 generic.go:356] "Generic (PLEG): container finished" podID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerID="3718d2fcc2ae557b268d16b0d107f123db38744cd250cf1973fd93e3caefd61e" exitCode=6
Jul 17 09:57:47.040464 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:47.040099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w" event={"ID":"15b36ea6-787a-4a34-b237-d6d1829452bf","Type":"ContainerDied","Data":"3718d2fcc2ae557b268d16b0d107f123db38744cd250cf1973fd93e3caefd61e"}
Jul 17 09:57:47.040464 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:47.040161    2560 scope.go:117] "RemoveContainer" containerID="450019c91f7272cf2493c38648cd77ac69c26430eb41aedcb7d0d00495b0525d"
Jul 17 09:57:47.040464 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:47.040429    2560 scope.go:117] "RemoveContainer" containerID="3718d2fcc2ae557b268d16b0d107f123db38744cd250cf1973fd93e3caefd61e"
Jul 17 09:57:47.040630 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:57:47.040614    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w_odh-ai-gateway-infra(15b36ea6-787a-4a34-b237-d6d1829452bf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf"
Jul 17 09:57:48.046735 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:48.046707    2560 scope.go:117] "RemoveContainer" containerID="3718d2fcc2ae557b268d16b0d107f123db38744cd250cf1973fd93e3caefd61e"
Jul 17 09:57:48.047136 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:57:48.046939    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w_odh-ai-gateway-infra(15b36ea6-787a-4a34-b237-d6d1829452bf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf"
Jul 17 09:57:58.178398 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:58.178366    2560 scope.go:117] "RemoveContainer" containerID="2cf5d917b5b8c5e55b6fcee8b83e03bfde273ad2652134bb2fd117c7ea41515b"
Jul 17 09:57:58.754794 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:58.754695    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:57:59.097105 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:59.097016    2560 generic.go:356] "Generic (PLEG): container finished" podID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerID="ecd79101b3b83be5e735152bfed9295fbc6d5884fa3bd7e37639ea7fcb35c772" exitCode=7
Jul 17 09:57:59.097105 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:59.097072    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd" event={"ID":"9411b683-fb02-4d7e-a98f-cd9d94f4989c","Type":"ContainerDied","Data":"ecd79101b3b83be5e735152bfed9295fbc6d5884fa3bd7e37639ea7fcb35c772"}
Jul 17 09:57:59.097346 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:59.097135    2560 scope.go:117] "RemoveContainer" containerID="2cf5d917b5b8c5e55b6fcee8b83e03bfde273ad2652134bb2fd117c7ea41515b"
Jul 17 09:57:59.097421 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:57:59.097405    2560 scope.go:117] "RemoveContainer" containerID="ecd79101b3b83be5e735152bfed9295fbc6d5884fa3bd7e37639ea7fcb35c772"
Jul 17 09:57:59.097680 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:57:59.097656    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd_odh-ai-gateway-infra(9411b683-fb02-4d7e-a98f-cd9d94f4989c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c"
Jul 17 09:58:00.128116 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:00.128085    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"]
Jul 17 09:58:00.179065 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:00.179038    2560 scope.go:117] "RemoveContainer" containerID="3718d2fcc2ae557b268d16b0d107f123db38744cd250cf1973fd93e3caefd61e"
Jul 17 09:58:00.266082 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:00.266059    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"
Jul 17 09:58:00.367184 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:00.367156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9411b683-fb02-4d7e-a98f-cd9d94f4989c-maas-api-service-ca\") pod \"9411b683-fb02-4d7e-a98f-cd9d94f4989c\" (UID: \"9411b683-fb02-4d7e-a98f-cd9d94f4989c\") "
Jul 17 09:58:00.367475 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:00.367453    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9411b683-fb02-4d7e-a98f-cd9d94f4989c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9411b683-fb02-4d7e-a98f-cd9d94f4989c" (UID: "9411b683-fb02-4d7e-a98f-cd9d94f4989c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:58:00.468323 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:00.468299    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9411b683-fb02-4d7e-a98f-cd9d94f4989c-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:58:01.115084 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:01.114990    2560 generic.go:356] "Generic (PLEG): container finished" podID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerID="a2cf2f25f2219c4d7a485333b5a26ae326cce2e1c11aac3c0c7915cf9ac3c879" exitCode=6
Jul 17 09:58:01.115084 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:01.115053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w" event={"ID":"15b36ea6-787a-4a34-b237-d6d1829452bf","Type":"ContainerDied","Data":"a2cf2f25f2219c4d7a485333b5a26ae326cce2e1c11aac3c0c7915cf9ac3c879"}
Jul 17 09:58:01.115301 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:01.115120    2560 scope.go:117] "RemoveContainer" containerID="3718d2fcc2ae557b268d16b0d107f123db38744cd250cf1973fd93e3caefd61e"
Jul 17 09:58:01.115470 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:01.115444    2560 scope.go:117] "RemoveContainer" containerID="a2cf2f25f2219c4d7a485333b5a26ae326cce2e1c11aac3c0c7915cf9ac3c879"
Jul 17 09:58:01.115718 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:58:01.115689    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w_odh-ai-gateway-infra(15b36ea6-787a-4a34-b237-d6d1829452bf)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf"
Jul 17 09:58:01.116523 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:01.116501    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"
Jul 17 09:58:01.116523 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:01.116508    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd" event={"ID":"9411b683-fb02-4d7e-a98f-cd9d94f4989c","Type":"ContainerDied","Data":"a39e28f46613d5cb7a74d5c4ece8881c1667a3eb863cc8472af809930c16b546"}
Jul 17 09:58:01.126052 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:01.126034    2560 scope.go:117] "RemoveContainer" containerID="ecd79101b3b83be5e735152bfed9295fbc6d5884fa3bd7e37639ea7fcb35c772"
Jul 17 09:58:01.147926 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:01.147901    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"]
Jul 17 09:58:01.154476 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:01.154454    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-qd4qd"]
Jul 17 09:58:01.183072 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:01.183050    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" path="/var/lib/kubelet/pods/9411b683-fb02-4d7e-a98f-cd9d94f4989c/volumes"
Jul 17 09:58:02.145258 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:02.145222    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"]
Jul 17 09:58:02.278025 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:02.277998    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"
Jul 17 09:58:02.385884 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:02.385854    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b36ea6-787a-4a34-b237-d6d1829452bf-maas-api-service-ca\") pod \"15b36ea6-787a-4a34-b237-d6d1829452bf\" (UID: \"15b36ea6-787a-4a34-b237-d6d1829452bf\") "
Jul 17 09:58:02.386236 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:02.386216    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15b36ea6-787a-4a34-b237-d6d1829452bf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "15b36ea6-787a-4a34-b237-d6d1829452bf" (UID: "15b36ea6-787a-4a34-b237-d6d1829452bf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:58:02.487431 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:02.487372    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b36ea6-787a-4a34-b237-d6d1829452bf-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:58:03.128169 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:03.128137    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"
Jul 17 09:58:03.128318 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:03.128138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w" event={"ID":"15b36ea6-787a-4a34-b237-d6d1829452bf","Type":"ContainerDied","Data":"87801b7d51103d3ed404ecf02e9d0ff5e4ea6085cf43ad9355abe514620af887"}
Jul 17 09:58:03.128318 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:03.128282    2560 scope.go:117] "RemoveContainer" containerID="a2cf2f25f2219c4d7a485333b5a26ae326cce2e1c11aac3c0c7915cf9ac3c879"
Jul 17 09:58:03.153541 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:03.153518    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"]
Jul 17 09:58:03.158190 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:03.158162    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-f664w"]
Jul 17 09:58:03.184152 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:03.184123    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf" path="/var/lib/kubelet/pods/15b36ea6-787a-4a34-b237-d6d1829452bf/volumes"
Jul 17 09:58:05.141997 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.141962    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"]
Jul 17 09:58:05.142350 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142258    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerName="revoke-keys"
Jul 17 09:58:05.142350 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142269    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerName="revoke-keys"
Jul 17 09:58:05.142350 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142284    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerName="revoke-keys"
Jul 17 09:58:05.142350 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142289    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerName="revoke-keys"
Jul 17 09:58:05.142350 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142296    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerName="revoke-keys"
Jul 17 09:58:05.142350 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142302    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerName="revoke-keys"
Jul 17 09:58:05.142350 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142309    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerName="revoke-keys"
Jul 17 09:58:05.142350 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142314    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerName="revoke-keys"
Jul 17 09:58:05.142350 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142322    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerName="revoke-keys"
Jul 17 09:58:05.142350 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142328    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerName="revoke-keys"
Jul 17 09:58:05.142665 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142378    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerName="revoke-keys"
Jul 17 09:58:05.142665 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142385    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerName="revoke-keys"
Jul 17 09:58:05.142665 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142394    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerName="revoke-keys"
Jul 17 09:58:05.142665 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.142400    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerName="revoke-keys"
Jul 17 09:58:05.146529 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.146511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"
Jul 17 09:58:05.149003 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.148980    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:58:05.149278 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.149260    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:58:05.153025 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.152967    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"]
Jul 17 09:58:05.312202 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.312161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68339b8f-a112-4f3c-a027-e826e96abb5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25\" (UID: \"68339b8f-a112-4f3c-a027-e826e96abb5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"
Jul 17 09:58:05.413009 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.412927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68339b8f-a112-4f3c-a027-e826e96abb5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25\" (UID: \"68339b8f-a112-4f3c-a027-e826e96abb5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"
Jul 17 09:58:05.413553 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.413534    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68339b8f-a112-4f3c-a027-e826e96abb5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25\" (UID: \"68339b8f-a112-4f3c-a027-e826e96abb5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"
Jul 17 09:58:05.458598 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.458565    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"
Jul 17 09:58:05.587522 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:05.587414    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"]
Jul 17 09:58:05.589444 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:58:05.589413    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68339b8f_a112_4f3c_a027_e826e96abb5f.slice/crio-609704b09d5a5b2c555b5e75c7e5665a4cbd15655a91c3a5a5361c5ac30db2b3 WatchSource:0}: Error finding container 609704b09d5a5b2c555b5e75c7e5665a4cbd15655a91c3a5a5361c5ac30db2b3: Status 404 returned error can't find the container with id 609704b09d5a5b2c555b5e75c7e5665a4cbd15655a91c3a5a5361c5ac30db2b3
Jul 17 09:58:06.144353 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:06.144309    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25" event={"ID":"68339b8f-a112-4f3c-a027-e826e96abb5f","Type":"ContainerStarted","Data":"b5e720139fce248255da5b6f23e0a072097a14fab29afb98dd33ffc4e677f257"}
Jul 17 09:58:06.144772 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:06.144380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25" event={"ID":"68339b8f-a112-4f3c-a027-e826e96abb5f","Type":"ContainerStarted","Data":"609704b09d5a5b2c555b5e75c7e5665a4cbd15655a91c3a5a5361c5ac30db2b3"}
Jul 17 09:58:06.163174 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:06.163124    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25" podStartSLOduration=1.163110707 podStartE2EDuration="1.163110707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:58:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:58:06.161286818 +0000 UTC m=+2405.652981249" watchObservedRunningTime="2026-07-17 09:58:06.163110707 +0000 UTC m=+2405.654805113"
Jul 17 09:58:07.150475 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:07.150439    2560 generic.go:356] "Generic (PLEG): container finished" podID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerID="b5e720139fce248255da5b6f23e0a072097a14fab29afb98dd33ffc4e677f257" exitCode=6
Jul 17 09:58:07.150871 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:07.150523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25" event={"ID":"68339b8f-a112-4f3c-a027-e826e96abb5f","Type":"ContainerDied","Data":"b5e720139fce248255da5b6f23e0a072097a14fab29afb98dd33ffc4e677f257"}
Jul 17 09:58:07.150871 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:07.150711    2560 scope.go:117] "RemoveContainer" containerID="b5e720139fce248255da5b6f23e0a072097a14fab29afb98dd33ffc4e677f257"
Jul 17 09:58:08.156405 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:08.156368    2560 generic.go:356] "Generic (PLEG): container finished" podID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerID="e34f6cccd8c530a1c056b2d7a0c96471bcb6fe8f77f10d64f3b85f17949fb56b" exitCode=6
Jul 17 09:58:08.156405 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:08.156404    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25" event={"ID":"68339b8f-a112-4f3c-a027-e826e96abb5f","Type":"ContainerDied","Data":"e34f6cccd8c530a1c056b2d7a0c96471bcb6fe8f77f10d64f3b85f17949fb56b"}
Jul 17 09:58:08.157078 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:08.156451    2560 scope.go:117] "RemoveContainer" containerID="b5e720139fce248255da5b6f23e0a072097a14fab29afb98dd33ffc4e677f257"
Jul 17 09:58:08.157078 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:08.156618    2560 scope.go:117] "RemoveContainer" containerID="e34f6cccd8c530a1c056b2d7a0c96471bcb6fe8f77f10d64f3b85f17949fb56b"
Jul 17 09:58:08.157078 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:58:08.156846    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25_odh-ai-gateway-infra(68339b8f-a112-4f3c-a027-e826e96abb5f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f"
Jul 17 09:58:09.162528 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:09.162500    2560 scope.go:117] "RemoveContainer" containerID="e34f6cccd8c530a1c056b2d7a0c96471bcb6fe8f77f10d64f3b85f17949fb56b"
Jul 17 09:58:09.162902 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:58:09.162713    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25_odh-ai-gateway-infra(68339b8f-a112-4f3c-a027-e826e96abb5f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f"
Jul 17 09:58:20.178974 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:20.178944    2560 scope.go:117] "RemoveContainer" containerID="e34f6cccd8c530a1c056b2d7a0c96471bcb6fe8f77f10d64f3b85f17949fb56b"
Jul 17 09:58:21.212750 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:21.212721    2560 generic.go:356] "Generic (PLEG): container finished" podID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerID="5c9c66181905ede503f835ca8101aae63a0c2df208a2daac575f0733de4efc0b" exitCode=6
Jul 17 09:58:21.213190 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:21.212797    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25" event={"ID":"68339b8f-a112-4f3c-a027-e826e96abb5f","Type":"ContainerDied","Data":"5c9c66181905ede503f835ca8101aae63a0c2df208a2daac575f0733de4efc0b"}
Jul 17 09:58:21.213190 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:21.212858    2560 scope.go:117] "RemoveContainer" containerID="e34f6cccd8c530a1c056b2d7a0c96471bcb6fe8f77f10d64f3b85f17949fb56b"
Jul 17 09:58:21.213190 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:21.213100    2560 scope.go:117] "RemoveContainer" containerID="5c9c66181905ede503f835ca8101aae63a0c2df208a2daac575f0733de4efc0b"
Jul 17 09:58:21.213378 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:58:21.213347    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25_odh-ai-gateway-infra(68339b8f-a112-4f3c-a027-e826e96abb5f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f"
Jul 17 09:58:22.244971 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:22.244933    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"]
Jul 17 09:58:22.373017 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:22.372993    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"
Jul 17 09:58:22.449413 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:22.449386    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68339b8f-a112-4f3c-a027-e826e96abb5f-maas-api-service-ca\") pod \"68339b8f-a112-4f3c-a027-e826e96abb5f\" (UID: \"68339b8f-a112-4f3c-a027-e826e96abb5f\") "
Jul 17 09:58:22.449719 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:22.449693    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68339b8f-a112-4f3c-a027-e826e96abb5f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "68339b8f-a112-4f3c-a027-e826e96abb5f" (UID: "68339b8f-a112-4f3c-a027-e826e96abb5f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:58:22.550322 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:22.550249    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68339b8f-a112-4f3c-a027-e826e96abb5f-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:58:23.229079 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:23.229045    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"
Jul 17 09:58:23.229253 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:23.229091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25" event={"ID":"68339b8f-a112-4f3c-a027-e826e96abb5f","Type":"ContainerDied","Data":"609704b09d5a5b2c555b5e75c7e5665a4cbd15655a91c3a5a5361c5ac30db2b3"}
Jul 17 09:58:23.229253 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:23.229147    2560 scope.go:117] "RemoveContainer" containerID="5c9c66181905ede503f835ca8101aae63a0c2df208a2daac575f0733de4efc0b"
Jul 17 09:58:23.248511 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:23.248490    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"]
Jul 17 09:58:23.255427 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:23.255377    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-j4f25"]
Jul 17 09:58:25.183921 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:25.183891    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f" path="/var/lib/kubelet/pods/68339b8f-a112-4f3c-a027-e826e96abb5f/volumes"
Jul 17 09:58:32.724811 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.724759    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"]
Jul 17 09:58:32.725213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.725073    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerName="revoke-keys"
Jul 17 09:58:32.725213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.725086    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerName="revoke-keys"
Jul 17 09:58:32.725213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.725094    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerName="revoke-keys"
Jul 17 09:58:32.725213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.725100    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerName="revoke-keys"
Jul 17 09:58:32.725213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.725112    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerName="revoke-keys"
Jul 17 09:58:32.725213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.725118    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerName="revoke-keys"
Jul 17 09:58:32.725213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.725166    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerName="revoke-keys"
Jul 17 09:58:32.725213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.725175    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b36ea6-787a-4a34-b237-d6d1829452bf" containerName="revoke-keys"
Jul 17 09:58:32.725213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.725181    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9411b683-fb02-4d7e-a98f-cd9d94f4989c" containerName="revoke-keys"
Jul 17 09:58:32.725213 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.725188    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerName="revoke-keys"
Jul 17 09:58:32.729436 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.729416    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"
Jul 17 09:58:32.732487 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.732459    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:58:32.732612 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.732466    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:58:32.738015 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.737989    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"]
Jul 17 09:58:32.839253 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.839228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4392f2-5a60-41dd-9921-0f86788d736c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr\" (UID: \"be4392f2-5a60-41dd-9921-0f86788d736c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"
Jul 17 09:58:32.940028 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.939996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4392f2-5a60-41dd-9921-0f86788d736c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr\" (UID: \"be4392f2-5a60-41dd-9921-0f86788d736c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"
Jul 17 09:58:32.940618 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:32.940593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4392f2-5a60-41dd-9921-0f86788d736c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr\" (UID: \"be4392f2-5a60-41dd-9921-0f86788d736c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"
Jul 17 09:58:33.040760 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:33.040688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"
Jul 17 09:58:33.171088 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:33.171061    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"]
Jul 17 09:58:33.174202 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:58:33.174167    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4392f2_5a60_41dd_9921_0f86788d736c.slice/crio-fd63f42e6489b41d7653575b152b3d3d0c36e1f6c015d6b6d00e8f9066f11a64 WatchSource:0}: Error finding container fd63f42e6489b41d7653575b152b3d3d0c36e1f6c015d6b6d00e8f9066f11a64: Status 404 returned error can't find the container with id fd63f42e6489b41d7653575b152b3d3d0c36e1f6c015d6b6d00e8f9066f11a64
Jul 17 09:58:33.271539 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:33.271508    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr" event={"ID":"be4392f2-5a60-41dd-9921-0f86788d736c","Type":"ContainerStarted","Data":"fd63f42e6489b41d7653575b152b3d3d0c36e1f6c015d6b6d00e8f9066f11a64"}
Jul 17 09:58:34.276923 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:34.276888    2560 generic.go:356] "Generic (PLEG): container finished" podID="be4392f2-5a60-41dd-9921-0f86788d736c" containerID="99bba6f129b90377d34a5b7fbc0511a700aca44cb3011fdc4e0f64eb4055631b" exitCode=7
Jul 17 09:58:34.277430 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:34.276972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr" event={"ID":"be4392f2-5a60-41dd-9921-0f86788d736c","Type":"ContainerDied","Data":"99bba6f129b90377d34a5b7fbc0511a700aca44cb3011fdc4e0f64eb4055631b"}
Jul 17 09:58:34.277430 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:34.277149    2560 scope.go:117] "RemoveContainer" containerID="99bba6f129b90377d34a5b7fbc0511a700aca44cb3011fdc4e0f64eb4055631b"
Jul 17 09:58:35.288300 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:35.288262    2560 generic.go:356] "Generic (PLEG): container finished" podID="be4392f2-5a60-41dd-9921-0f86788d736c" containerID="6dc459c8c39346d2377073163ad39685b7762f90ae207c75dc9d9794ffa367bf" exitCode=7
Jul 17 09:58:35.288711 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:35.288344    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr" event={"ID":"be4392f2-5a60-41dd-9921-0f86788d736c","Type":"ContainerDied","Data":"6dc459c8c39346d2377073163ad39685b7762f90ae207c75dc9d9794ffa367bf"}
Jul 17 09:58:35.288711 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:35.288424    2560 scope.go:117] "RemoveContainer" containerID="99bba6f129b90377d34a5b7fbc0511a700aca44cb3011fdc4e0f64eb4055631b"
Jul 17 09:58:35.288711 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:35.288585    2560 scope.go:117] "RemoveContainer" containerID="6dc459c8c39346d2377073163ad39685b7762f90ae207c75dc9d9794ffa367bf"
Jul 17 09:58:35.288884 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:58:35.288764    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr_odh-ai-gateway-infra(be4392f2-5a60-41dd-9921-0f86788d736c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr" podUID="be4392f2-5a60-41dd-9921-0f86788d736c"
Jul 17 09:58:36.294398 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:36.294369    2560 scope.go:117] "RemoveContainer" containerID="6dc459c8c39346d2377073163ad39685b7762f90ae207c75dc9d9794ffa367bf"
Jul 17 09:58:36.294888 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:58:36.294603    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr_odh-ai-gateway-infra(be4392f2-5a60-41dd-9921-0f86788d736c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr" podUID="be4392f2-5a60-41dd-9921-0f86788d736c"
Jul 17 09:58:51.181554 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:51.181523    2560 scope.go:117] "RemoveContainer" containerID="6dc459c8c39346d2377073163ad39685b7762f90ae207c75dc9d9794ffa367bf"
Jul 17 09:58:52.104065 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:52.104028    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:58:52.210394 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:52.210356    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:58:52.366669 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:52.366635    2560 generic.go:356] "Generic (PLEG): container finished" podID="be4392f2-5a60-41dd-9921-0f86788d736c" containerID="29e0a1db7f6e5a789697c36198d76bed57e219ae357d302ec897880a7c9ce097" exitCode=7
Jul 17 09:58:52.366890 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:52.366709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr" event={"ID":"be4392f2-5a60-41dd-9921-0f86788d736c","Type":"ContainerDied","Data":"29e0a1db7f6e5a789697c36198d76bed57e219ae357d302ec897880a7c9ce097"}
Jul 17 09:58:52.366890 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:52.366838    2560 scope.go:117] "RemoveContainer" containerID="6dc459c8c39346d2377073163ad39685b7762f90ae207c75dc9d9794ffa367bf"
Jul 17 09:58:52.367154 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:52.367134    2560 scope.go:117] "RemoveContainer" containerID="29e0a1db7f6e5a789697c36198d76bed57e219ae357d302ec897880a7c9ce097"
Jul 17 09:58:52.367411 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:58:52.367389    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr_odh-ai-gateway-infra(be4392f2-5a60-41dd-9921-0f86788d736c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr" podUID="be4392f2-5a60-41dd-9921-0f86788d736c"
Jul 17 09:58:53.394266 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:53.394232    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"]
Jul 17 09:58:53.523191 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:53.523162    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"
Jul 17 09:58:53.721999 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:53.721915    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4392f2-5a60-41dd-9921-0f86788d736c-maas-api-service-ca\") pod \"be4392f2-5a60-41dd-9921-0f86788d736c\" (UID: \"be4392f2-5a60-41dd-9921-0f86788d736c\") "
Jul 17 09:58:53.722287 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:53.722262    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be4392f2-5a60-41dd-9921-0f86788d736c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be4392f2-5a60-41dd-9921-0f86788d736c" (UID: "be4392f2-5a60-41dd-9921-0f86788d736c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:58:53.823158 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:53.823123    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be4392f2-5a60-41dd-9921-0f86788d736c-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:58:54.093000 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:54.092907    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:58:54.192821 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:54.192762    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:58:54.378595 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:54.378518    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"
Jul 17 09:58:54.378595 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:54.378532    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr" event={"ID":"be4392f2-5a60-41dd-9921-0f86788d736c","Type":"ContainerDied","Data":"fd63f42e6489b41d7653575b152b3d3d0c36e1f6c015d6b6d00e8f9066f11a64"}
Jul 17 09:58:54.378826 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:54.378593    2560 scope.go:117] "RemoveContainer" containerID="29e0a1db7f6e5a789697c36198d76bed57e219ae357d302ec897880a7c9ce097"
Jul 17 09:58:54.399626 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:54.399597    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"]
Jul 17 09:58:54.404543 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:54.404521    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-clmzr"]
Jul 17 09:58:55.183679 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.183641    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be4392f2-5a60-41dd-9921-0f86788d736c" path="/var/lib/kubelet/pods/be4392f2-5a60-41dd-9921-0f86788d736c/volumes"
Jul 17 09:58:55.185368 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.185343    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"]
Jul 17 09:58:55.185647 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.185633    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4392f2-5a60-41dd-9921-0f86788d736c" containerName="revoke-keys"
Jul 17 09:58:55.185689 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.185650    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4392f2-5a60-41dd-9921-0f86788d736c" containerName="revoke-keys"
Jul 17 09:58:55.185689 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.185660    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4392f2-5a60-41dd-9921-0f86788d736c" containerName="revoke-keys"
Jul 17 09:58:55.185689 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.185666    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4392f2-5a60-41dd-9921-0f86788d736c" containerName="revoke-keys"
Jul 17 09:58:55.185689 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.185674    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerName="revoke-keys"
Jul 17 09:58:55.185689 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.185680    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerName="revoke-keys"
Jul 17 09:58:55.185881 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.185731    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4392f2-5a60-41dd-9921-0f86788d736c" containerName="revoke-keys"
Jul 17 09:58:55.185881 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.185739    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4392f2-5a60-41dd-9921-0f86788d736c" containerName="revoke-keys"
Jul 17 09:58:55.185881 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.185746    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="68339b8f-a112-4f3c-a027-e826e96abb5f" containerName="revoke-keys"
Jul 17 09:58:55.190028 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.190011    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"
Jul 17 09:58:55.192568 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.192549    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:58:55.192679 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.192592    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:58:55.197473 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.197446    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"]
Jul 17 09:58:55.235327 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.235296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d72885b-44b5-4cfc-8b63-06a3dd25c2f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85\" (UID: \"9d72885b-44b5-4cfc-8b63-06a3dd25c2f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"
Jul 17 09:58:55.336568 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.336535    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d72885b-44b5-4cfc-8b63-06a3dd25c2f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85\" (UID: \"9d72885b-44b5-4cfc-8b63-06a3dd25c2f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"
Jul 17 09:58:55.337148 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.337127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d72885b-44b5-4cfc-8b63-06a3dd25c2f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85\" (UID: \"9d72885b-44b5-4cfc-8b63-06a3dd25c2f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"
Jul 17 09:58:55.502099 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.502021    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"
Jul 17 09:58:55.632054 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:55.632030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"]
Jul 17 09:58:55.634529 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:58:55.634496    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d72885b_44b5_4cfc_8b63_06a3dd25c2f7.slice/crio-b2bbad2d9db7a2706be31efc4384df950fa686797be71315597aa90e9215becc WatchSource:0}: Error finding container b2bbad2d9db7a2706be31efc4384df950fa686797be71315597aa90e9215becc: Status 404 returned error can't find the container with id b2bbad2d9db7a2706be31efc4384df950fa686797be71315597aa90e9215becc
Jul 17 09:58:56.396240 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:56.396201    2560 generic.go:356] "Generic (PLEG): container finished" podID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerID="4b885656a18502df39fb5190dfc3b833b96c081d8e4ca16b8af5ad8e256bef71" exitCode=6
Jul 17 09:58:56.396435 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:56.396287    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85" event={"ID":"9d72885b-44b5-4cfc-8b63-06a3dd25c2f7","Type":"ContainerDied","Data":"4b885656a18502df39fb5190dfc3b833b96c081d8e4ca16b8af5ad8e256bef71"}
Jul 17 09:58:56.396435 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:56.396378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85" event={"ID":"9d72885b-44b5-4cfc-8b63-06a3dd25c2f7","Type":"ContainerStarted","Data":"b2bbad2d9db7a2706be31efc4384df950fa686797be71315597aa90e9215becc"}
Jul 17 09:58:56.396529 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:56.396500    2560 scope.go:117] "RemoveContainer" containerID="4b885656a18502df39fb5190dfc3b833b96c081d8e4ca16b8af5ad8e256bef71"
Jul 17 09:58:57.402705 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:57.402675    2560 generic.go:356] "Generic (PLEG): container finished" podID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerID="f4f6b44f419fc403c799f62d657875ada8bddb6e3123901ff02156375d7ecae1" exitCode=6
Jul 17 09:58:57.403112 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:57.402721    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85" event={"ID":"9d72885b-44b5-4cfc-8b63-06a3dd25c2f7","Type":"ContainerDied","Data":"f4f6b44f419fc403c799f62d657875ada8bddb6e3123901ff02156375d7ecae1"}
Jul 17 09:58:57.403112 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:57.402772    2560 scope.go:117] "RemoveContainer" containerID="4b885656a18502df39fb5190dfc3b833b96c081d8e4ca16b8af5ad8e256bef71"
Jul 17 09:58:57.403112 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:57.402965    2560 scope.go:117] "RemoveContainer" containerID="f4f6b44f419fc403c799f62d657875ada8bddb6e3123901ff02156375d7ecae1"
Jul 17 09:58:57.403263 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:58:57.403193    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85_odh-ai-gateway-infra(9d72885b-44b5-4cfc-8b63-06a3dd25c2f7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7"
Jul 17 09:58:58.408408 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:58:58.408382    2560 scope.go:117] "RemoveContainer" containerID="f4f6b44f419fc403c799f62d657875ada8bddb6e3123901ff02156375d7ecae1"
Jul 17 09:58:58.408836 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:58:58.408555    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85_odh-ai-gateway-infra(9d72885b-44b5-4cfc-8b63-06a3dd25c2f7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7"
Jul 17 09:59:10.178395 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:10.178364    2560 scope.go:117] "RemoveContainer" containerID="f4f6b44f419fc403c799f62d657875ada8bddb6e3123901ff02156375d7ecae1"
Jul 17 09:59:10.460058 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:10.459992    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85" event={"ID":"9d72885b-44b5-4cfc-8b63-06a3dd25c2f7","Type":"ContainerStarted","Data":"6925792d9787927d8ee229f01c4667ba753f4d34a14fce544c90c18582c8c604"}
Jul 17 09:59:10.487419 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:10.487374    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85" podStartSLOduration=15.48736103 podStartE2EDuration="15.48736103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:59:10.486007367 +0000 UTC m=+2469.977701773" watchObservedRunningTime="2026-07-17 09:59:10.48736103 +0000 UTC m=+2469.979055438"
Jul 17 09:59:11.465467 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:11.465435    2560 generic.go:356] "Generic (PLEG): container finished" podID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerID="6925792d9787927d8ee229f01c4667ba753f4d34a14fce544c90c18582c8c604" exitCode=6
Jul 17 09:59:11.465968 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:11.465505    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85" event={"ID":"9d72885b-44b5-4cfc-8b63-06a3dd25c2f7","Type":"ContainerDied","Data":"6925792d9787927d8ee229f01c4667ba753f4d34a14fce544c90c18582c8c604"}
Jul 17 09:59:11.465968 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:11.465563    2560 scope.go:117] "RemoveContainer" containerID="f4f6b44f419fc403c799f62d657875ada8bddb6e3123901ff02156375d7ecae1"
Jul 17 09:59:11.465968 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:11.465868    2560 scope.go:117] "RemoveContainer" containerID="6925792d9787927d8ee229f01c4667ba753f4d34a14fce544c90c18582c8c604"
Jul 17 09:59:11.466131 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:59:11.466082    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85_odh-ai-gateway-infra(9d72885b-44b5-4cfc-8b63-06a3dd25c2f7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7"
Jul 17 09:59:11.497327 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:11.497301    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"]
Jul 17 09:59:12.599892 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:12.599868    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"
Jul 17 09:59:12.687241 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:12.687207    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d72885b-44b5-4cfc-8b63-06a3dd25c2f7-maas-api-service-ca\") pod \"9d72885b-44b5-4cfc-8b63-06a3dd25c2f7\" (UID: \"9d72885b-44b5-4cfc-8b63-06a3dd25c2f7\") "
Jul 17 09:59:12.687555 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:12.687533    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d72885b-44b5-4cfc-8b63-06a3dd25c2f7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" (UID: "9d72885b-44b5-4cfc-8b63-06a3dd25c2f7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:59:12.788645 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:12.788577    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d72885b-44b5-4cfc-8b63-06a3dd25c2f7-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:59:13.477365 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:13.477289    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"
Jul 17 09:59:13.477365 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:13.477317    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85" event={"ID":"9d72885b-44b5-4cfc-8b63-06a3dd25c2f7","Type":"ContainerDied","Data":"b2bbad2d9db7a2706be31efc4384df950fa686797be71315597aa90e9215becc"}
Jul 17 09:59:13.477567 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:13.477373    2560 scope.go:117] "RemoveContainer" containerID="6925792d9787927d8ee229f01c4667ba753f4d34a14fce544c90c18582c8c604"
Jul 17 09:59:13.492700 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:13.492676    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"]
Jul 17 09:59:13.498821 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:13.498801    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-7fb85"]
Jul 17 09:59:15.184285 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:15.184252    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" path="/var/lib/kubelet/pods/9d72885b-44b5-4cfc-8b63-06a3dd25c2f7/volumes"
Jul 17 09:59:24.893363 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.893327    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"]
Jul 17 09:59:24.893857 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.893650    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerName="revoke-keys"
Jul 17 09:59:24.893857 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.893661    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerName="revoke-keys"
Jul 17 09:59:24.893857 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.893676    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerName="revoke-keys"
Jul 17 09:59:24.893857 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.893682    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerName="revoke-keys"
Jul 17 09:59:24.893857 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.893692    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4392f2-5a60-41dd-9921-0f86788d736c" containerName="revoke-keys"
Jul 17 09:59:24.893857 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.893697    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4392f2-5a60-41dd-9921-0f86788d736c" containerName="revoke-keys"
Jul 17 09:59:24.893857 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.893742    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerName="revoke-keys"
Jul 17 09:59:24.893857 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.893750    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerName="revoke-keys"
Jul 17 09:59:24.893857 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.893758    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerName="revoke-keys"
Jul 17 09:59:24.893857 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.893766    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4392f2-5a60-41dd-9921-0f86788d736c" containerName="revoke-keys"
Jul 17 09:59:24.898001 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.897983    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"
Jul 17 09:59:24.900998 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.900975    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 09:59:24.901098 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.901014    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 09:59:24.906904 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.906878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"]
Jul 17 09:59:24.989231 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:24.989188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f93411-77df-484b-ba63-de94f6cb4727-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m\" (UID: \"c6f93411-77df-484b-ba63-de94f6cb4727\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"
Jul 17 09:59:25.090203 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:25.090158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f93411-77df-484b-ba63-de94f6cb4727-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m\" (UID: \"c6f93411-77df-484b-ba63-de94f6cb4727\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"
Jul 17 09:59:25.090773 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:25.090753    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f93411-77df-484b-ba63-de94f6cb4727-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m\" (UID: \"c6f93411-77df-484b-ba63-de94f6cb4727\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"
Jul 17 09:59:25.208836 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:25.208753    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"
Jul 17 09:59:25.347802 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:25.347756    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"]
Jul 17 09:59:25.351140 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:59:25.351112    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f93411_77df_484b_ba63_de94f6cb4727.slice/crio-49e819e5f751a3e0e97afbd93a38533abd46eb5c7cdde0c5ff98bc9d406d7d0d WatchSource:0}: Error finding container 49e819e5f751a3e0e97afbd93a38533abd46eb5c7cdde0c5ff98bc9d406d7d0d: Status 404 returned error can't find the container with id 49e819e5f751a3e0e97afbd93a38533abd46eb5c7cdde0c5ff98bc9d406d7d0d
Jul 17 09:59:25.531737 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:25.531643    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m" event={"ID":"c6f93411-77df-484b-ba63-de94f6cb4727","Type":"ContainerStarted","Data":"49e819e5f751a3e0e97afbd93a38533abd46eb5c7cdde0c5ff98bc9d406d7d0d"}
Jul 17 09:59:26.537228 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:26.537188    2560 generic.go:356] "Generic (PLEG): container finished" podID="c6f93411-77df-484b-ba63-de94f6cb4727" containerID="d61ee7af588c758bb4338e621544454c5689488c2b7adeba83d26f11398ebe93" exitCode=6
Jul 17 09:59:26.537681 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:26.537277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m" event={"ID":"c6f93411-77df-484b-ba63-de94f6cb4727","Type":"ContainerDied","Data":"d61ee7af588c758bb4338e621544454c5689488c2b7adeba83d26f11398ebe93"}
Jul 17 09:59:26.537681 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:26.537417    2560 scope.go:117] "RemoveContainer" containerID="d61ee7af588c758bb4338e621544454c5689488c2b7adeba83d26f11398ebe93"
Jul 17 09:59:27.543148 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:27.543116    2560 generic.go:356] "Generic (PLEG): container finished" podID="c6f93411-77df-484b-ba63-de94f6cb4727" containerID="304e53800e80a864a859defff0c1daeab2093e184c8a66bbd9c28cf08c731a81" exitCode=6
Jul 17 09:59:27.543577 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:27.543161    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m" event={"ID":"c6f93411-77df-484b-ba63-de94f6cb4727","Type":"ContainerDied","Data":"304e53800e80a864a859defff0c1daeab2093e184c8a66bbd9c28cf08c731a81"}
Jul 17 09:59:27.543577 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:27.543208    2560 scope.go:117] "RemoveContainer" containerID="d61ee7af588c758bb4338e621544454c5689488c2b7adeba83d26f11398ebe93"
Jul 17 09:59:27.543577 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:27.543361    2560 scope.go:117] "RemoveContainer" containerID="304e53800e80a864a859defff0c1daeab2093e184c8a66bbd9c28cf08c731a81"
Jul 17 09:59:27.543716 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:59:27.543578    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m_odh-ai-gateway-infra(c6f93411-77df-484b-ba63-de94f6cb4727)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m" podUID="c6f93411-77df-484b-ba63-de94f6cb4727"
Jul 17 09:59:28.549196 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:28.549169    2560 scope.go:117] "RemoveContainer" containerID="304e53800e80a864a859defff0c1daeab2093e184c8a66bbd9c28cf08c731a81"
Jul 17 09:59:28.549606 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:59:28.549357    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m_odh-ai-gateway-infra(c6f93411-77df-484b-ba63-de94f6cb4727)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m" podUID="c6f93411-77df-484b-ba63-de94f6cb4727"
Jul 17 09:59:32.790456 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:32.790417    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"]
Jul 17 09:59:32.790949 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:32.790729    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerName="revoke-keys"
Jul 17 09:59:32.790949 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:32.790740    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d72885b-44b5-4cfc-8b63-06a3dd25c2f7" containerName="revoke-keys"
Jul 17 09:59:32.794908 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:32.794886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"
Jul 17 09:59:32.805905 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:32.805877    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"]
Jul 17 09:59:32.956356 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:32.956323    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f298cd9e-e438-471b-9d6a-66731c8c30d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk\" (UID: \"f298cd9e-e438-471b-9d6a-66731c8c30d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"
Jul 17 09:59:33.057249 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:33.057168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f298cd9e-e438-471b-9d6a-66731c8c30d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk\" (UID: \"f298cd9e-e438-471b-9d6a-66731c8c30d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"
Jul 17 09:59:33.057800 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:33.057758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f298cd9e-e438-471b-9d6a-66731c8c30d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk\" (UID: \"f298cd9e-e438-471b-9d6a-66731c8c30d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"
Jul 17 09:59:33.105255 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:33.105233    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"
Jul 17 09:59:33.234555 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:33.234530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"]
Jul 17 09:59:33.235731 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:59:33.235707    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf298cd9e_e438_471b_9d6a_66731c8c30d4.slice/crio-f807d3f7d69e4f2363e91409728e2fdf9db8cb5c8b4a14abff7040bbced60881 WatchSource:0}: Error finding container f807d3f7d69e4f2363e91409728e2fdf9db8cb5c8b4a14abff7040bbced60881: Status 404 returned error can't find the container with id f807d3f7d69e4f2363e91409728e2fdf9db8cb5c8b4a14abff7040bbced60881
Jul 17 09:59:33.570985 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:33.570954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk" event={"ID":"f298cd9e-e438-471b-9d6a-66731c8c30d4","Type":"ContainerStarted","Data":"2202198aef09d86b87acba692db2c7133deb64d711d2a5f7a63c18229a09d421"}
Jul 17 09:59:33.571107 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:33.571007    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk" event={"ID":"f298cd9e-e438-471b-9d6a-66731c8c30d4","Type":"ContainerStarted","Data":"f807d3f7d69e4f2363e91409728e2fdf9db8cb5c8b4a14abff7040bbced60881"}
Jul 17 09:59:33.587461 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:33.587410    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk" podStartSLOduration=1.587392233 podStartE2EDuration="1.587392233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:59:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:59:33.586849082 +0000 UTC m=+2493.078543488" watchObservedRunningTime="2026-07-17 09:59:33.587392233 +0000 UTC m=+2493.079086640"
Jul 17 09:59:34.577031 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:34.576992    2560 generic.go:356] "Generic (PLEG): container finished" podID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerID="2202198aef09d86b87acba692db2c7133deb64d711d2a5f7a63c18229a09d421" exitCode=7
Jul 17 09:59:34.577430 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:34.577078    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk" event={"ID":"f298cd9e-e438-471b-9d6a-66731c8c30d4","Type":"ContainerDied","Data":"2202198aef09d86b87acba692db2c7133deb64d711d2a5f7a63c18229a09d421"}
Jul 17 09:59:34.577430 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:34.577220    2560 scope.go:117] "RemoveContainer" containerID="2202198aef09d86b87acba692db2c7133deb64d711d2a5f7a63c18229a09d421"
Jul 17 09:59:35.588840 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:35.588747    2560 generic.go:356] "Generic (PLEG): container finished" podID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerID="7463a661835090272e590db4fa2c80b8f3fb41e49cb45fdfd223d965c4fd8b01" exitCode=7
Jul 17 09:59:35.588840 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:35.588810    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk" event={"ID":"f298cd9e-e438-471b-9d6a-66731c8c30d4","Type":"ContainerDied","Data":"7463a661835090272e590db4fa2c80b8f3fb41e49cb45fdfd223d965c4fd8b01"}
Jul 17 09:59:35.589330 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:35.588884    2560 scope.go:117] "RemoveContainer" containerID="2202198aef09d86b87acba692db2c7133deb64d711d2a5f7a63c18229a09d421"
Jul 17 09:59:35.589330 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:35.589061    2560 scope.go:117] "RemoveContainer" containerID="7463a661835090272e590db4fa2c80b8f3fb41e49cb45fdfd223d965c4fd8b01"
Jul 17 09:59:35.589330 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:59:35.589288    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk_odh-ai-gateway-infra(f298cd9e-e438-471b-9d6a-66731c8c30d4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4"
Jul 17 09:59:36.594745 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:36.594720    2560 scope.go:117] "RemoveContainer" containerID="7463a661835090272e590db4fa2c80b8f3fb41e49cb45fdfd223d965c4fd8b01"
Jul 17 09:59:36.595136 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:59:36.594926    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk_odh-ai-gateway-infra(f298cd9e-e438-471b-9d6a-66731c8c30d4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4"
Jul 17 09:59:39.178603 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:39.178568    2560 scope.go:117] "RemoveContainer" containerID="304e53800e80a864a859defff0c1daeab2093e184c8a66bbd9c28cf08c731a81"
Jul 17 09:59:39.611859 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:39.611764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m" event={"ID":"c6f93411-77df-484b-ba63-de94f6cb4727","Type":"ContainerStarted","Data":"3ce2cf8b20af221e8e9d6c4b40ef9e2c1dc4d6b99dc288b4bf4396bb509da9f2"}
Jul 17 09:59:39.631343 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:39.631294    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m" podStartSLOduration=15.631280146 podStartE2EDuration="15.631280146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:59:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 09:59:39.630852891 +0000 UTC m=+2499.122547299" watchObservedRunningTime="2026-07-17 09:59:39.631280146 +0000 UTC m=+2499.122974552"
Jul 17 09:59:40.617987 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:40.617956    2560 generic.go:356] "Generic (PLEG): container finished" podID="c6f93411-77df-484b-ba63-de94f6cb4727" containerID="3ce2cf8b20af221e8e9d6c4b40ef9e2c1dc4d6b99dc288b4bf4396bb509da9f2" exitCode=6
Jul 17 09:59:40.618479 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:40.618035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m" event={"ID":"c6f93411-77df-484b-ba63-de94f6cb4727","Type":"ContainerDied","Data":"3ce2cf8b20af221e8e9d6c4b40ef9e2c1dc4d6b99dc288b4bf4396bb509da9f2"}
Jul 17 09:59:40.618479 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:40.618097    2560 scope.go:117] "RemoveContainer" containerID="304e53800e80a864a859defff0c1daeab2093e184c8a66bbd9c28cf08c731a81"
Jul 17 09:59:40.618479 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:40.618363    2560 scope.go:117] "RemoveContainer" containerID="3ce2cf8b20af221e8e9d6c4b40ef9e2c1dc4d6b99dc288b4bf4396bb509da9f2"
Jul 17 09:59:40.618596 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:59:40.618566    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m_odh-ai-gateway-infra(c6f93411-77df-484b-ba63-de94f6cb4727)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m" podUID="c6f93411-77df-484b-ba63-de94f6cb4727"
Jul 17 09:59:40.642669 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:40.642648    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"]
Jul 17 09:59:41.766497 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:41.766467    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"
Jul 17 09:59:41.932274 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:41.932244    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f93411-77df-484b-ba63-de94f6cb4727-maas-api-service-ca\") pod \"c6f93411-77df-484b-ba63-de94f6cb4727\" (UID: \"c6f93411-77df-484b-ba63-de94f6cb4727\") "
Jul 17 09:59:41.932635 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:41.932612    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6f93411-77df-484b-ba63-de94f6cb4727-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c6f93411-77df-484b-ba63-de94f6cb4727" (UID: "c6f93411-77df-484b-ba63-de94f6cb4727"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:59:42.033836 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:42.033804    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6f93411-77df-484b-ba63-de94f6cb4727-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:59:42.628889 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:42.628855    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m" event={"ID":"c6f93411-77df-484b-ba63-de94f6cb4727","Type":"ContainerDied","Data":"49e819e5f751a3e0e97afbd93a38533abd46eb5c7cdde0c5ff98bc9d406d7d0d"}
Jul 17 09:59:42.628889 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:42.628884    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"
Jul 17 09:59:42.629177 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:42.628915    2560 scope.go:117] "RemoveContainer" containerID="3ce2cf8b20af221e8e9d6c4b40ef9e2c1dc4d6b99dc288b4bf4396bb509da9f2"
Jul 17 09:59:42.655235 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:42.655207    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"]
Jul 17 09:59:42.662215 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:42.662193    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-pwz5m"]
Jul 17 09:59:43.183353 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:43.183321    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6f93411-77df-484b-ba63-de94f6cb4727" path="/var/lib/kubelet/pods/c6f93411-77df-484b-ba63-de94f6cb4727/volumes"
Jul 17 09:59:45.258149 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.258118    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"]
Jul 17 09:59:45.258524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.258411    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6f93411-77df-484b-ba63-de94f6cb4727" containerName="revoke-keys"
Jul 17 09:59:45.258524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.258423    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6f93411-77df-484b-ba63-de94f6cb4727" containerName="revoke-keys"
Jul 17 09:59:45.258524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.258439    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6f93411-77df-484b-ba63-de94f6cb4727" containerName="revoke-keys"
Jul 17 09:59:45.258524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.258445    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6f93411-77df-484b-ba63-de94f6cb4727" containerName="revoke-keys"
Jul 17 09:59:45.258524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.258516    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6f93411-77df-484b-ba63-de94f6cb4727" containerName="revoke-keys"
Jul 17 09:59:45.258524 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.258526    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6f93411-77df-484b-ba63-de94f6cb4727" containerName="revoke-keys"
Jul 17 09:59:45.262957 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.262940    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"
Jul 17 09:59:45.271965 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.271940    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"]
Jul 17 09:59:45.363838 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.363808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f83cafcd-de45-4e3e-86be-4f0d7a32a94b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z\" (UID: \"f83cafcd-de45-4e3e-86be-4f0d7a32a94b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"
Jul 17 09:59:45.464480 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.464451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f83cafcd-de45-4e3e-86be-4f0d7a32a94b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z\" (UID: \"f83cafcd-de45-4e3e-86be-4f0d7a32a94b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"
Jul 17 09:59:45.465128 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.465104    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f83cafcd-de45-4e3e-86be-4f0d7a32a94b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z\" (UID: \"f83cafcd-de45-4e3e-86be-4f0d7a32a94b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"
Jul 17 09:59:45.573375 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.573300    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"
Jul 17 09:59:45.923655 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:45.923625    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"]
Jul 17 09:59:45.924906 ip-10-0-131-131 kubenswrapper[2560]: W0717 09:59:45.924877    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83cafcd_de45_4e3e_86be_4f0d7a32a94b.slice/crio-1f0aa3241197112d1e3afa20f591b282a5ee8b5437f2b0dceb0a2352c4f25bee WatchSource:0}: Error finding container 1f0aa3241197112d1e3afa20f591b282a5ee8b5437f2b0dceb0a2352c4f25bee: Status 404 returned error can't find the container with id 1f0aa3241197112d1e3afa20f591b282a5ee8b5437f2b0dceb0a2352c4f25bee
Jul 17 09:59:46.648995 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:46.648965    2560 generic.go:356] "Generic (PLEG): container finished" podID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerID="d00286afaf68839bca5cd1cfc1531f2242f023d85e349bc0b4bcf9f414c33706" exitCode=6
Jul 17 09:59:46.649332 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:46.649006    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z" event={"ID":"f83cafcd-de45-4e3e-86be-4f0d7a32a94b","Type":"ContainerDied","Data":"d00286afaf68839bca5cd1cfc1531f2242f023d85e349bc0b4bcf9f414c33706"}
Jul 17 09:59:46.649332 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:46.649074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z" event={"ID":"f83cafcd-de45-4e3e-86be-4f0d7a32a94b","Type":"ContainerStarted","Data":"1f0aa3241197112d1e3afa20f591b282a5ee8b5437f2b0dceb0a2352c4f25bee"}
Jul 17 09:59:46.649332 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:46.649234    2560 scope.go:117] "RemoveContainer" containerID="d00286afaf68839bca5cd1cfc1531f2242f023d85e349bc0b4bcf9f414c33706"
Jul 17 09:59:47.655462 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:47.655421    2560 generic.go:356] "Generic (PLEG): container finished" podID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerID="c7572ef4408b19290a3356084be2dd57df92993b028b94f414a67b4cf45f4f0f" exitCode=6
Jul 17 09:59:47.655939 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:47.655482    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z" event={"ID":"f83cafcd-de45-4e3e-86be-4f0d7a32a94b","Type":"ContainerDied","Data":"c7572ef4408b19290a3356084be2dd57df92993b028b94f414a67b4cf45f4f0f"}
Jul 17 09:59:47.655939 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:47.655553    2560 scope.go:117] "RemoveContainer" containerID="d00286afaf68839bca5cd1cfc1531f2242f023d85e349bc0b4bcf9f414c33706"
Jul 17 09:59:47.655939 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:47.655743    2560 scope.go:117] "RemoveContainer" containerID="c7572ef4408b19290a3356084be2dd57df92993b028b94f414a67b4cf45f4f0f"
Jul 17 09:59:47.656067 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:59:47.656010    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z_odh-ai-gateway-infra(f83cafcd-de45-4e3e-86be-4f0d7a32a94b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b"
Jul 17 09:59:48.662737 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:48.662705    2560 scope.go:117] "RemoveContainer" containerID="c7572ef4408b19290a3356084be2dd57df92993b028b94f414a67b4cf45f4f0f"
Jul 17 09:59:48.663126 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:59:48.662885    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z_odh-ai-gateway-infra(f83cafcd-de45-4e3e-86be-4f0d7a32a94b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b"
Jul 17 09:59:49.179155 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:49.179130    2560 scope.go:117] "RemoveContainer" containerID="7463a661835090272e590db4fa2c80b8f3fb41e49cb45fdfd223d965c4fd8b01"
Jul 17 09:59:49.668512 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:49.668482    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk" event={"ID":"f298cd9e-e438-471b-9d6a-66731c8c30d4","Type":"ContainerStarted","Data":"a905a3b3f02e1e3feaa8b6608dc8735d4bbea99ff0678717204ac9322529dc9d"}
Jul 17 09:59:50.675343 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:50.675302    2560 generic.go:356] "Generic (PLEG): container finished" podID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerID="a905a3b3f02e1e3feaa8b6608dc8735d4bbea99ff0678717204ac9322529dc9d" exitCode=7
Jul 17 09:59:50.675751 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:50.675372    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk" event={"ID":"f298cd9e-e438-471b-9d6a-66731c8c30d4","Type":"ContainerDied","Data":"a905a3b3f02e1e3feaa8b6608dc8735d4bbea99ff0678717204ac9322529dc9d"}
Jul 17 09:59:50.675751 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:50.675428    2560 scope.go:117] "RemoveContainer" containerID="7463a661835090272e590db4fa2c80b8f3fb41e49cb45fdfd223d965c4fd8b01"
Jul 17 09:59:50.675751 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:50.675698    2560 scope.go:117] "RemoveContainer" containerID="a905a3b3f02e1e3feaa8b6608dc8735d4bbea99ff0678717204ac9322529dc9d"
Jul 17 09:59:50.676014 ip-10-0-131-131 kubenswrapper[2560]: E0717 09:59:50.675980    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk_odh-ai-gateway-infra(f298cd9e-e438-471b-9d6a-66731c8c30d4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4"
Jul 17 09:59:50.713128 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:50.713098    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"]
Jul 17 09:59:51.808943 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:51.808920    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"
Jul 17 09:59:51.924325 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:51.924299    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f298cd9e-e438-471b-9d6a-66731c8c30d4-maas-api-service-ca\") pod \"f298cd9e-e438-471b-9d6a-66731c8c30d4\" (UID: \"f298cd9e-e438-471b-9d6a-66731c8c30d4\") "
Jul 17 09:59:51.924655 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:51.924636    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f298cd9e-e438-471b-9d6a-66731c8c30d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f298cd9e-e438-471b-9d6a-66731c8c30d4" (UID: "f298cd9e-e438-471b-9d6a-66731c8c30d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 09:59:52.025727 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:52.025659    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f298cd9e-e438-471b-9d6a-66731c8c30d4-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 09:59:52.686197 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:52.686166    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"
Jul 17 09:59:52.686365 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:52.686204    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk" event={"ID":"f298cd9e-e438-471b-9d6a-66731c8c30d4","Type":"ContainerDied","Data":"f807d3f7d69e4f2363e91409728e2fdf9db8cb5c8b4a14abff7040bbced60881"}
Jul 17 09:59:52.686365 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:52.686285    2560 scope.go:117] "RemoveContainer" containerID="a905a3b3f02e1e3feaa8b6608dc8735d4bbea99ff0678717204ac9322529dc9d"
Jul 17 09:59:52.710424 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:52.710394    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"]
Jul 17 09:59:52.715521 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:52.715496    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-xfjwk"]
Jul 17 09:59:52.783265 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:52.783233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:59:52.886655 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:52.886599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:59:53.183490 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:53.183460    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4" path="/var/lib/kubelet/pods/f298cd9e-e438-471b-9d6a-66731c8c30d4/volumes"
Jul 17 09:59:55.448314 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:55.448277    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 09:59:59.193086 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:59.193046    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 09:59:59.520834 ip-10-0-131-131 kubenswrapper[2560]: I0717 09:59:59.520717    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:03.184565 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:03.184539    2560 scope.go:117] "RemoveContainer" containerID="c7572ef4408b19290a3356084be2dd57df92993b028b94f414a67b4cf45f4f0f"
Jul 17 10:00:03.736035 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:03.735995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z" event={"ID":"f83cafcd-de45-4e3e-86be-4f0d7a32a94b","Type":"ContainerStarted","Data":"86f1c259cb9c8c45ec5ee0891b31abfc43e24466f382a34fc8503a806452a44d"}
Jul 17 10:00:03.754297 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:03.754248    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z" podStartSLOduration=18.75423559 podStartE2EDuration="18.75423559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 09:59:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:00:03.752724891 +0000 UTC m=+2523.244419308" watchObservedRunningTime="2026-07-17 10:00:03.75423559 +0000 UTC m=+2523.245929996"
Jul 17 10:00:04.741523 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:04.741487    2560 generic.go:356] "Generic (PLEG): container finished" podID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerID="86f1c259cb9c8c45ec5ee0891b31abfc43e24466f382a34fc8503a806452a44d" exitCode=6
Jul 17 10:00:04.741946 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:04.741556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z" event={"ID":"f83cafcd-de45-4e3e-86be-4f0d7a32a94b","Type":"ContainerDied","Data":"86f1c259cb9c8c45ec5ee0891b31abfc43e24466f382a34fc8503a806452a44d"}
Jul 17 10:00:04.741946 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:04.741619    2560 scope.go:117] "RemoveContainer" containerID="c7572ef4408b19290a3356084be2dd57df92993b028b94f414a67b4cf45f4f0f"
Jul 17 10:00:04.741946 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:04.741895    2560 scope.go:117] "RemoveContainer" containerID="86f1c259cb9c8c45ec5ee0891b31abfc43e24466f382a34fc8503a806452a44d"
Jul 17 10:00:04.742119 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:00:04.742085    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z_odh-ai-gateway-infra(f83cafcd-de45-4e3e-86be-4f0d7a32a94b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b"
Jul 17 10:00:04.766502 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:04.766477    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"]
Jul 17 10:00:05.634834 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:05.634796    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:05.738859 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:05.738824    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:05.876725 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:05.876702    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"
Jul 17 10:00:05.946673 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:05.946641    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f83cafcd-de45-4e3e-86be-4f0d7a32a94b-maas-api-service-ca\") pod \"f83cafcd-de45-4e3e-86be-4f0d7a32a94b\" (UID: \"f83cafcd-de45-4e3e-86be-4f0d7a32a94b\") "
Jul 17 10:00:05.947011 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:05.946992    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f83cafcd-de45-4e3e-86be-4f0d7a32a94b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f83cafcd-de45-4e3e-86be-4f0d7a32a94b" (UID: "f83cafcd-de45-4e3e-86be-4f0d7a32a94b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:00:06.047551 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:06.047518    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f83cafcd-de45-4e3e-86be-4f0d7a32a94b-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:00:06.577214 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:06.577172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:06.687385 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:06.687348    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:06.752144 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:06.752120    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"
Jul 17 10:00:06.752297 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:06.752120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z" event={"ID":"f83cafcd-de45-4e3e-86be-4f0d7a32a94b","Type":"ContainerDied","Data":"1f0aa3241197112d1e3afa20f591b282a5ee8b5437f2b0dceb0a2352c4f25bee"}
Jul 17 10:00:06.752297 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:06.752258    2560 scope.go:117] "RemoveContainer" containerID="86f1c259cb9c8c45ec5ee0891b31abfc43e24466f382a34fc8503a806452a44d"
Jul 17 10:00:06.775227 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:06.775196    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"]
Jul 17 10:00:06.780344 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:06.780323    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-vjr8z"]
Jul 17 10:00:07.184891 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:07.184852    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" path="/var/lib/kubelet/pods/f83cafcd-de45-4e3e-86be-4f0d7a32a94b/volumes"
Jul 17 10:00:07.908371 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:07.908334    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:09.871759 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:09.871730    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:14.508187 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:14.508126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:14.637768 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:14.637735    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:14.741079 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:14.741044    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:14.839272 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:14.839174    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:15.570656 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:15.570622    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:32.851828 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.851795    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"]
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852084    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852094    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852102    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852108    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852119    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6f93411-77df-484b-ba63-de94f6cb4727" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852125    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6f93411-77df-484b-ba63-de94f6cb4727" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852144    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852151    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852157    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852162    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852204    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852212    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852218    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852225    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852230    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerName="revoke-keys"
Jul 17 10:00:32.852310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.852236    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6f93411-77df-484b-ba63-de94f6cb4727" containerName="revoke-keys"
Jul 17 10:00:32.855221 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.855200    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"
Jul 17 10:00:32.858376 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.858350    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 10:00:32.858819 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.858794    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 10:00:32.878994 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.878963    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"]
Jul 17 10:00:32.987802 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:32.987752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac206be-1f1d-4069-8b7d-ec551edfbd90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc\" (UID: \"fac206be-1f1d-4069-8b7d-ec551edfbd90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"
Jul 17 10:00:33.089180 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:33.089141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac206be-1f1d-4069-8b7d-ec551edfbd90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc\" (UID: \"fac206be-1f1d-4069-8b7d-ec551edfbd90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"
Jul 17 10:00:33.089848 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:33.089825    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac206be-1f1d-4069-8b7d-ec551edfbd90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc\" (UID: \"fac206be-1f1d-4069-8b7d-ec551edfbd90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"
Jul 17 10:00:33.165366 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:33.165342    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"
Jul 17 10:00:33.297154 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:33.297118    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"]
Jul 17 10:00:33.300448 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:00:33.300423    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac206be_1f1d_4069_8b7d_ec551edfbd90.slice/crio-20637bc68318174a83eff194473eedd9f9eba570c43e1cf8944b79e458665e2d WatchSource:0}: Error finding container 20637bc68318174a83eff194473eedd9f9eba570c43e1cf8944b79e458665e2d: Status 404 returned error can't find the container with id 20637bc68318174a83eff194473eedd9f9eba570c43e1cf8944b79e458665e2d
Jul 17 10:00:33.866269 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:33.866183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc" event={"ID":"fac206be-1f1d-4069-8b7d-ec551edfbd90","Type":"ContainerStarted","Data":"051e2f928280386a951e5e89aa17caae34cc3c697924f76078561aa011dd50ae"}
Jul 17 10:00:33.866269 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:33.866236    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc" event={"ID":"fac206be-1f1d-4069-8b7d-ec551edfbd90","Type":"ContainerStarted","Data":"20637bc68318174a83eff194473eedd9f9eba570c43e1cf8944b79e458665e2d"}
Jul 17 10:00:33.890900 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:33.890847    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc" podStartSLOduration=1.8908268270000002 podStartE2EDuration="1.890826827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:00:33.889887348 +0000 UTC m=+2553.381581755" watchObservedRunningTime="2026-07-17 10:00:33.890826827 +0000 UTC m=+2553.382521234"
Jul 17 10:00:34.871683 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:34.871650    2560 generic.go:356] "Generic (PLEG): container finished" podID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerID="051e2f928280386a951e5e89aa17caae34cc3c697924f76078561aa011dd50ae" exitCode=6
Jul 17 10:00:34.872092 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:34.871746    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc" event={"ID":"fac206be-1f1d-4069-8b7d-ec551edfbd90","Type":"ContainerDied","Data":"051e2f928280386a951e5e89aa17caae34cc3c697924f76078561aa011dd50ae"}
Jul 17 10:00:34.872092 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:34.871923    2560 scope.go:117] "RemoveContainer" containerID="051e2f928280386a951e5e89aa17caae34cc3c697924f76078561aa011dd50ae"
Jul 17 10:00:35.877938 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:35.877853    2560 generic.go:356] "Generic (PLEG): container finished" podID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerID="453b404348fafe82aa5f2945f2a4f0995478a7461edc8e9394e4558515493eb6" exitCode=6
Jul 17 10:00:35.877938 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:35.877890    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc" event={"ID":"fac206be-1f1d-4069-8b7d-ec551edfbd90","Type":"ContainerDied","Data":"453b404348fafe82aa5f2945f2a4f0995478a7461edc8e9394e4558515493eb6"}
Jul 17 10:00:35.878375 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:35.877948    2560 scope.go:117] "RemoveContainer" containerID="051e2f928280386a951e5e89aa17caae34cc3c697924f76078561aa011dd50ae"
Jul 17 10:00:35.878375 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:35.878114    2560 scope.go:117] "RemoveContainer" containerID="453b404348fafe82aa5f2945f2a4f0995478a7461edc8e9394e4558515493eb6"
Jul 17 10:00:35.878375 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:00:35.878299    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc_odh-ai-gateway-infra(fac206be-1f1d-4069-8b7d-ec551edfbd90)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90"
Jul 17 10:00:36.883851 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:36.883825    2560 scope.go:117] "RemoveContainer" containerID="453b404348fafe82aa5f2945f2a4f0995478a7461edc8e9394e4558515493eb6"
Jul 17 10:00:36.884237 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:00:36.883987    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc_odh-ai-gateway-infra(fac206be-1f1d-4069-8b7d-ec551edfbd90)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90"
Jul 17 10:00:41.261206 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:41.261172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:48.239002 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:48.238941    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:51.180868 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:51.180840    2560 scope.go:117] "RemoveContainer" containerID="453b404348fafe82aa5f2945f2a4f0995478a7461edc8e9394e4558515493eb6"
Jul 17 10:00:51.507852 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:51.507729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:00:51.947361 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:51.947326    2560 generic.go:356] "Generic (PLEG): container finished" podID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerID="3e2a71b51c591a93071dfbfec12f55f3ddf92afd3f6d8f1d67cd357864e90c4d" exitCode=6
Jul 17 10:00:51.947543 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:51.947399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc" event={"ID":"fac206be-1f1d-4069-8b7d-ec551edfbd90","Type":"ContainerDied","Data":"3e2a71b51c591a93071dfbfec12f55f3ddf92afd3f6d8f1d67cd357864e90c4d"}
Jul 17 10:00:51.947543 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:51.947461    2560 scope.go:117] "RemoveContainer" containerID="453b404348fafe82aa5f2945f2a4f0995478a7461edc8e9394e4558515493eb6"
Jul 17 10:00:51.947855 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:51.947822    2560 scope.go:117] "RemoveContainer" containerID="3e2a71b51c591a93071dfbfec12f55f3ddf92afd3f6d8f1d67cd357864e90c4d"
Jul 17 10:00:51.948044 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:00:51.948019    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc_odh-ai-gateway-infra(fac206be-1f1d-4069-8b7d-ec551edfbd90)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90"
Jul 17 10:00:52.981581 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:52.981550    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"]
Jul 17 10:00:53.109175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:53.109152    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"
Jul 17 10:00:53.264838 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:53.264759    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac206be-1f1d-4069-8b7d-ec551edfbd90-maas-api-service-ca\") pod \"fac206be-1f1d-4069-8b7d-ec551edfbd90\" (UID: \"fac206be-1f1d-4069-8b7d-ec551edfbd90\") "
Jul 17 10:00:53.265163 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:53.265138    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fac206be-1f1d-4069-8b7d-ec551edfbd90-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fac206be-1f1d-4069-8b7d-ec551edfbd90" (UID: "fac206be-1f1d-4069-8b7d-ec551edfbd90"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:00:53.365893 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:53.365855    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac206be-1f1d-4069-8b7d-ec551edfbd90-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:00:53.958256 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:53.958217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc" event={"ID":"fac206be-1f1d-4069-8b7d-ec551edfbd90","Type":"ContainerDied","Data":"20637bc68318174a83eff194473eedd9f9eba570c43e1cf8944b79e458665e2d"}
Jul 17 10:00:53.958256 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:53.958245    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"
Jul 17 10:00:53.958521 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:53.958279    2560 scope.go:117] "RemoveContainer" containerID="3e2a71b51c591a93071dfbfec12f55f3ddf92afd3f6d8f1d67cd357864e90c4d"
Jul 17 10:00:53.981709 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:53.981685    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"]
Jul 17 10:00:53.986742 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:53.986721    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-5p6pc"]
Jul 17 10:00:55.189644 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:00:55.189608    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90" path="/var/lib/kubelet/pods/fac206be-1f1d-4069-8b7d-ec551edfbd90/volumes"
Jul 17 10:01:04.459143 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:04.459113    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:12.186379 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:12.186347    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:12.310853 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:12.310811    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:12.470270 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:12.470187    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:14.044744 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.044714    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"]
Jul 17 10:01:14.045175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.045031    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerName="revoke-keys"
Jul 17 10:01:14.045175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.045044    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerName="revoke-keys"
Jul 17 10:01:14.045175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.045057    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerName="revoke-keys"
Jul 17 10:01:14.045175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.045063    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f298cd9e-e438-471b-9d6a-66731c8c30d4" containerName="revoke-keys"
Jul 17 10:01:14.045175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.045069    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerName="revoke-keys"
Jul 17 10:01:14.045175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.045074    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerName="revoke-keys"
Jul 17 10:01:14.045175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.045085    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerName="revoke-keys"
Jul 17 10:01:14.045175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.045092    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerName="revoke-keys"
Jul 17 10:01:14.045175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.045145    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerName="revoke-keys"
Jul 17 10:01:14.045175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.045154    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f83cafcd-de45-4e3e-86be-4f0d7a32a94b" containerName="revoke-keys"
Jul 17 10:01:14.045175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.045161    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerName="revoke-keys"
Jul 17 10:01:14.048081 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.048064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"
Jul 17 10:01:14.051153 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.051131    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 10:01:14.052494 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.052476    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 10:01:14.065717 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.065692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"]
Jul 17 10:01:14.149872 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.149837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5\" (UID: \"76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"
Jul 17 10:01:14.250445 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.250409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5\" (UID: \"76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"
Jul 17 10:01:14.251053 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.251031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5\" (UID: \"76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"
Jul 17 10:01:14.357767 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.357695    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"
Jul 17 10:01:14.489963 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:14.489917    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"]
Jul 17 10:01:14.493136 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:01:14.493099    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ba857e_9d06_4c36_b0b0_64e2a7ccd9b0.slice/crio-ddd324986ed28b13445c0d5312da4b7fdb19430be52e0618107a60fe0135d343 WatchSource:0}: Error finding container ddd324986ed28b13445c0d5312da4b7fdb19430be52e0618107a60fe0135d343: Status 404 returned error can't find the container with id ddd324986ed28b13445c0d5312da4b7fdb19430be52e0618107a60fe0135d343
Jul 17 10:01:15.047826 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:15.047795    2560 generic.go:356] "Generic (PLEG): container finished" podID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerID="7de0d13018802b5d36bf86e4ac9f28ad362879f1099b79b2fd31073960810945" exitCode=6
Jul 17 10:01:15.048200 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:15.047883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5" event={"ID":"76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0","Type":"ContainerDied","Data":"7de0d13018802b5d36bf86e4ac9f28ad362879f1099b79b2fd31073960810945"}
Jul 17 10:01:15.048200 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:15.047932    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5" event={"ID":"76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0","Type":"ContainerStarted","Data":"ddd324986ed28b13445c0d5312da4b7fdb19430be52e0618107a60fe0135d343"}
Jul 17 10:01:15.048200 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:15.048040    2560 scope.go:117] "RemoveContainer" containerID="7de0d13018802b5d36bf86e4ac9f28ad362879f1099b79b2fd31073960810945"
Jul 17 10:01:16.054010 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:16.053926    2560 generic.go:356] "Generic (PLEG): container finished" podID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerID="543619fbf2fc522cce28ee80456a6a34c7e4092a17c81a75844462fde0e05787" exitCode=6
Jul 17 10:01:16.054419 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:16.054013    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5" event={"ID":"76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0","Type":"ContainerDied","Data":"543619fbf2fc522cce28ee80456a6a34c7e4092a17c81a75844462fde0e05787"}
Jul 17 10:01:16.054419 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:16.054073    2560 scope.go:117] "RemoveContainer" containerID="7de0d13018802b5d36bf86e4ac9f28ad362879f1099b79b2fd31073960810945"
Jul 17 10:01:16.054419 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:16.054270    2560 scope.go:117] "RemoveContainer" containerID="543619fbf2fc522cce28ee80456a6a34c7e4092a17c81a75844462fde0e05787"
Jul 17 10:01:16.054535 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:01:16.054476    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5_odh-ai-gateway-infra(76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0"
Jul 17 10:01:17.060515 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:17.060486    2560 scope.go:117] "RemoveContainer" containerID="543619fbf2fc522cce28ee80456a6a34c7e4092a17c81a75844462fde0e05787"
Jul 17 10:01:17.060920 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:01:17.060676    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5_odh-ai-gateway-infra(76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0"
Jul 17 10:01:22.935328 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:22.935287    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:23.899114 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:23.899065    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:29.183262 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:29.183233    2560 scope.go:117] "RemoveContainer" containerID="543619fbf2fc522cce28ee80456a6a34c7e4092a17c81a75844462fde0e05787"
Jul 17 10:01:30.117591 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:30.117504    2560 generic.go:356] "Generic (PLEG): container finished" podID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerID="3674e72ee96bb8b98de19bb5052d7894618e68d546199de3de634f98c8106882" exitCode=6
Jul 17 10:01:30.117591 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:30.117543    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5" event={"ID":"76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0","Type":"ContainerDied","Data":"3674e72ee96bb8b98de19bb5052d7894618e68d546199de3de634f98c8106882"}
Jul 17 10:01:30.117828 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:30.117599    2560 scope.go:117] "RemoveContainer" containerID="543619fbf2fc522cce28ee80456a6a34c7e4092a17c81a75844462fde0e05787"
Jul 17 10:01:30.117918 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:30.117902    2560 scope.go:117] "RemoveContainer" containerID="3674e72ee96bb8b98de19bb5052d7894618e68d546199de3de634f98c8106882"
Jul 17 10:01:30.118163 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:01:30.118138    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5_odh-ai-gateway-infra(76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0"
Jul 17 10:01:30.667438 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:30.667395    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:30.892084 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:30.892049    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:30.994697 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:30.994611    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:31.171186 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:31.171151    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"]
Jul 17 10:01:31.301896 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:31.301873    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"
Jul 17 10:01:31.397035 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:31.396993    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0-maas-api-service-ca\") pod \"76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0\" (UID: \"76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0\") "
Jul 17 10:01:31.397335 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:31.397313    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" (UID: "76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:01:31.498007 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:31.497977    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:01:31.775681 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:31.775640    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:31.874324 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:31.874291    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:31.974974 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:31.974940    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:32.129579 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.129499    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"
Jul 17 10:01:32.129736 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.129499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5" event={"ID":"76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0","Type":"ContainerDied","Data":"ddd324986ed28b13445c0d5312da4b7fdb19430be52e0618107a60fe0135d343"}
Jul 17 10:01:32.129736 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.129638    2560 scope.go:117] "RemoveContainer" containerID="3674e72ee96bb8b98de19bb5052d7894618e68d546199de3de634f98c8106882"
Jul 17 10:01:32.156381 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.156351    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"]
Jul 17 10:01:32.168937 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.168906    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-fv4l5"]
Jul 17 10:01:32.939532 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.939495    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"]
Jul 17 10:01:32.939953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.939790    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerName="revoke-keys"
Jul 17 10:01:32.939953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.939804    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerName="revoke-keys"
Jul 17 10:01:32.939953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.939824    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerName="revoke-keys"
Jul 17 10:01:32.939953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.939830    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerName="revoke-keys"
Jul 17 10:01:32.939953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.939841    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerName="revoke-keys"
Jul 17 10:01:32.939953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.939855    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerName="revoke-keys"
Jul 17 10:01:32.939953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.939907    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerName="revoke-keys"
Jul 17 10:01:32.939953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.939918    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerName="revoke-keys"
Jul 17 10:01:32.939953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.939927    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac206be-1f1d-4069-8b7d-ec551edfbd90" containerName="revoke-keys"
Jul 17 10:01:32.944018 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.943996    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"
Jul 17 10:01:32.947166 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.947146    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 10:01:32.947274 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.947148    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 10:01:32.952881 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:32.952846    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"]
Jul 17 10:01:33.011472 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:33.011430    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd\" (UID: \"3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"
Jul 17 10:01:33.112455 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:33.112414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd\" (UID: \"3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"
Jul 17 10:01:33.113069 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:33.113050    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd\" (UID: \"3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"
Jul 17 10:01:33.182757 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:33.182722    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" path="/var/lib/kubelet/pods/76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0/volumes"
Jul 17 10:01:33.255608 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:33.255514    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"
Jul 17 10:01:33.384260 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:33.384238    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"]
Jul 17 10:01:33.387366 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:01:33.387338    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c049ef9_cf4d_4a7e_bfd6_a8d6396025d7.slice/crio-0b1c23ea7af953413978ef45c4b51d60544a56f0f02d81144dc16b10c44c9662 WatchSource:0}: Error finding container 0b1c23ea7af953413978ef45c4b51d60544a56f0f02d81144dc16b10c44c9662: Status 404 returned error can't find the container with id 0b1c23ea7af953413978ef45c4b51d60544a56f0f02d81144dc16b10c44c9662
Jul 17 10:01:34.141300 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:34.141272    2560 generic.go:356] "Generic (PLEG): container finished" podID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerID="096abb22b15d9aef031dad9270bfeca7c63d90a5c62d4c0137032a0cdfbff010" exitCode=6
Jul 17 10:01:34.141677 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:34.141360    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd" event={"ID":"3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7","Type":"ContainerDied","Data":"096abb22b15d9aef031dad9270bfeca7c63d90a5c62d4c0137032a0cdfbff010"}
Jul 17 10:01:34.141677 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:34.141407    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd" event={"ID":"3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7","Type":"ContainerStarted","Data":"0b1c23ea7af953413978ef45c4b51d60544a56f0f02d81144dc16b10c44c9662"}
Jul 17 10:01:34.141677 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:34.141536    2560 scope.go:117] "RemoveContainer" containerID="096abb22b15d9aef031dad9270bfeca7c63d90a5c62d4c0137032a0cdfbff010"
Jul 17 10:01:34.260265 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:34.260195    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:01:35.147620 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:35.147589    2560 generic.go:356] "Generic (PLEG): container finished" podID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerID="92bde18cb2284244a267815a5bdf47bbe205fb3a6f136e3b00ec4e75b9ff20c8" exitCode=6
Jul 17 10:01:35.148089 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:35.147673    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd" event={"ID":"3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7","Type":"ContainerDied","Data":"92bde18cb2284244a267815a5bdf47bbe205fb3a6f136e3b00ec4e75b9ff20c8"}
Jul 17 10:01:35.148089 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:35.147726    2560 scope.go:117] "RemoveContainer" containerID="096abb22b15d9aef031dad9270bfeca7c63d90a5c62d4c0137032a0cdfbff010"
Jul 17 10:01:35.148089 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:35.147948    2560 scope.go:117] "RemoveContainer" containerID="92bde18cb2284244a267815a5bdf47bbe205fb3a6f136e3b00ec4e75b9ff20c8"
Jul 17 10:01:35.148217 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:01:35.148182    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd_odh-ai-gateway-infra(3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7"
Jul 17 10:01:36.153845 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:36.153819    2560 scope.go:117] "RemoveContainer" containerID="92bde18cb2284244a267815a5bdf47bbe205fb3a6f136e3b00ec4e75b9ff20c8"
Jul 17 10:01:36.154330 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:01:36.154021    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd_odh-ai-gateway-infra(3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7"
Jul 17 10:01:36.468579 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:36.468491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:40.621233 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:40.621198    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:40.739140 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:40.739106    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:41.316760 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:41.316723    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:43.748752 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:43.748717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:01:48.429097 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:48.429057    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:48.532905 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:48.532872    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:48.648173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:48.648131    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:48.989006 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:48.988972    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"]
Jul 17 10:01:48.989380 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:48.989362    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerName="revoke-keys"
Jul 17 10:01:48.989476 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:48.989382    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerName="revoke-keys"
Jul 17 10:01:48.989476 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:48.989463    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ba857e-9d06-4c36-b0b0-64e2a7ccd9b0" containerName="revoke-keys"
Jul 17 10:01:48.992216 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:48.992194    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:48.994737 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:48.994712    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0d3f0022-openshift-default-dockercfg-7ksk7\""
Jul 17 10:01:49.008047 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.008024    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"]
Jul 17 10:01:49.036702 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.036662    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:49.057802 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.057754    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-credential-socket\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.057802 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.057804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-certs\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.057979 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.057842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-socket\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.057979 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.057865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-envoy\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.057979 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.057883    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istiod-ca-cert\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.057979 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.057949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxjfq\" (UniqueName: \"kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-kube-api-access-qxjfq\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.057979 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.057978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-podinfo\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.058213 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.058009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-data\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.058213 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.058123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-token\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.134261 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.134185    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:49.158919 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.158884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-podinfo\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159072 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.158936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-data\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159072 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.159001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-token\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159072 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.159033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-credential-socket\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159072 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.159054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-certs\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159292 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.159084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-socket\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159292 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.159112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-envoy\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159292 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.159138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istiod-ca-cert\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159292 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.159194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxjfq\" (UniqueName: \"kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-kube-api-access-qxjfq\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159495 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.159464    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-data\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159495 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.159480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-credential-socket\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159607 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.159580    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-socket\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.159663 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.159603    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-certs\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.160037 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.160018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istiod-ca-cert\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.161669 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.161636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-envoy\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.162127 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.162100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-podinfo\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.169253 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.169229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-token\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.169561 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.169540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxjfq\" (UniqueName: \"kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-kube-api-access-qxjfq\") pod \"e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") " pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.178456 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.178436    2560 scope.go:117] "RemoveContainer" containerID="92bde18cb2284244a267815a5bdf47bbe205fb3a6f136e3b00ec4e75b9ff20c8"
Jul 17 10:01:49.302898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.302823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:49.460914 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.460884    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"]
Jul 17 10:01:49.464001 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:01:49.463973    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3adbac_7924_44a0_ac97_c6fe69319cdb.slice/crio-bdf2fd2377e5fccbf13a960dbbe6dcd9e996de6ab7b606acce03e850d2811370 WatchSource:0}: Error finding container bdf2fd2377e5fccbf13a960dbbe6dcd9e996de6ab7b606acce03e850d2811370: Status 404 returned error can't find the container with id bdf2fd2377e5fccbf13a960dbbe6dcd9e996de6ab7b606acce03e850d2811370
Jul 17 10:01:49.466310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.466278    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:01:49.466396 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.466345    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:01:49.466396 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:49.466373    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:01:50.222987 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:50.222952    2560 generic.go:356] "Generic (PLEG): container finished" podID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerID="3a58978a8eeae785bf7f7dee7f0c93f7e2518aadb386d96edebbf59eaeb5e89e" exitCode=6
Jul 17 10:01:50.223176 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:50.223023    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd" event={"ID":"3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7","Type":"ContainerDied","Data":"3a58978a8eeae785bf7f7dee7f0c93f7e2518aadb386d96edebbf59eaeb5e89e"}
Jul 17 10:01:50.223176 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:50.223121    2560 scope.go:117] "RemoveContainer" containerID="92bde18cb2284244a267815a5bdf47bbe205fb3a6f136e3b00ec4e75b9ff20c8"
Jul 17 10:01:50.223444 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:50.223422    2560 scope.go:117] "RemoveContainer" containerID="3a58978a8eeae785bf7f7dee7f0c93f7e2518aadb386d96edebbf59eaeb5e89e"
Jul 17 10:01:50.223669 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:01:50.223645    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd_odh-ai-gateway-infra(3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7"
Jul 17 10:01:50.224833 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:50.224810    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" event={"ID":"ef3adbac-7924-44a0-ac97-c6fe69319cdb","Type":"ContainerStarted","Data":"87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052"}
Jul 17 10:01:50.224932 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:50.224853    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" event={"ID":"ef3adbac-7924-44a0-ac97-c6fe69319cdb","Type":"ContainerStarted","Data":"bdf2fd2377e5fccbf13a960dbbe6dcd9e996de6ab7b606acce03e850d2811370"}
Jul 17 10:01:50.283441 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:50.283392    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" podStartSLOduration=2.283377057 podStartE2EDuration="2.283377057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:50.282411429 +0000 UTC m=+2629.774105836" watchObservedRunningTime="2026-07-17 10:01:50.283377057 +0000 UTC m=+2629.775071459"
Jul 17 10:01:50.303175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:50.303144    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:50.308131 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:50.308106    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:51.230517 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:51.230485    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:51.231414 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:51.231394    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:01:51.257881 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:51.257855    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"]
Jul 17 10:01:51.397460 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:51.397432    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"
Jul 17 10:01:51.479842 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:51.479810    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7-maas-api-service-ca\") pod \"3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7\" (UID: \"3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7\") "
Jul 17 10:01:51.480191 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:51.480165    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" (UID: "3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:01:51.581058 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:51.580973    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:01:52.236142 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:52.236106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd" event={"ID":"3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7","Type":"ContainerDied","Data":"0b1c23ea7af953413978ef45c4b51d60544a56f0f02d81144dc16b10c44c9662"}
Jul 17 10:01:52.236142 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:52.236126    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"
Jul 17 10:01:52.236678 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:52.236176    2560 scope.go:117] "RemoveContainer" containerID="3a58978a8eeae785bf7f7dee7f0c93f7e2518aadb386d96edebbf59eaeb5e89e"
Jul 17 10:01:52.277489 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:52.277460    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"]
Jul 17 10:01:52.288439 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:52.288413    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-8cszd"]
Jul 17 10:01:52.350880 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:52.350849    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:52.536964 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:52.536864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:52.636546 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:52.636512    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:52.912613 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:52.912579    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:53.184518 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:53.184432    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" path="/var/lib/kubelet/pods/3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7/volumes"
Jul 17 10:01:53.239869 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:53.239829    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:53.332660 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:53.332623    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:56.785660 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:56.785602    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:57.423756 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:57.423720    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:57.462733 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:57.462700    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:01:57.525254 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:57.525213    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:01:57.847837 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:01:57.847742    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:04.708430 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:04.708390    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:04.809646 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:04.809610    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:07.271973 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:07.271919    2560 patch_prober.go:28] interesting pod/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 10:02:07.272603 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:07.272000    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 10:02:08.314002 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:08.313969    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerID="87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052" exitCode=0
Jul 17 10:02:08.314428 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:08.314023    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" event={"ID":"ef3adbac-7924-44a0-ac97-c6fe69319cdb","Type":"ContainerDied","Data":"87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052"}
Jul 17 10:02:08.314428 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:08.314392    2560 scope.go:117] "RemoveContainer" containerID="87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052"
Jul 17 10:02:08.315379 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:08.315350    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:02:08.315461 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:08.315434    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:02:08.315510 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:08.315496    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:02:09.320676 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:09.320639    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" event={"ID":"ef3adbac-7924-44a0-ac97-c6fe69319cdb","Type":"ContainerStarted","Data":"ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888"}
Jul 17 10:02:10.303985 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:10.303893    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:02:10.304214 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:10.304180    2560 patch_prober.go:28] interesting pod/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 17 10:02:10.304623 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:10.304590    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 17 10:02:11.304354 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:11.304306    2560 patch_prober.go:28] interesting pod/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 17 10:02:11.304894 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:11.304382    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 17 10:02:12.304292 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:12.304251    2560 patch_prober.go:28] interesting pod/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 17 10:02:12.304507 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:12.304317    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 17 10:02:13.306733 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:13.306702    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:02:13.307132 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:13.307092    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:02:13.307823 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:13.307800    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:02:15.617061 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:15.617016    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:18.559849 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:18.559809    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:02:20.233645 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:20.233606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:27.113862 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:27.113828    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:27.214238 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:27.214204    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:31.415439 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:31.415408    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"]
Jul 17 10:02:31.415922 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:31.415616    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerName="istio-proxy" containerID="cri-o://ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888" gracePeriod=30
Jul 17 10:02:31.463723 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:31.463689    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:31.689735 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:31.689643    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:31.857461 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:31.857428    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:31.959993 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:31.959912    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:32.104179 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:32.104134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:36.666415 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.666388    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:02:36.687820 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.687754    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-data\") pod \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") "
Jul 17 10:02:36.687820 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.687802    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-envoy\") pod \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") "
Jul 17 10:02:36.687975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.687833    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-credential-socket\") pod \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") "
Jul 17 10:02:36.687975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.687851    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-socket\") pod \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") "
Jul 17 10:02:36.687975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.687876    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istiod-ca-cert\") pod \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") "
Jul 17 10:02:36.687975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.687893    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxjfq\" (UniqueName: \"kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-kube-api-access-qxjfq\") pod \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") "
Jul 17 10:02:36.687975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.687911    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-certs\") pod \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") "
Jul 17 10:02:36.688225 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.688108    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ef3adbac-7924-44a0-ac97-c6fe69319cdb" (UID: "ef3adbac-7924-44a0-ac97-c6fe69319cdb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:02:36.688225 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.688128    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ef3adbac-7924-44a0-ac97-c6fe69319cdb" (UID: "ef3adbac-7924-44a0-ac97-c6fe69319cdb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:02:36.688225 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.688156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-token\") pod \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") "
Jul 17 10:02:36.688372 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.688233    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-podinfo\") pod \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\" (UID: \"ef3adbac-7924-44a0-ac97-c6fe69319cdb\") "
Jul 17 10:02:36.688424 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.688385    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ef3adbac-7924-44a0-ac97-c6fe69319cdb" (UID: "ef3adbac-7924-44a0-ac97-c6fe69319cdb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:02:36.688573 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.688526    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-credential-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:02:36.688573 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.688537    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-data" (OuterVolumeSpecName: "istio-data") pod "ef3adbac-7924-44a0-ac97-c6fe69319cdb" (UID: "ef3adbac-7924-44a0-ac97-c6fe69319cdb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:02:36.688573 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.688544    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:02:36.688573 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.688561    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ef3adbac-7924-44a0-ac97-c6fe69319cdb" (UID: "ef3adbac-7924-44a0-ac97-c6fe69319cdb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:02:36.688754 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.688580    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-workload-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:02:36.690068 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.690040    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ef3adbac-7924-44a0-ac97-c6fe69319cdb" (UID: "ef3adbac-7924-44a0-ac97-c6fe69319cdb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:02:36.690234 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.690216    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-token" (OuterVolumeSpecName: "istio-token") pod "ef3adbac-7924-44a0-ac97-c6fe69319cdb" (UID: "ef3adbac-7924-44a0-ac97-c6fe69319cdb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:02:36.690755 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.690728    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ef3adbac-7924-44a0-ac97-c6fe69319cdb" (UID: "ef3adbac-7924-44a0-ac97-c6fe69319cdb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 10:02:36.690755 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.690727    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-kube-api-access-qxjfq" (OuterVolumeSpecName: "kube-api-access-qxjfq") pod "ef3adbac-7924-44a0-ac97-c6fe69319cdb" (UID: "ef3adbac-7924-44a0-ac97-c6fe69319cdb"). InnerVolumeSpecName "kube-api-access-qxjfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:02:36.789296 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.789261    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-token\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:02:36.789296 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.789292    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-podinfo\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:02:36.789296 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.789301    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-data\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:02:36.789522 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.789310    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istio-envoy\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:02:36.789522 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.789321    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef3adbac-7924-44a0-ac97-c6fe69319cdb-istiod-ca-cert\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:02:36.789522 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:36.789329    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxjfq\" (UniqueName: \"kubernetes.io/projected/ef3adbac-7924-44a0-ac97-c6fe69319cdb-kube-api-access-qxjfq\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:02:37.443255 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.443168    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerID="ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888" exitCode=0
Jul 17 10:02:37.443255 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.443219    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"
Jul 17 10:02:37.443443 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.443258    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" event={"ID":"ef3adbac-7924-44a0-ac97-c6fe69319cdb","Type":"ContainerDied","Data":"ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888"}
Jul 17 10:02:37.443443 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.443311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm" event={"ID":"ef3adbac-7924-44a0-ac97-c6fe69319cdb","Type":"ContainerDied","Data":"bdf2fd2377e5fccbf13a960dbbe6dcd9e996de6ab7b606acce03e850d2811370"}
Jul 17 10:02:37.443443 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.443335    2560 scope.go:117] "RemoveContainer" containerID="ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888"
Jul 17 10:02:37.451488 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.451469    2560 scope.go:117] "RemoveContainer" containerID="87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052"
Jul 17 10:02:37.458822 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.458761    2560 scope.go:117] "RemoveContainer" containerID="ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888"
Jul 17 10:02:37.459124 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:02:37.459102    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888\": container with ID starting with ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888 not found: ID does not exist" containerID="ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888"
Jul 17 10:02:37.459168 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.459134    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888"} err="failed to get container status \"ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888\": rpc error: code = NotFound desc = could not find container \"ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888\": container with ID starting with ac8a35572f730f085ddd70610cc743348c4a611b651a306c76f4742216cbe888 not found: ID does not exist"
Jul 17 10:02:37.459168 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.459150    2560 scope.go:117] "RemoveContainer" containerID="87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052"
Jul 17 10:02:37.459368 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:02:37.459350    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052\": container with ID starting with 87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052 not found: ID does not exist" containerID="87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052"
Jul 17 10:02:37.459411 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.459375    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052"} err="failed to get container status \"87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052\": rpc error: code = NotFound desc = could not find container \"87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052\": container with ID starting with 87940d65914e7c482d88dd7c5785fbd80b18b4850a8ef3e7e6a5471f0a3bb052 not found: ID does not exist"
Jul 17 10:02:37.470300 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.470280    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"]
Jul 17 10:02:37.476376 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:37.476344    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0d3f0022-openshift-default-f84f894ff-7vlxm"]
Jul 17 10:02:38.932328 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:38.932288    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:39.044084 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:39.044045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:39.143276 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:39.143239    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:39.183176 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:39.183104    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" path="/var/lib/kubelet/pods/ef3adbac-7924-44a0-ac97-c6fe69319cdb/volumes"
Jul 17 10:02:39.305855 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:39.305823    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:45.677980 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:45.677945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:45.784597 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:45.784565    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:52.599168 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.599129    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:52.884424 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884339    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"]
Jul 17 10:02:52.884658 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884646    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerName="istio-proxy"
Jul 17 10:02:52.884709 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884659    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerName="istio-proxy"
Jul 17 10:02:52.884709 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884670    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerName="revoke-keys"
Jul 17 10:02:52.884709 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884675    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerName="revoke-keys"
Jul 17 10:02:52.884709 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884685    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerName="revoke-keys"
Jul 17 10:02:52.884709 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884691    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerName="revoke-keys"
Jul 17 10:02:52.884709 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884699    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerName="revoke-keys"
Jul 17 10:02:52.884709 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884704    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerName="revoke-keys"
Jul 17 10:02:52.884975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884753    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerName="revoke-keys"
Jul 17 10:02:52.884975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884764    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerName="istio-proxy"
Jul 17 10:02:52.884975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884771    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerName="revoke-keys"
Jul 17 10:02:52.884975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.884791    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerName="istio-proxy"
Jul 17 10:02:52.887690 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.887666    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:52.894097 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.894062    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-43c677b2-openshift-default-dockercfg-mht8m\""
Jul 17 10:02:52.903771 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.903698    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"]
Jul 17 10:02:52.940798 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:52.940307    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:53.031701 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.031665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-socket\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.031906 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.031709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-envoy\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.031906 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.031735    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-podinfo\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.031906 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.031760    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqb9g\" (UniqueName: \"kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-kube-api-access-hqb9g\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.031906 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.031818    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-credential-socket\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.031906 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.031872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-data\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.031906 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.031906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istiod-ca-cert\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.032131 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.031937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-token\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.032131 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.031972    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-certs\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.132621 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.132580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-socket\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.132833 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.132638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-envoy\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.132833 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.132667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-podinfo\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.132833 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.132692    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqb9g\" (UniqueName: \"kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-kube-api-access-hqb9g\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.133023 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.132836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-credential-socket\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.133023 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.132885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-data\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.133023 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.132923    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istiod-ca-cert\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.133023 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.132972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-token\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.133023 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.132998    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-certs\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.133298 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.133219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-socket\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.133298 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.133258    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-credential-socket\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.133460 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.133403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-data\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.133531 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.133503    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-certs\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.133889 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.133863    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istiod-ca-cert\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.135176 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.135125    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-envoy\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.135359 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.135343    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-podinfo\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.142888 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.142860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-token\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.143054 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.143028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqb9g\" (UniqueName: \"kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-kube-api-access-hqb9g\") pod \"e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") " pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.199344 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.199309    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:53.200401 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.200354    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:53.343457 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.343430    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"]
Jul 17 10:02:53.345964 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:02:53.345936    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f548d55_3252_4f5a_ae74_7fa1c24faf1b.slice/crio-3d52766c1685d61755b5d6fa86af05d4bd537e869493d964c4e48a98ccee985e WatchSource:0}: Error finding container 3d52766c1685d61755b5d6fa86af05d4bd537e869493d964c4e48a98ccee985e: Status 404 returned error can't find the container with id 3d52766c1685d61755b5d6fa86af05d4bd537e869493d964c4e48a98ccee985e
Jul 17 10:02:53.348389 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.348352    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:02:53.348476 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.348431    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:02:53.348476 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.348465    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:02:53.516156 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.516113    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" event={"ID":"0f548d55-3252-4f5a-ae74-7fa1c24faf1b","Type":"ContainerStarted","Data":"b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf"}
Jul 17 10:02:53.516345 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.516184    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" event={"ID":"0f548d55-3252-4f5a-ae74-7fa1c24faf1b","Type":"ContainerStarted","Data":"3d52766c1685d61755b5d6fa86af05d4bd537e869493d964c4e48a98ccee985e"}
Jul 17 10:02:53.557587 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:53.557527    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" podStartSLOduration=1.557508244 podStartE2EDuration="1.557508244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:02:53.553278772 +0000 UTC m=+2693.044973178" watchObservedRunningTime="2026-07-17 10:02:53.557508244 +0000 UTC m=+2693.049202650"
Jul 17 10:02:54.199969 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:54.199929    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:54.204571 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:54.204546    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:54.524430 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:54.524339    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:54.525365 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:54.525339    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:02:55.583744 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:55.583700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:55.680989 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:55.680953    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:55.865061 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:55.864969    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:56.037242 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:56.037205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:56.380236 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:56.380196    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:56.482018 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:56.481979    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:02:58.759026 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:02:58.758984    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:03:00.005533 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:00.005464    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:03:06.580635 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:06.580552    2560 generic.go:356] "Generic (PLEG): container finished" podID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerID="b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf" exitCode=0
Jul 17 10:03:06.581094 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:06.580628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" event={"ID":"0f548d55-3252-4f5a-ae74-7fa1c24faf1b","Type":"ContainerDied","Data":"b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf"}
Jul 17 10:03:06.581139 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:06.581108    2560 scope.go:117] "RemoveContainer" containerID="b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf"
Jul 17 10:03:06.582122 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:06.582083    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:03:06.582266 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:06.582155    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:03:06.582266 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:06.582190    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:03:07.589940 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:07.589899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" event={"ID":"0f548d55-3252-4f5a-ae74-7fa1c24faf1b","Type":"ContainerStarted","Data":"eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87"}
Jul 17 10:03:08.200336 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:08.200298    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:03:08.201559 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:08.201526    2560 patch_prober.go:28] interesting pod/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 10:03:08.201691 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:08.201621    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 10:03:09.199736 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:09.199692    2560 patch_prober.go:28] interesting pod/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 10:03:09.200264 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:09.199757    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 10:03:09.525152 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:09.525062    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:03:10.206392 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:10.206325    2560 patch_prober.go:28] interesting pod/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 10:03:10.206993 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:10.206412    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 10:03:11.200762 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:11.200725    2560 patch_prober.go:28] interesting pod/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 17 10:03:11.201084 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:11.201053    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 17 10:03:12.204136 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:12.204105    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:03:12.204996 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:12.204978    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:03:20.711209 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:20.711177    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:03:24.150296 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:24.150256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:03:40.144473 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:40.144438    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:03:53.159984 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:53.159930    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:03:53.257560 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:53.257527    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:03:53.406047 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:53.406014    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:03:57.146815 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:57.146766    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:03:58.365439 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:03:58.365403    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:03.443706 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:03.443666    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:40.924083 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:40.924007    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:41.130277 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:41.130241    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:48.392624 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:48.392589    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:48.523299 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:48.523260    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:50.001967 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:50.001936    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:51.045002 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:51.044969    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"]
Jul 17 10:04:51.045480 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:51.045167    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerName="istio-proxy" containerID="cri-o://eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87" gracePeriod=30
Jul 17 10:04:51.075233 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:51.075208    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:51.292535 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:51.292497    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:52.402821 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:52.402789    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:52.518600 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:52.518568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:52.630020 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:52.629989    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:53.570877 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:53.570840    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:53.691974 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:53.691941    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:55.271364 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:55.271331    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:04:55.781685 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:55.781647    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:04:56.297883 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.297860    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:04:56.314013 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.313944    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-token\") pod \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") "
Jul 17 10:04:56.314013 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.313982    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-certs\") pod \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") "
Jul 17 10:04:56.314217 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314073    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-data\") pod \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") "
Jul 17 10:04:56.314217 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-socket\") pod \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") "
Jul 17 10:04:56.314217 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314144    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqb9g\" (UniqueName: \"kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-kube-api-access-hqb9g\") pod \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") "
Jul 17 10:04:56.314217 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314195    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istiod-ca-cert\") pod \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") "
Jul 17 10:04:56.314438 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314235    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-podinfo\") pod \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") "
Jul 17 10:04:56.314438 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314238    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f548d55-3252-4f5a-ae74-7fa1c24faf1b" (UID: "0f548d55-3252-4f5a-ae74-7fa1c24faf1b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:04:56.314438 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314261    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-credential-socket\") pod \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") "
Jul 17 10:04:56.314438 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314312    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-envoy\") pod \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\" (UID: \"0f548d55-3252-4f5a-ae74-7fa1c24faf1b\") "
Jul 17 10:04:56.314438 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314357    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f548d55-3252-4f5a-ae74-7fa1c24faf1b" (UID: "0f548d55-3252-4f5a-ae74-7fa1c24faf1b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:04:56.314705 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314636    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:04:56.314705 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314655    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-workload-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:04:56.314705 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314585    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f548d55-3252-4f5a-ae74-7fa1c24faf1b" (UID: "0f548d55-3252-4f5a-ae74-7fa1c24faf1b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:04:56.314847 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314688    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f548d55-3252-4f5a-ae74-7fa1c24faf1b" (UID: "0f548d55-3252-4f5a-ae74-7fa1c24faf1b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:04:56.314847 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.314828    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f548d55-3252-4f5a-ae74-7fa1c24faf1b" (UID: "0f548d55-3252-4f5a-ae74-7fa1c24faf1b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:04:56.316553 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.316524    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f548d55-3252-4f5a-ae74-7fa1c24faf1b" (UID: "0f548d55-3252-4f5a-ae74-7fa1c24faf1b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:04:56.316636 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.316603    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-kube-api-access-hqb9g" (OuterVolumeSpecName: "kube-api-access-hqb9g") pod "0f548d55-3252-4f5a-ae74-7fa1c24faf1b" (UID: "0f548d55-3252-4f5a-ae74-7fa1c24faf1b"). InnerVolumeSpecName "kube-api-access-hqb9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:04:56.316636 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.316621    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f548d55-3252-4f5a-ae74-7fa1c24faf1b" (UID: "0f548d55-3252-4f5a-ae74-7fa1c24faf1b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 10:04:56.316733 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.316693    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f548d55-3252-4f5a-ae74-7fa1c24faf1b" (UID: "0f548d55-3252-4f5a-ae74-7fa1c24faf1b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:04:56.415302 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.415274    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-token\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:04:56.415302 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.415299    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-data\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:04:56.415495 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.415309    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqb9g\" (UniqueName: \"kubernetes.io/projected/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-kube-api-access-hqb9g\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:04:56.415495 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.415320    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istiod-ca-cert\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:04:56.415495 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.415330    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-podinfo\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:04:56.415495 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.415338    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-credential-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:04:56.415495 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:56.415346    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f548d55-3252-4f5a-ae74-7fa1c24faf1b-istio-envoy\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:04:57.071904 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.071829    2560 generic.go:356] "Generic (PLEG): container finished" podID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerID="eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87" exitCode=0
Jul 17 10:04:57.071904 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.071896    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"
Jul 17 10:04:57.072183 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.071925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" event={"ID":"0f548d55-3252-4f5a-ae74-7fa1c24faf1b","Type":"ContainerDied","Data":"eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87"}
Jul 17 10:04:57.072183 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.071994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv" event={"ID":"0f548d55-3252-4f5a-ae74-7fa1c24faf1b","Type":"ContainerDied","Data":"3d52766c1685d61755b5d6fa86af05d4bd537e869493d964c4e48a98ccee985e"}
Jul 17 10:04:57.072183 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.072022    2560 scope.go:117] "RemoveContainer" containerID="eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87"
Jul 17 10:04:57.082399 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.082358    2560 scope.go:117] "RemoveContainer" containerID="b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf"
Jul 17 10:04:57.093463 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.093446    2560 scope.go:117] "RemoveContainer" containerID="eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87"
Jul 17 10:04:57.093702 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:04:57.093683    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87\": container with ID starting with eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87 not found: ID does not exist" containerID="eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87"
Jul 17 10:04:57.093762 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.093709    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87"} err="failed to get container status \"eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87\": rpc error: code = NotFound desc = could not find container \"eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87\": container with ID starting with eb39e839b3fc417eb0359312e916ec9947a718f0c82856ca304c64661fae3b87 not found: ID does not exist"
Jul 17 10:04:57.093762 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.093729    2560 scope.go:117] "RemoveContainer" containerID="b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf"
Jul 17 10:04:57.094015 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:04:57.093988    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf\": container with ID starting with b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf not found: ID does not exist" containerID="b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf"
Jul 17 10:04:57.094078 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.094026    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf"} err="failed to get container status \"b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf\": rpc error: code = NotFound desc = could not find container \"b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf\": container with ID starting with b70303f92e86b0ce24d8cdc941d0183a3af684122fa7cdbe3e8b1a79e76f4ddf not found: ID does not exist"
Jul 17 10:04:57.130628 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.130601    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"]
Jul 17 10:04:57.139765 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.139734    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-43c677b2-openshift-default-655df96cc5-2f2dv"]
Jul 17 10:04:57.185282 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:04:57.185242    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" path="/var/lib/kubelet/pods/0f548d55-3252-4f5a-ae74-7fa1c24faf1b/volumes"
Jul 17 10:05:03.090572 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:03.090523    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:03.190831 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:03.190798    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:03.821976 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:03.821924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:08.153989 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:08.153954    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:05:08.335508 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:08.335449    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:10.377108 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:10.377066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:10.511457 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:10.511379    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:10.628064 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:10.628035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:10.733116 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:10.733072    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:15.641379 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.641344    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"]
Jul 17 10:05:15.641920 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.641663    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerName="istio-proxy"
Jul 17 10:05:15.641920 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.641675    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef3adbac-7924-44a0-ac97-c6fe69319cdb" containerName="istio-proxy"
Jul 17 10:05:15.641920 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.641685    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerName="istio-proxy"
Jul 17 10:05:15.641920 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.641693    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerName="istio-proxy"
Jul 17 10:05:15.641920 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.641702    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerName="istio-proxy"
Jul 17 10:05:15.641920 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.641708    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerName="istio-proxy"
Jul 17 10:05:15.641920 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.641756    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerName="istio-proxy"
Jul 17 10:05:15.641920 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.641771    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c049ef9-cf4d-4a7e-bfd6-a8d6396025d7" containerName="revoke-keys"
Jul 17 10:05:15.644904 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.644885    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"
Jul 17 10:05:15.647501 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.647473    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 10:05:15.647613 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.647476    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 10:05:15.653419 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.653397    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"]
Jul 17 10:05:15.790396 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.790358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e294ec-08e3-4b74-82e4-b087ed7a2813-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd\" (UID: \"86e294ec-08e3-4b74-82e4-b087ed7a2813\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"
Jul 17 10:05:15.891840 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.891738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e294ec-08e3-4b74-82e4-b087ed7a2813-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd\" (UID: \"86e294ec-08e3-4b74-82e4-b087ed7a2813\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"
Jul 17 10:05:15.892374 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.892353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e294ec-08e3-4b74-82e4-b087ed7a2813-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd\" (UID: \"86e294ec-08e3-4b74-82e4-b087ed7a2813\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"
Jul 17 10:05:15.955033 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:15.955001    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"
Jul 17 10:05:16.085294 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:16.085256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"]
Jul 17 10:05:16.088402 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:05:16.088371    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e294ec_08e3_4b74_82e4_b087ed7a2813.slice/crio-bcf80c826f558d2bd39a15e5cc8136255d0caa357d6dd500f437814c272d2aac WatchSource:0}: Error finding container bcf80c826f558d2bd39a15e5cc8136255d0caa357d6dd500f437814c272d2aac: Status 404 returned error can't find the container with id bcf80c826f558d2bd39a15e5cc8136255d0caa357d6dd500f437814c272d2aac
Jul 17 10:05:16.154570 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:16.154497    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd" event={"ID":"86e294ec-08e3-4b74-82e4-b087ed7a2813","Type":"ContainerStarted","Data":"bcf80c826f558d2bd39a15e5cc8136255d0caa357d6dd500f437814c272d2aac"}
Jul 17 10:05:17.160286 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:17.160253    2560 generic.go:356] "Generic (PLEG): container finished" podID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerID="6025ae129e918416045b9e0888d8366f07656b135c0dfa18b467cc11b6f7d023" exitCode=6
Jul 17 10:05:17.160680 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:17.160338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd" event={"ID":"86e294ec-08e3-4b74-82e4-b087ed7a2813","Type":"ContainerDied","Data":"6025ae129e918416045b9e0888d8366f07656b135c0dfa18b467cc11b6f7d023"}
Jul 17 10:05:17.160680 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:17.160489    2560 scope.go:117] "RemoveContainer" containerID="6025ae129e918416045b9e0888d8366f07656b135c0dfa18b467cc11b6f7d023"
Jul 17 10:05:18.166652 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:18.166616    2560 generic.go:356] "Generic (PLEG): container finished" podID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerID="561a7e9de2544b89da920dc28be5e5d0bf5f1480636115c6b130037e9c7cadc0" exitCode=6
Jul 17 10:05:18.167070 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:18.166658    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd" event={"ID":"86e294ec-08e3-4b74-82e4-b087ed7a2813","Type":"ContainerDied","Data":"561a7e9de2544b89da920dc28be5e5d0bf5f1480636115c6b130037e9c7cadc0"}
Jul 17 10:05:18.167070 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:18.166718    2560 scope.go:117] "RemoveContainer" containerID="6025ae129e918416045b9e0888d8366f07656b135c0dfa18b467cc11b6f7d023"
Jul 17 10:05:18.167070 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:18.166930    2560 scope.go:117] "RemoveContainer" containerID="561a7e9de2544b89da920dc28be5e5d0bf5f1480636115c6b130037e9c7cadc0"
Jul 17 10:05:18.167206 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:05:18.167140    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd_odh-ai-gateway-infra(86e294ec-08e3-4b74-82e4-b087ed7a2813)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813"
Jul 17 10:05:19.172172 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:19.172147    2560 scope.go:117] "RemoveContainer" containerID="561a7e9de2544b89da920dc28be5e5d0bf5f1480636115c6b130037e9c7cadc0"
Jul 17 10:05:19.172549 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:05:19.172320    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd_odh-ai-gateway-infra(86e294ec-08e3-4b74-82e4-b087ed7a2813)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813"
Jul 17 10:05:21.189485 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:21.189449    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:21.523815 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:21.523703    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:30.178036 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:30.178011    2560 scope.go:117] "RemoveContainer" containerID="561a7e9de2544b89da920dc28be5e5d0bf5f1480636115c6b130037e9c7cadc0"
Jul 17 10:05:31.221276 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:31.221244    2560 generic.go:356] "Generic (PLEG): container finished" podID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerID="eda761d25cc03f0dd40590d8c2cfc661b0809464b17412b4c1d57cf467f620e7" exitCode=6
Jul 17 10:05:31.221682 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:31.221315    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd" event={"ID":"86e294ec-08e3-4b74-82e4-b087ed7a2813","Type":"ContainerDied","Data":"eda761d25cc03f0dd40590d8c2cfc661b0809464b17412b4c1d57cf467f620e7"}
Jul 17 10:05:31.221682 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:31.221374    2560 scope.go:117] "RemoveContainer" containerID="561a7e9de2544b89da920dc28be5e5d0bf5f1480636115c6b130037e9c7cadc0"
Jul 17 10:05:31.221682 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:31.221642    2560 scope.go:117] "RemoveContainer" containerID="eda761d25cc03f0dd40590d8c2cfc661b0809464b17412b4c1d57cf467f620e7"
Jul 17 10:05:31.221884 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:05:31.221858    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd_odh-ai-gateway-infra(86e294ec-08e3-4b74-82e4-b087ed7a2813)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813"
Jul 17 10:05:32.274219 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:32.274190    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"]
Jul 17 10:05:32.401891 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:32.401868    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"
Jul 17 10:05:32.528561 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:32.528496    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e294ec-08e3-4b74-82e4-b087ed7a2813-maas-api-service-ca\") pod \"86e294ec-08e3-4b74-82e4-b087ed7a2813\" (UID: \"86e294ec-08e3-4b74-82e4-b087ed7a2813\") "
Jul 17 10:05:32.528830 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:32.528810    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86e294ec-08e3-4b74-82e4-b087ed7a2813-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "86e294ec-08e3-4b74-82e4-b087ed7a2813" (UID: "86e294ec-08e3-4b74-82e4-b087ed7a2813"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:05:32.629471 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:32.629443    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e294ec-08e3-4b74-82e4-b087ed7a2813-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:05:33.231496 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:33.231461    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd" event={"ID":"86e294ec-08e3-4b74-82e4-b087ed7a2813","Type":"ContainerDied","Data":"bcf80c826f558d2bd39a15e5cc8136255d0caa357d6dd500f437814c272d2aac"}
Jul 17 10:05:33.231651 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:33.231520    2560 scope.go:117] "RemoveContainer" containerID="eda761d25cc03f0dd40590d8c2cfc661b0809464b17412b4c1d57cf467f620e7"
Jul 17 10:05:33.231651 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:33.231476    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"
Jul 17 10:05:33.255600 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:33.255576    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"]
Jul 17 10:05:33.259008 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:33.258978    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-gzvdd"]
Jul 17 10:05:34.306197 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.306168    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"]
Jul 17 10:05:34.306558 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.306468    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerName="revoke-keys"
Jul 17 10:05:34.306558 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.306480    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerName="revoke-keys"
Jul 17 10:05:34.306558 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.306495    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerName="revoke-keys"
Jul 17 10:05:34.306558 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.306501    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerName="revoke-keys"
Jul 17 10:05:34.306558 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.306547    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerName="revoke-keys"
Jul 17 10:05:34.306558 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.306555    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerName="revoke-keys"
Jul 17 10:05:34.306558 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.306561    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerName="revoke-keys"
Jul 17 10:05:34.306768 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.306568    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f548d55-3252-4f5a-ae74-7fa1c24faf1b" containerName="istio-proxy"
Jul 17 10:05:34.310553 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.310534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"
Jul 17 10:05:34.314328 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.314306    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 10:05:34.314456 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.314309    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 10:05:34.320038 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.320013    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"]
Jul 17 10:05:34.443452 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.443425    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d77bde15-442c-4247-af18-6401f4debe4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx\" (UID: \"d77bde15-442c-4247-af18-6401f4debe4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"
Jul 17 10:05:34.544142 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.544107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d77bde15-442c-4247-af18-6401f4debe4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx\" (UID: \"d77bde15-442c-4247-af18-6401f4debe4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"
Jul 17 10:05:34.544707 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.544687    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d77bde15-442c-4247-af18-6401f4debe4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx\" (UID: \"d77bde15-442c-4247-af18-6401f4debe4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"
Jul 17 10:05:34.620914 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.620841    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"
Jul 17 10:05:34.953709 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:34.953684    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"]
Jul 17 10:05:34.955471 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:05:34.955446    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77bde15_442c_4247_af18_6401f4debe4b.slice/crio-6b28499f988f4ef769cc6699cb0ff4ca9c97d1cac67cfb3e9b42ad744f354a9e WatchSource:0}: Error finding container 6b28499f988f4ef769cc6699cb0ff4ca9c97d1cac67cfb3e9b42ad744f354a9e: Status 404 returned error can't find the container with id 6b28499f988f4ef769cc6699cb0ff4ca9c97d1cac67cfb3e9b42ad744f354a9e
Jul 17 10:05:35.184441 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:35.184410    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813" path="/var/lib/kubelet/pods/86e294ec-08e3-4b74-82e4-b087ed7a2813/volumes"
Jul 17 10:05:35.248220 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:35.248187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx" event={"ID":"d77bde15-442c-4247-af18-6401f4debe4b","Type":"ContainerStarted","Data":"85525ea59e6d32a3a753d1ed2ade4ab0d5f5239ba59fc8326f5c532d488de915"}
Jul 17 10:05:35.248332 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:35.248243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx" event={"ID":"d77bde15-442c-4247-af18-6401f4debe4b","Type":"ContainerStarted","Data":"6b28499f988f4ef769cc6699cb0ff4ca9c97d1cac67cfb3e9b42ad744f354a9e"}
Jul 17 10:05:35.266041 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:35.266000    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx" podStartSLOduration=1.265985927 podStartE2EDuration="1.265985927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:05:35.265289219 +0000 UTC m=+2854.756983622" watchObservedRunningTime="2026-07-17 10:05:35.265985927 +0000 UTC m=+2854.757680345"
Jul 17 10:05:36.254136 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:36.254100    2560 generic.go:356] "Generic (PLEG): container finished" podID="d77bde15-442c-4247-af18-6401f4debe4b" containerID="85525ea59e6d32a3a753d1ed2ade4ab0d5f5239ba59fc8326f5c532d488de915" exitCode=6
Jul 17 10:05:36.254523 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:36.254178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx" event={"ID":"d77bde15-442c-4247-af18-6401f4debe4b","Type":"ContainerDied","Data":"85525ea59e6d32a3a753d1ed2ade4ab0d5f5239ba59fc8326f5c532d488de915"}
Jul 17 10:05:36.254523 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:36.254322    2560 scope.go:117] "RemoveContainer" containerID="85525ea59e6d32a3a753d1ed2ade4ab0d5f5239ba59fc8326f5c532d488de915"
Jul 17 10:05:37.260419 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:37.260387    2560 generic.go:356] "Generic (PLEG): container finished" podID="d77bde15-442c-4247-af18-6401f4debe4b" containerID="9428443befa5bc0062c08dc5b3cce3709f45a43e3382a97a0311153b4d2b534f" exitCode=6
Jul 17 10:05:37.260841 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:37.260473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx" event={"ID":"d77bde15-442c-4247-af18-6401f4debe4b","Type":"ContainerDied","Data":"9428443befa5bc0062c08dc5b3cce3709f45a43e3382a97a0311153b4d2b534f"}
Jul 17 10:05:37.260841 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:37.260527    2560 scope.go:117] "RemoveContainer" containerID="85525ea59e6d32a3a753d1ed2ade4ab0d5f5239ba59fc8326f5c532d488de915"
Jul 17 10:05:37.260841 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:37.260598    2560 scope.go:117] "RemoveContainer" containerID="9428443befa5bc0062c08dc5b3cce3709f45a43e3382a97a0311153b4d2b534f"
Jul 17 10:05:37.261030 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:05:37.260837    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx_odh-ai-gateway-infra(d77bde15-442c-4247-af18-6401f4debe4b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx" podUID="d77bde15-442c-4247-af18-6401f4debe4b"
Jul 17 10:05:38.266026 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:38.265998    2560 scope.go:117] "RemoveContainer" containerID="9428443befa5bc0062c08dc5b3cce3709f45a43e3382a97a0311153b4d2b534f"
Jul 17 10:05:38.266406 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:05:38.266184    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx_odh-ai-gateway-infra(d77bde15-442c-4247-af18-6401f4debe4b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx" podUID="d77bde15-442c-4247-af18-6401f4debe4b"
Jul 17 10:05:42.565555 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:42.565514    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:45.404034 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:45.404001    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"]
Jul 17 10:05:45.404403 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:45.404295    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerName="revoke-keys"
Jul 17 10:05:45.404403 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:45.404306    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e294ec-08e3-4b74-82e4-b087ed7a2813" containerName="revoke-keys"
Jul 17 10:05:45.407201 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:45.407184    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"
Jul 17 10:05:45.415748 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:45.415726    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"]
Jul 17 10:05:45.531245 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:45.531218    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63fb053e-a4c5-4dd4-acc2-8d1a387ae767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2\" (UID: \"63fb053e-a4c5-4dd4-acc2-8d1a387ae767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"
Jul 17 10:05:45.632706 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:45.632676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63fb053e-a4c5-4dd4-acc2-8d1a387ae767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2\" (UID: \"63fb053e-a4c5-4dd4-acc2-8d1a387ae767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"
Jul 17 10:05:45.633327 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:45.633308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63fb053e-a4c5-4dd4-acc2-8d1a387ae767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2\" (UID: \"63fb053e-a4c5-4dd4-acc2-8d1a387ae767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"
Jul 17 10:05:45.717243 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:45.717184    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"
Jul 17 10:05:45.841654 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:45.841624    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"]
Jul 17 10:05:45.845266 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:05:45.845242    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fb053e_a4c5_4dd4_acc2_8d1a387ae767.slice/crio-ea3a1d1bbd438f415b4aada15b0499436d64257fb64ac50e620867da4a77e0d5 WatchSource:0}: Error finding container ea3a1d1bbd438f415b4aada15b0499436d64257fb64ac50e620867da4a77e0d5: Status 404 returned error can't find the container with id ea3a1d1bbd438f415b4aada15b0499436d64257fb64ac50e620867da4a77e0d5
Jul 17 10:05:46.300142 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:46.300060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2" event={"ID":"63fb053e-a4c5-4dd4-acc2-8d1a387ae767","Type":"ContainerStarted","Data":"2c9c5ead16ea34b7e66daee51d05a9a9d925a7abed21215426ec866536255ff1"}
Jul 17 10:05:46.300265 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:46.300155    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2" event={"ID":"63fb053e-a4c5-4dd4-acc2-8d1a387ae767","Type":"ContainerStarted","Data":"ea3a1d1bbd438f415b4aada15b0499436d64257fb64ac50e620867da4a77e0d5"}
Jul 17 10:05:46.319426 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:46.319375    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2" podStartSLOduration=1.319361099 podStartE2EDuration="1.319361099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:05:46.318443317 +0000 UTC m=+2865.810137736" watchObservedRunningTime="2026-07-17 10:05:46.319361099 +0000 UTC m=+2865.811055503"
Jul 17 10:05:47.305869 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:47.305837    2560 generic.go:356] "Generic (PLEG): container finished" podID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerID="2c9c5ead16ea34b7e66daee51d05a9a9d925a7abed21215426ec866536255ff1" exitCode=6
Jul 17 10:05:47.306323 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:47.305883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2" event={"ID":"63fb053e-a4c5-4dd4-acc2-8d1a387ae767","Type":"ContainerDied","Data":"2c9c5ead16ea34b7e66daee51d05a9a9d925a7abed21215426ec866536255ff1"}
Jul 17 10:05:47.306323 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:47.306043    2560 scope.go:117] "RemoveContainer" containerID="2c9c5ead16ea34b7e66daee51d05a9a9d925a7abed21215426ec866536255ff1"
Jul 17 10:05:48.312668 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:48.312575    2560 generic.go:356] "Generic (PLEG): container finished" podID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerID="442e33539faf6b41385a8d0c7bf05d561b2e5e1b4abce5e511ce409045a53e02" exitCode=6
Jul 17 10:05:48.312668 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:48.312622    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2" event={"ID":"63fb053e-a4c5-4dd4-acc2-8d1a387ae767","Type":"ContainerDied","Data":"442e33539faf6b41385a8d0c7bf05d561b2e5e1b4abce5e511ce409045a53e02"}
Jul 17 10:05:48.313212 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:48.312682    2560 scope.go:117] "RemoveContainer" containerID="2c9c5ead16ea34b7e66daee51d05a9a9d925a7abed21215426ec866536255ff1"
Jul 17 10:05:48.313212 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:48.312882    2560 scope.go:117] "RemoveContainer" containerID="442e33539faf6b41385a8d0c7bf05d561b2e5e1b4abce5e511ce409045a53e02"
Jul 17 10:05:48.313212 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:05:48.313129    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2_odh-ai-gateway-infra(63fb053e-a4c5-4dd4-acc2-8d1a387ae767)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767"
Jul 17 10:05:48.874184 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:48.874151    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:48.971511 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:48.971467    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:49.179139 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:49.179110    2560 scope.go:117] "RemoveContainer" containerID="9428443befa5bc0062c08dc5b3cce3709f45a43e3382a97a0311153b4d2b534f"
Jul 17 10:05:49.184725 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:49.184700    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:49.320765 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:49.320738    2560 scope.go:117] "RemoveContainer" containerID="442e33539faf6b41385a8d0c7bf05d561b2e5e1b4abce5e511ce409045a53e02"
Jul 17 10:05:49.321069 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:05:49.320911    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2_odh-ai-gateway-infra(63fb053e-a4c5-4dd4-acc2-8d1a387ae767)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767"
Jul 17 10:05:49.578215 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:49.578137    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:49.865017 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:49.864940    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:50.326739 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:50.326711    2560 generic.go:356] "Generic (PLEG): container finished" podID="d77bde15-442c-4247-af18-6401f4debe4b" containerID="04bf5f3c5061e830197f58c341edeacf4c8c490d2e875774f1a6b03650172b1f" exitCode=6
Jul 17 10:05:50.327227 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:50.326761    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx" event={"ID":"d77bde15-442c-4247-af18-6401f4debe4b","Type":"ContainerDied","Data":"04bf5f3c5061e830197f58c341edeacf4c8c490d2e875774f1a6b03650172b1f"}
Jul 17 10:05:50.327227 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:50.326820    2560 scope.go:117] "RemoveContainer" containerID="9428443befa5bc0062c08dc5b3cce3709f45a43e3382a97a0311153b4d2b534f"
Jul 17 10:05:50.327227 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:50.327119    2560 scope.go:117] "RemoveContainer" containerID="04bf5f3c5061e830197f58c341edeacf4c8c490d2e875774f1a6b03650172b1f"
Jul 17 10:05:50.327382 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:05:50.327356    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx_odh-ai-gateway-infra(d77bde15-442c-4247-af18-6401f4debe4b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx" podUID="d77bde15-442c-4247-af18-6401f4debe4b"
Jul 17 10:05:51.355716 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:51.355673    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"]
Jul 17 10:05:51.485811 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:51.485769    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"
Jul 17 10:05:51.582231 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:51.582203    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d77bde15-442c-4247-af18-6401f4debe4b-maas-api-service-ca\") pod \"d77bde15-442c-4247-af18-6401f4debe4b\" (UID: \"d77bde15-442c-4247-af18-6401f4debe4b\") "
Jul 17 10:05:51.582587 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:51.582564    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d77bde15-442c-4247-af18-6401f4debe4b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d77bde15-442c-4247-af18-6401f4debe4b" (UID: "d77bde15-442c-4247-af18-6401f4debe4b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:05:51.683317 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:51.683289    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d77bde15-442c-4247-af18-6401f4debe4b-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:05:52.337210 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:52.337174    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx" event={"ID":"d77bde15-442c-4247-af18-6401f4debe4b","Type":"ContainerDied","Data":"6b28499f988f4ef769cc6699cb0ff4ca9c97d1cac67cfb3e9b42ad744f354a9e"}
Jul 17 10:05:52.337210 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:52.337192    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"
Jul 17 10:05:52.337445 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:52.337235    2560 scope.go:117] "RemoveContainer" containerID="04bf5f3c5061e830197f58c341edeacf4c8c490d2e875774f1a6b03650172b1f"
Jul 17 10:05:52.360605 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:52.360584    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"]
Jul 17 10:05:52.366544 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:52.366524    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-kcmzx"]
Jul 17 10:05:52.509894 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:52.509863    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:53.184177 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.184143    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d77bde15-442c-4247-af18-6401f4debe4b" path="/var/lib/kubelet/pods/d77bde15-442c-4247-af18-6401f4debe4b/volumes"
Jul 17 10:05:53.251232 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.251203    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"]
Jul 17 10:05:53.251537 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.251524    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d77bde15-442c-4247-af18-6401f4debe4b" containerName="revoke-keys"
Jul 17 10:05:53.251584 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.251539    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d77bde15-442c-4247-af18-6401f4debe4b" containerName="revoke-keys"
Jul 17 10:05:53.251584 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.251551    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d77bde15-442c-4247-af18-6401f4debe4b" containerName="revoke-keys"
Jul 17 10:05:53.251584 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.251557    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d77bde15-442c-4247-af18-6401f4debe4b" containerName="revoke-keys"
Jul 17 10:05:53.251584 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.251565    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d77bde15-442c-4247-af18-6401f4debe4b" containerName="revoke-keys"
Jul 17 10:05:53.251584 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.251571    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d77bde15-442c-4247-af18-6401f4debe4b" containerName="revoke-keys"
Jul 17 10:05:53.251729 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.251628    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d77bde15-442c-4247-af18-6401f4debe4b" containerName="revoke-keys"
Jul 17 10:05:53.251729 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.251639    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d77bde15-442c-4247-af18-6401f4debe4b" containerName="revoke-keys"
Jul 17 10:05:53.256055 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.256006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"
Jul 17 10:05:53.269746 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.269725    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"]
Jul 17 10:05:53.296939 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.296908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d29ed99-48f9-413d-a108-132c04d3a84d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz\" (UID: \"7d29ed99-48f9-413d-a108-132c04d3a84d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"
Jul 17 10:05:53.398110 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.398074    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d29ed99-48f9-413d-a108-132c04d3a84d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz\" (UID: \"7d29ed99-48f9-413d-a108-132c04d3a84d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"
Jul 17 10:05:53.398816 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.398767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d29ed99-48f9-413d-a108-132c04d3a84d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz\" (UID: \"7d29ed99-48f9-413d-a108-132c04d3a84d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"
Jul 17 10:05:53.565232 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.565125    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"
Jul 17 10:05:53.689953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:53.689922    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"]
Jul 17 10:05:53.691618 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:05:53.691589    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d29ed99_48f9_413d_a108_132c04d3a84d.slice/crio-ae3e881de6307874ebdef20fcd95abe9d76cc2aabc874a615ce9e1c1f70c2a9c WatchSource:0}: Error finding container ae3e881de6307874ebdef20fcd95abe9d76cc2aabc874a615ce9e1c1f70c2a9c: Status 404 returned error can't find the container with id ae3e881de6307874ebdef20fcd95abe9d76cc2aabc874a615ce9e1c1f70c2a9c
Jul 17 10:05:54.347998 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:54.347916    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz" event={"ID":"7d29ed99-48f9-413d-a108-132c04d3a84d","Type":"ContainerStarted","Data":"7b4f61e73b5dee92f81c7cc00e48f54283ea75b1a61d45b994f0d730b13330bb"}
Jul 17 10:05:54.347998 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:54.347979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz" event={"ID":"7d29ed99-48f9-413d-a108-132c04d3a84d","Type":"ContainerStarted","Data":"ae3e881de6307874ebdef20fcd95abe9d76cc2aabc874a615ce9e1c1f70c2a9c"}
Jul 17 10:05:54.364428 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:54.364378    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz" podStartSLOduration=1.364363662 podStartE2EDuration="1.364363662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:05:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:05:54.363632116 +0000 UTC m=+2873.855326566" watchObservedRunningTime="2026-07-17 10:05:54.364363662 +0000 UTC m=+2873.856058066"
Jul 17 10:05:54.610417 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:54.610340    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:55.353414 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:55.353385    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerID="7b4f61e73b5dee92f81c7cc00e48f54283ea75b1a61d45b994f0d730b13330bb" exitCode=6
Jul 17 10:05:55.353615 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:55.353476    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz" event={"ID":"7d29ed99-48f9-413d-a108-132c04d3a84d","Type":"ContainerDied","Data":"7b4f61e73b5dee92f81c7cc00e48f54283ea75b1a61d45b994f0d730b13330bb"}
Jul 17 10:05:55.353663 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:55.353647    2560 scope.go:117] "RemoveContainer" containerID="7b4f61e73b5dee92f81c7cc00e48f54283ea75b1a61d45b994f0d730b13330bb"
Jul 17 10:05:56.359604 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:56.359570    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerID="2055fd39e0d38a1860286f13bbb7a289ca6cfc3d5061b1ab2fdc5aae5672853c" exitCode=6
Jul 17 10:05:56.360062 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:56.359650    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz" event={"ID":"7d29ed99-48f9-413d-a108-132c04d3a84d","Type":"ContainerDied","Data":"2055fd39e0d38a1860286f13bbb7a289ca6cfc3d5061b1ab2fdc5aae5672853c"}
Jul 17 10:05:56.360062 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:56.359721    2560 scope.go:117] "RemoveContainer" containerID="7b4f61e73b5dee92f81c7cc00e48f54283ea75b1a61d45b994f0d730b13330bb"
Jul 17 10:05:56.360062 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:56.359830    2560 scope.go:117] "RemoveContainer" containerID="2055fd39e0d38a1860286f13bbb7a289ca6cfc3d5061b1ab2fdc5aae5672853c"
Jul 17 10:05:56.360062 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:05:56.360035    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz_odh-ai-gateway-infra(7d29ed99-48f9-413d-a108-132c04d3a84d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d"
Jul 17 10:05:56.967128 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:56.967093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:57.313191 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.313083    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:57.365328 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.365303    2560 scope.go:117] "RemoveContainer" containerID="2055fd39e0d38a1860286f13bbb7a289ca6cfc3d5061b1ab2fdc5aae5672853c"
Jul 17 10:05:57.365688 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:05:57.365481    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz_odh-ai-gateway-infra(7d29ed99-48f9-413d-a108-132c04d3a84d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d"
Jul 17 10:05:57.616280 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.616202    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"]
Jul 17 10:05:57.616624 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.616610    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d77bde15-442c-4247-af18-6401f4debe4b" containerName="revoke-keys"
Jul 17 10:05:57.620866 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.620847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.623599 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.623573    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-787694-openshift-default-dockercfg-c5q27\""
Jul 17 10:05:57.639221 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.639191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"]
Jul 17 10:05:57.666088 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.666033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:57.737952 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.737923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-credential-socket\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.738105 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.737960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-certs\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.738105 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.737982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-data\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.738105 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.738031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8903d3b-a86b-415e-94ac-890e8e518356-istiod-ca-cert\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.738105 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.738080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-socket\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.738105 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.738095    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-istio-token\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.738362 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.738137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8903d3b-a86b-415e-94ac-890e8e518356-istio-podinfo\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.738362 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.738164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qltnx\" (UniqueName: \"kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-kube-api-access-qltnx\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.738362 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.738247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-envoy\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839155 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839126    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qltnx\" (UniqueName: \"kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-kube-api-access-qltnx\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839292 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-envoy\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839292 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-credential-socket\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839410 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-certs\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839410 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-data\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839410 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8903d3b-a86b-415e-94ac-890e8e518356-istiod-ca-cert\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839563 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-socket\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839563 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-istio-token\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839563 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-credential-socket\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839714 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8903d3b-a86b-415e-94ac-890e8e518356-istio-podinfo\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839714 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-certs\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.839989 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.839969    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-data\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.840094 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.840023    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-socket\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.840293 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.840270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8903d3b-a86b-415e-94ac-890e8e518356-istiod-ca-cert\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.841551 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.841528    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-envoy\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.841967 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.841947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8903d3b-a86b-415e-94ac-890e8e518356-istio-podinfo\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.852204 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.852184    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qltnx\" (UniqueName: \"kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-kube-api-access-qltnx\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.852336 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.852304    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-istio-token\") pod \"e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") " pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:57.904164 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.904136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:05:57.930851 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:57.930827    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:58.076131 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:58.076109    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"]
Jul 17 10:05:58.078631 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:05:58.078596    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8903d3b_a86b_415e_94ac_890e8e518356.slice/crio-38bf37981bc474a94b94b1ccb8f19a5964fff73409b8d03d30c81ba47cedb7ab WatchSource:0}: Error finding container 38bf37981bc474a94b94b1ccb8f19a5964fff73409b8d03d30c81ba47cedb7ab: Status 404 returned error can't find the container with id 38bf37981bc474a94b94b1ccb8f19a5964fff73409b8d03d30c81ba47cedb7ab
Jul 17 10:05:58.080719 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:58.080689    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:05:58.080813 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:58.080754    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:05:58.080862 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:58.080814    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:05:58.371466 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:58.371383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" event={"ID":"f8903d3b-a86b-415e-94ac-890e8e518356","Type":"ContainerStarted","Data":"9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44"}
Jul 17 10:05:58.371466 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:58.371447    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" event={"ID":"f8903d3b-a86b-415e-94ac-890e8e518356","Type":"ContainerStarted","Data":"38bf37981bc474a94b94b1ccb8f19a5964fff73409b8d03d30c81ba47cedb7ab"}
Jul 17 10:05:58.400372 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:58.400317    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" podStartSLOduration=1.400304155 podStartE2EDuration="1.400304155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:05:58.399347839 +0000 UTC m=+2877.891042255" watchObservedRunningTime="2026-07-17 10:05:58.400304155 +0000 UTC m=+2877.891998559"
Jul 17 10:05:58.931681 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:58.931652    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:05:59.861609 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:59.861574    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:05:59.935789 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:05:59.935750    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:06:00.178560 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:00.178529    2560 scope.go:117] "RemoveContainer" containerID="442e33539faf6b41385a8d0c7bf05d561b2e5e1b4abce5e511ce409045a53e02"
Jul 17 10:06:00.381410 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:00.381381    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:06:00.382485 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:00.382462    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:06:00.431144 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:00.431056    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:00.575240 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:00.575204    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:00.729769 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:00.729678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:00.851159 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:00.851127    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:01.387452 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:01.387414    2560 generic.go:356] "Generic (PLEG): container finished" podID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerID="3ad9b4408a3756fbf675e26cc32b3c46ee18dfcf94cc4790974e658d7996985e" exitCode=6
Jul 17 10:06:01.387452 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:01.387444    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2" event={"ID":"63fb053e-a4c5-4dd4-acc2-8d1a387ae767","Type":"ContainerDied","Data":"3ad9b4408a3756fbf675e26cc32b3c46ee18dfcf94cc4790974e658d7996985e"}
Jul 17 10:06:01.387972 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:01.387508    2560 scope.go:117] "RemoveContainer" containerID="442e33539faf6b41385a8d0c7bf05d561b2e5e1b4abce5e511ce409045a53e02"
Jul 17 10:06:01.388036 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:01.388014    2560 scope.go:117] "RemoveContainer" containerID="3ad9b4408a3756fbf675e26cc32b3c46ee18dfcf94cc4790974e658d7996985e"
Jul 17 10:06:01.388241 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:06:01.388217    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2_odh-ai-gateway-infra(63fb053e-a4c5-4dd4-acc2-8d1a387ae767)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767"
Jul 17 10:06:01.538983 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:01.538920    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:01.651916 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:01.651887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:02.447434 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:02.447398    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"]
Jul 17 10:06:02.564250 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:02.564228    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"
Jul 17 10:06:02.679880 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:02.679850    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63fb053e-a4c5-4dd4-acc2-8d1a387ae767-maas-api-service-ca\") pod \"63fb053e-a4c5-4dd4-acc2-8d1a387ae767\" (UID: \"63fb053e-a4c5-4dd4-acc2-8d1a387ae767\") "
Jul 17 10:06:02.680176 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:02.680155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63fb053e-a4c5-4dd4-acc2-8d1a387ae767-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63fb053e-a4c5-4dd4-acc2-8d1a387ae767" (UID: "63fb053e-a4c5-4dd4-acc2-8d1a387ae767"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:06:02.781029 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:02.780950    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63fb053e-a4c5-4dd4-acc2-8d1a387ae767-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:06:03.399437 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:03.399402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2" event={"ID":"63fb053e-a4c5-4dd4-acc2-8d1a387ae767","Type":"ContainerDied","Data":"ea3a1d1bbd438f415b4aada15b0499436d64257fb64ac50e620867da4a77e0d5"}
Jul 17 10:06:03.399684 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:03.399460    2560 scope.go:117] "RemoveContainer" containerID="3ad9b4408a3756fbf675e26cc32b3c46ee18dfcf94cc4790974e658d7996985e"
Jul 17 10:06:03.399684 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:03.399408    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"
Jul 17 10:06:03.430294 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:03.430268    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"]
Jul 17 10:06:03.434761 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:03.434740    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-p42n2"]
Jul 17 10:06:04.991146 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:04.991108    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:05.184293 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:05.184254    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" path="/var/lib/kubelet/pods/63fb053e-a4c5-4dd4-acc2-8d1a387ae767/volumes"
Jul 17 10:06:10.178869 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:10.178832    2560 scope.go:117] "RemoveContainer" containerID="2055fd39e0d38a1860286f13bbb7a289ca6cfc3d5061b1ab2fdc5aae5672853c"
Jul 17 10:06:11.440608 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:11.440575    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerID="4b50a191b65bc07228db917732346628be3a792a1cac7f66f3735b05d1a0f0d4" exitCode=6
Jul 17 10:06:11.441069 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:11.440647    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz" event={"ID":"7d29ed99-48f9-413d-a108-132c04d3a84d","Type":"ContainerDied","Data":"4b50a191b65bc07228db917732346628be3a792a1cac7f66f3735b05d1a0f0d4"}
Jul 17 10:06:11.441069 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:11.440706    2560 scope.go:117] "RemoveContainer" containerID="2055fd39e0d38a1860286f13bbb7a289ca6cfc3d5061b1ab2fdc5aae5672853c"
Jul 17 10:06:11.441069 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:11.441038    2560 scope.go:117] "RemoveContainer" containerID="4b50a191b65bc07228db917732346628be3a792a1cac7f66f3735b05d1a0f0d4"
Jul 17 10:06:11.441292 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:06:11.441273    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz_odh-ai-gateway-infra(7d29ed99-48f9-413d-a108-132c04d3a84d)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d"
Jul 17 10:06:12.511200 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:12.511161    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"]
Jul 17 10:06:12.642092 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:12.642062    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"
Jul 17 10:06:12.767503 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:12.767472    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d29ed99-48f9-413d-a108-132c04d3a84d-maas-api-service-ca\") pod \"7d29ed99-48f9-413d-a108-132c04d3a84d\" (UID: \"7d29ed99-48f9-413d-a108-132c04d3a84d\") "
Jul 17 10:06:12.767941 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:12.767915    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d29ed99-48f9-413d-a108-132c04d3a84d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d29ed99-48f9-413d-a108-132c04d3a84d" (UID: "7d29ed99-48f9-413d-a108-132c04d3a84d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:06:12.868807 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:12.868692    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d29ed99-48f9-413d-a108-132c04d3a84d-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:06:13.083481 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.083443    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:06:13.454403 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.454321    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"
Jul 17 10:06:13.454403 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.454334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz" event={"ID":"7d29ed99-48f9-413d-a108-132c04d3a84d","Type":"ContainerDied","Data":"ae3e881de6307874ebdef20fcd95abe9d76cc2aabc874a615ce9e1c1f70c2a9c"}
Jul 17 10:06:13.454403 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.454391    2560 scope.go:117] "RemoveContainer" containerID="4b50a191b65bc07228db917732346628be3a792a1cac7f66f3735b05d1a0f0d4"
Jul 17 10:06:13.474572 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.474543    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"]
Jul 17 10:06:13.485888 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.485855    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-28vbz"]
Jul 17 10:06:13.608477 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608443    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"]
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608751    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerName="revoke-keys"
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608762    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerName="revoke-keys"
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608770    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerName="revoke-keys"
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608790    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerName="revoke-keys"
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608800    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerName="revoke-keys"
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608806    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerName="revoke-keys"
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608818    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerName="revoke-keys"
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608824    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerName="revoke-keys"
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608882    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerName="revoke-keys"
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608891    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerName="revoke-keys"
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608897    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerName="revoke-keys"
Jul 17 10:06:13.608898 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608903    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerName="revoke-keys"
Jul 17 10:06:13.609324 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608908    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerName="revoke-keys"
Jul 17 10:06:13.609324 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.608913    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerName="revoke-keys"
Jul 17 10:06:13.614287 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.614268    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.617416 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.617396    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fe50f0\"/\"default-dockercfg-ljptp\""
Jul 17 10:06:13.617515 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.617396    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fe50f0\"/\"test-model-fe50f0-kserve-self-signed-certs\""
Jul 17 10:06:13.617932 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.617914    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fe50f0\"/\"openshift-service-ca.crt\""
Jul 17 10:06:13.617999 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.617981    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fe50f0\"/\"kube-root-ca.crt\""
Jul 17 10:06:13.655975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.655946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"]
Jul 17 10:06:13.678029 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.677994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6999be4-5685-460c-ac65-0ab45bc1a38e-tls-certs\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.678175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.678051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-home\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.678175 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.678077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-dshm\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.678297 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.678121    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-model-cache\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.678297 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.678231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-tmp-dir\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.678385 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.678363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zn4r\" (UniqueName: \"kubernetes.io/projected/f6999be4-5685-460c-ac65-0ab45bc1a38e-kube-api-access-2zn4r\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.735864 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.735763    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:13.779614 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.779583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-dshm\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.779812 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.779635    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-model-cache\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.779812 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.779668    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-tmp-dir\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.779812 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.779697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zn4r\" (UniqueName: \"kubernetes.io/projected/f6999be4-5685-460c-ac65-0ab45bc1a38e-kube-api-access-2zn4r\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.779812 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.779752    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6999be4-5685-460c-ac65-0ab45bc1a38e-tls-certs\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.779812 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.779811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-home\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.780143 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.780119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-model-cache\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.780228 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.780152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-tmp-dir\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.780228 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.780181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-home\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.781976 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.781956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-dshm\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.782756 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.782736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6999be4-5685-460c-ac65-0ab45bc1a38e-tls-certs\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.791910 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.791878    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zn4r\" (UniqueName: \"kubernetes.io/projected/f6999be4-5685-460c-ac65-0ab45bc1a38e-kube-api-access-2zn4r\") pod \"test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") " pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:13.923105 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:13.923065    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:14.075740 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:14.075715    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"]
Jul 17 10:06:14.078320 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:06:14.078294    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6999be4_5685_460c_ac65_0ab45bc1a38e.slice/crio-e5270899e6c7964d5914d312034bfc026c35455619fefc9f81b5c1d15428bb12 WatchSource:0}: Error finding container e5270899e6c7964d5914d312034bfc026c35455619fefc9f81b5c1d15428bb12: Status 404 returned error can't find the container with id e5270899e6c7964d5914d312034bfc026c35455619fefc9f81b5c1d15428bb12
Jul 17 10:06:14.460746 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:14.460706    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2" event={"ID":"f6999be4-5685-460c-ac65-0ab45bc1a38e","Type":"ContainerStarted","Data":"07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3"}
Jul 17 10:06:14.460746 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:14.460752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2" event={"ID":"f6999be4-5685-460c-ac65-0ab45bc1a38e","Type":"ContainerStarted","Data":"e5270899e6c7964d5914d312034bfc026c35455619fefc9f81b5c1d15428bb12"}
Jul 17 10:06:14.515391 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:14.515328    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2" podStartSLOduration=1.515310764 podStartE2EDuration="1.515310764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:06:14.513132498 +0000 UTC m=+2894.004826897" watchObservedRunningTime="2026-07-17 10:06:14.515310764 +0000 UTC m=+2894.007005169"
Jul 17 10:06:14.517067 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:14.517033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:14.686993 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:14.686958    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:15.185348 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:15.185278    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d" path="/var/lib/kubelet/pods/7d29ed99-48f9-413d-a108-132c04d3a84d/volumes"
Jul 17 10:06:15.382865 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:15.382760    2560 patch_prober.go:28] interesting pod/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 17 10:06:15.382865 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:15.382836    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 17 10:06:15.466953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:15.466920    2560 generic.go:356] "Generic (PLEG): container finished" podID="f8903d3b-a86b-415e-94ac-890e8e518356" containerID="9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44" exitCode=0
Jul 17 10:06:15.467113 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:15.466993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" event={"ID":"f8903d3b-a86b-415e-94ac-890e8e518356","Type":"ContainerDied","Data":"9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44"}
Jul 17 10:06:15.467431 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:15.467413    2560 scope.go:117] "RemoveContainer" containerID="9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44"
Jul 17 10:06:15.468413 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:15.468383    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:06:15.468494 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:15.468468    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:06:15.468533 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:15.468514    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:06:16.472886 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:16.472854    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" event={"ID":"f8903d3b-a86b-415e-94ac-890e8e518356","Type":"ContainerStarted","Data":"a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd"}
Jul 17 10:06:16.932016 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:16.931979    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:06:16.932205 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:16.932163    2560 patch_prober.go:28] interesting pod/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 17 10:06:16.932250 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:16.932211    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 17 10:06:17.931519 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:17.931482    2560 patch_prober.go:28] interesting pod/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 17 10:06:17.931920 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:17.931545    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 17 10:06:18.931728 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:18.931684    2560 patch_prober.go:28] interesting pod/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 17 10:06:18.932156 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:18.931763    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 17 10:06:19.931635 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:19.931594    2560 patch_prober.go:28] interesting pod/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 17 10:06:19.931811 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:19.931653    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 17 10:06:20.935660 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:20.935628    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:06:20.936200 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:20.935987    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:06:20.936854 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:20.936830    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:06:22.235452 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:22.235416    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:22.671266 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:22.671238    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:22.770269 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:22.770240    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:23.264251 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:23.264214    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:23.924061 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:23.924026    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:23.924239 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:23.924111    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:23.936691 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:23.936662    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:24.535877 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:24.535844    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:06:30.268937 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:30.268899    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:06:42.518478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.518438    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"]
Jul 17 10:06:42.519056 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.518915    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerName="revoke-keys"
Jul 17 10:06:42.519056 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.518934    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fb053e-a4c5-4dd4-acc2-8d1a387ae767" containerName="revoke-keys"
Jul 17 10:06:42.519056 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.518946    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerName="revoke-keys"
Jul 17 10:06:42.519056 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.518955    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d29ed99-48f9-413d-a108-132c04d3a84d" containerName="revoke-keys"
Jul 17 10:06:42.521904 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.521873    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.525682 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.525650    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-787694\"/\"default-dockercfg-nvpkz\""
Jul 17 10:06:42.525682 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.525670    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-787694\"/\"openshift-service-ca.crt\""
Jul 17 10:06:42.525926 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.525911    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-787694\"/\"kube-root-ca.crt\""
Jul 17 10:06:42.526054 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.526038    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-787694\"/\"test-model-787694-kserve-self-signed-certs\""
Jul 17 10:06:42.532880 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.532861    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"]
Jul 17 10:06:42.556614 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.556587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:42.646294 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.646265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-dshm\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.646469 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.646314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-home\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.646469 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.646340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-model-cache\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.646469 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.646369    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tls-certs\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.646469 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.646386    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxkw5\" (UniqueName: \"kubernetes.io/projected/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-kube-api-access-pxkw5\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.646469 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.646438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tmp-dir\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.747618 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.747589    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tmp-dir\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.747769 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.747638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-dshm\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.747769 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.747676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-home\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.747769 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.747698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-model-cache\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.747769 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.747723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tls-certs\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.748025 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.747766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxkw5\" (UniqueName: \"kubernetes.io/projected/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-kube-api-access-pxkw5\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.748081 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.748037    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tmp-dir\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.748081 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.748063    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-model-cache\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.748187 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.748164    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-home\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.749906 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.749886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-dshm\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.750154 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.750134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tls-certs\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.759814 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.759767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxkw5\" (UniqueName: \"kubernetes.io/projected/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-kube-api-access-pxkw5\") pod \"test-model-787694-kserve-8648c98947-fzn5s\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") " pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.831025 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.830944    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:42.960748 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:42.960722    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"]
Jul 17 10:06:42.963242 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:06:42.963212    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dd4034e_ac36_422a_96ea_5ddb17f1cb2d.slice/crio-f7c1dd01bbacd02d364587b1235f22893aa7fdc7f1fba6f500deab2bb819a5c8 WatchSource:0}: Error finding container f7c1dd01bbacd02d364587b1235f22893aa7fdc7f1fba6f500deab2bb819a5c8: Status 404 returned error can't find the container with id f7c1dd01bbacd02d364587b1235f22893aa7fdc7f1fba6f500deab2bb819a5c8
Jul 17 10:06:43.615410 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:43.615375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s" event={"ID":"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d","Type":"ContainerStarted","Data":"d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15"}
Jul 17 10:06:43.615813 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:43.615421    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s" event={"ID":"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d","Type":"ContainerStarted","Data":"f7c1dd01bbacd02d364587b1235f22893aa7fdc7f1fba6f500deab2bb819a5c8"}
Jul 17 10:06:43.650395 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:43.650352    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s" podStartSLOduration=1.650337939 podStartE2EDuration="1.650337939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:06:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:06:43.649515525 +0000 UTC m=+2923.141209932" watchObservedRunningTime="2026-07-17 10:06:43.650337939 +0000 UTC m=+2923.142032344"
Jul 17 10:06:46.690622 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:46.690585    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:06:52.115657 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:52.115603    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:52.297872 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:52.297835    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:06:52.831679 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:52.831646    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:52.831886 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:52.831699    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:52.844124 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:52.844095    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:53.676380 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:53.676349    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:06:59.971281 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:06:59.971246    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:07:03.944615 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:03.944581    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"]
Jul 17 10:07:03.991291 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:03.991260    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:04.926016 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:04.925983    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"]
Jul 17 10:07:04.950495 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:04.950440    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:05.740416 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:05.740381    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:05.861315 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:05.861253    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:15.766637 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:15.766595    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:18.354123 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:18.354080    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:07:18.964805 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:18.964749    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2" podUID="f6999be4-5685-460c-ac65-0ab45bc1a38e" containerName="main" containerID="cri-o://07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3" gracePeriod=45
Jul 17 10:07:19.225789 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.225708    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:07:19.294356 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.294323    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6999be4-5685-460c-ac65-0ab45bc1a38e-tls-certs\") pod \"f6999be4-5685-460c-ac65-0ab45bc1a38e\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") "
Jul 17 10:07:19.294555 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.294372    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-dshm\") pod \"f6999be4-5685-460c-ac65-0ab45bc1a38e\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") "
Jul 17 10:07:19.294555 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.294404    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-tmp-dir\") pod \"f6999be4-5685-460c-ac65-0ab45bc1a38e\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") "
Jul 17 10:07:19.294555 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.294486    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zn4r\" (UniqueName: \"kubernetes.io/projected/f6999be4-5685-460c-ac65-0ab45bc1a38e-kube-api-access-2zn4r\") pod \"f6999be4-5685-460c-ac65-0ab45bc1a38e\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") "
Jul 17 10:07:19.294555 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.294507    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-home\") pod \"f6999be4-5685-460c-ac65-0ab45bc1a38e\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") "
Jul 17 10:07:19.294793 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.294564    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-model-cache\") pod \"f6999be4-5685-460c-ac65-0ab45bc1a38e\" (UID: \"f6999be4-5685-460c-ac65-0ab45bc1a38e\") "
Jul 17 10:07:19.294869 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.294804    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f6999be4-5685-460c-ac65-0ab45bc1a38e" (UID: "f6999be4-5685-460c-ac65-0ab45bc1a38e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:07:19.294869 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.294824    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-home" (OuterVolumeSpecName: "home") pod "f6999be4-5685-460c-ac65-0ab45bc1a38e" (UID: "f6999be4-5685-460c-ac65-0ab45bc1a38e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:07:19.294963 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.294922    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-model-cache" (OuterVolumeSpecName: "model-cache") pod "f6999be4-5685-460c-ac65-0ab45bc1a38e" (UID: "f6999be4-5685-460c-ac65-0ab45bc1a38e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:07:19.296686 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.296661    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-dshm" (OuterVolumeSpecName: "dshm") pod "f6999be4-5685-460c-ac65-0ab45bc1a38e" (UID: "f6999be4-5685-460c-ac65-0ab45bc1a38e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:07:19.296831 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.296685    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6999be4-5685-460c-ac65-0ab45bc1a38e-kube-api-access-2zn4r" (OuterVolumeSpecName: "kube-api-access-2zn4r") pod "f6999be4-5685-460c-ac65-0ab45bc1a38e" (UID: "f6999be4-5685-460c-ac65-0ab45bc1a38e"). InnerVolumeSpecName "kube-api-access-2zn4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:07:19.296831 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.296700    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6999be4-5685-460c-ac65-0ab45bc1a38e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f6999be4-5685-460c-ac65-0ab45bc1a38e" (UID: "f6999be4-5685-460c-ac65-0ab45bc1a38e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:07:19.395694 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.395657    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zn4r\" (UniqueName: \"kubernetes.io/projected/f6999be4-5685-460c-ac65-0ab45bc1a38e-kube-api-access-2zn4r\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:19.395694 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.395688    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-home\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:19.395694 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.395700    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-model-cache\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:19.396159 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.395711    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6999be4-5685-460c-ac65-0ab45bc1a38e-tls-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:19.396159 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.395719    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-dshm\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:19.396159 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.395744    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6999be4-5685-460c-ac65-0ab45bc1a38e-tmp-dir\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:19.777837 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.777801    2560 generic.go:356] "Generic (PLEG): container finished" podID="f6999be4-5685-460c-ac65-0ab45bc1a38e" containerID="07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3" exitCode=0
Jul 17 10:07:19.778032 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.777844    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"
Jul 17 10:07:19.778032 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.777875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2" event={"ID":"f6999be4-5685-460c-ac65-0ab45bc1a38e","Type":"ContainerDied","Data":"07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3"}
Jul 17 10:07:19.778032 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.777915    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2" event={"ID":"f6999be4-5685-460c-ac65-0ab45bc1a38e","Type":"ContainerDied","Data":"e5270899e6c7964d5914d312034bfc026c35455619fefc9f81b5c1d15428bb12"}
Jul 17 10:07:19.778032 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.777932    2560 scope.go:117] "RemoveContainer" containerID="07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3"
Jul 17 10:07:19.787165 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.787148    2560 scope.go:117] "RemoveContainer" containerID="07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3"
Jul 17 10:07:19.787422 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:07:19.787404    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3\": container with ID starting with 07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3 not found: ID does not exist" containerID="07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3"
Jul 17 10:07:19.787470 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.787431    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3"} err="failed to get container status \"07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3\": rpc error: code = NotFound desc = could not find container \"07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3\": container with ID starting with 07b372008c19cef023bc4b1a5b35647ead1dd07314f553f141286e535b7d57e3 not found: ID does not exist"
Jul 17 10:07:19.798991 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.798967    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"]
Jul 17 10:07:19.802877 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.802856    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-fe50f0/test-model-fe50f0-kserve-5bb9fcbfb5-5tsw2"]
Jul 17 10:07:19.945952 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:19.945910    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s" podUID="4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" containerName="main" containerID="cri-o://d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15" gracePeriod=45
Jul 17 10:07:20.192689 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.192655    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:20.205489 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.205463    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:07:20.302884 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.302845    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tmp-dir\") pod \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") "
Jul 17 10:07:20.303098 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.302909    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-home\") pod \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") "
Jul 17 10:07:20.303098 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.302939    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-model-cache\") pod \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") "
Jul 17 10:07:20.303098 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.303001    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxkw5\" (UniqueName: \"kubernetes.io/projected/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-kube-api-access-pxkw5\") pod \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") "
Jul 17 10:07:20.303098 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.303038    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-dshm\") pod \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") "
Jul 17 10:07:20.303098 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.303071    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tls-certs\") pod \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\" (UID: \"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d\") "
Jul 17 10:07:20.303343 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.303170    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" (UID: "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:07:20.303343 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.303185    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-home" (OuterVolumeSpecName: "home") pod "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" (UID: "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:07:20.303343 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.303266    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-model-cache" (OuterVolumeSpecName: "model-cache") pod "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" (UID: "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:07:20.303447 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.303392    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-home\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:20.303447 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.303413    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-model-cache\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:20.303447 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.303432    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tmp-dir\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:20.305355 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.305319    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-dshm" (OuterVolumeSpecName: "dshm") pod "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" (UID: "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:07:20.305469 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.305374    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" (UID: "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:07:20.305469 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.305390    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-kube-api-access-pxkw5" (OuterVolumeSpecName: "kube-api-access-pxkw5") pod "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" (UID: "4dd4034e-ac36-422a-96ea-5ddb17f1cb2d"). InnerVolumeSpecName "kube-api-access-pxkw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:07:20.404331 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.404292    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-dshm\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:20.404331 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.404326    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-tls-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:20.404331 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.404339    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxkw5\" (UniqueName: \"kubernetes.io/projected/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d-kube-api-access-pxkw5\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:07:20.785347 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.785247    2560 generic.go:356] "Generic (PLEG): container finished" podID="4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" containerID="d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15" exitCode=0
Jul 17 10:07:20.785347 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.785287    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"
Jul 17 10:07:20.785347 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.785329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s" event={"ID":"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d","Type":"ContainerDied","Data":"d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15"}
Jul 17 10:07:20.785666 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.785382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s" event={"ID":"4dd4034e-ac36-422a-96ea-5ddb17f1cb2d","Type":"ContainerDied","Data":"f7c1dd01bbacd02d364587b1235f22893aa7fdc7f1fba6f500deab2bb819a5c8"}
Jul 17 10:07:20.785666 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.785406    2560 scope.go:117] "RemoveContainer" containerID="d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15"
Jul 17 10:07:20.794576 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.794528    2560 scope.go:117] "RemoveContainer" containerID="d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15"
Jul 17 10:07:20.794840 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:07:20.794817    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15\": container with ID starting with d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15 not found: ID does not exist" containerID="d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15"
Jul 17 10:07:20.794929 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.794849    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15"} err="failed to get container status \"d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15\": rpc error: code = NotFound desc = could not find container \"d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15\": container with ID starting with d3219102acb075dbee7382c84c0473bdc41355937415cc0ee9a3aa36fb598e15 not found: ID does not exist"
Jul 17 10:07:20.808412 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.808386    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"]
Jul 17 10:07:20.810141 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:20.810120    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-787694/test-model-787694-kserve-8648c98947-fzn5s"]
Jul 17 10:07:21.185245 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:21.185211    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" path="/var/lib/kubelet/pods/4dd4034e-ac36-422a-96ea-5ddb17f1cb2d/volumes"
Jul 17 10:07:21.185619 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:21.185605    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6999be4-5685-460c-ac65-0ab45bc1a38e" path="/var/lib/kubelet/pods/f6999be4-5685-460c-ac65-0ab45bc1a38e/volumes"
Jul 17 10:07:26.856210 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:26.856118    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:26.957134 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:26.957088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:31.072740 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:31.072694    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:31.363589 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:31.363501    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:32.204712 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:32.204673    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:32.312586 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:32.312553    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:42.218250 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:42.218212    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:45.351889 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:45.351855    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:07:46.592890 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:46.592850    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:53.212846 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:53.212812    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:53.307070 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:53.307032    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:57.380606 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:57.380569    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"]
Jul 17 10:07:57.381063 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:57.380833    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy" containerID="cri-o://a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd" gracePeriod=30
Jul 17 10:07:57.404293 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:57.404261    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:57.668062 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:57.668025    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:58.128903 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:58.128812    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:58.488520 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:58.488477    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:07:59.179999 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:07:59.179958    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:01.235079 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:01.235035    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:01.376460 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:01.376420    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:01.464788 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:01.464746    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:01.942402 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:01.942357    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:02.040105 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.040061    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:02.140975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.140932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:02.637458 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.637434    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:08:02.694173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694070    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-credential-socket\") pod \"f8903d3b-a86b-415e-94ac-890e8e518356\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") "
Jul 17 10:08:02.694173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694157    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-data\") pod \"f8903d3b-a86b-415e-94ac-890e8e518356\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") "
Jul 17 10:08:02.694411 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694189    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8903d3b-a86b-415e-94ac-890e8e518356-istiod-ca-cert\") pod \"f8903d3b-a86b-415e-94ac-890e8e518356\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") "
Jul 17 10:08:02.694411 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694209    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-envoy\") pod \"f8903d3b-a86b-415e-94ac-890e8e518356\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") "
Jul 17 10:08:02.694411 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-certs\") pod \"f8903d3b-a86b-415e-94ac-890e8e518356\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") "
Jul 17 10:08:02.694411 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694280    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8903d3b-a86b-415e-94ac-890e8e518356-istio-podinfo\") pod \"f8903d3b-a86b-415e-94ac-890e8e518356\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") "
Jul 17 10:08:02.694411 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694327    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qltnx\" (UniqueName: \"kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-kube-api-access-qltnx\") pod \"f8903d3b-a86b-415e-94ac-890e8e518356\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") "
Jul 17 10:08:02.694411 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694378    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-socket\") pod \"f8903d3b-a86b-415e-94ac-890e8e518356\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") "
Jul 17 10:08:02.694411 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694383    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f8903d3b-a86b-415e-94ac-890e8e518356" (UID: "f8903d3b-a86b-415e-94ac-890e8e518356"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:08:02.694759 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694471    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-istio-token\") pod \"f8903d3b-a86b-415e-94ac-890e8e518356\" (UID: \"f8903d3b-a86b-415e-94ac-890e8e518356\") "
Jul 17 10:08:02.694759 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694651    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f8903d3b-a86b-415e-94ac-890e8e518356" (UID: "f8903d3b-a86b-415e-94ac-890e8e518356"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:08:02.694759 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694699    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8903d3b-a86b-415e-94ac-890e8e518356-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f8903d3b-a86b-415e-94ac-890e8e518356" (UID: "f8903d3b-a86b-415e-94ac-890e8e518356"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:08:02.694904 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694772    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:08:02.694904 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694815    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-credential-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:08:02.694904 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.694829    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8903d3b-a86b-415e-94ac-890e8e518356-istiod-ca-cert\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:08:02.695147 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.695108    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-data" (OuterVolumeSpecName: "istio-data") pod "f8903d3b-a86b-415e-94ac-890e8e518356" (UID: "f8903d3b-a86b-415e-94ac-890e8e518356"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:08:02.695344 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.695253    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f8903d3b-a86b-415e-94ac-890e8e518356" (UID: "f8903d3b-a86b-415e-94ac-890e8e518356"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:08:02.696835 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.696807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-kube-api-access-qltnx" (OuterVolumeSpecName: "kube-api-access-qltnx") pod "f8903d3b-a86b-415e-94ac-890e8e518356" (UID: "f8903d3b-a86b-415e-94ac-890e8e518356"). InnerVolumeSpecName "kube-api-access-qltnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:08:02.696971 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.696954    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f8903d3b-a86b-415e-94ac-890e8e518356" (UID: "f8903d3b-a86b-415e-94ac-890e8e518356"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:08:02.697128 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.697091    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8903d3b-a86b-415e-94ac-890e8e518356-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f8903d3b-a86b-415e-94ac-890e8e518356" (UID: "f8903d3b-a86b-415e-94ac-890e8e518356"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 10:08:02.697299 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.697284    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-istio-token" (OuterVolumeSpecName: "istio-token") pod "f8903d3b-a86b-415e-94ac-890e8e518356" (UID: "f8903d3b-a86b-415e-94ac-890e8e518356"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:08:02.795762 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.795721    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-istio-token\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:08:02.795762 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.795755    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-data\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:08:02.795762 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.795765    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-istio-envoy\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:08:02.795762 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.795772    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8903d3b-a86b-415e-94ac-890e8e518356-workload-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:08:02.796070 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.795801    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8903d3b-a86b-415e-94ac-890e8e518356-istio-podinfo\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:08:02.796070 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.795810    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qltnx\" (UniqueName: \"kubernetes.io/projected/f8903d3b-a86b-415e-94ac-890e8e518356-kube-api-access-qltnx\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:08:02.969488 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.969390    2560 generic.go:356] "Generic (PLEG): container finished" podID="f8903d3b-a86b-415e-94ac-890e8e518356" containerID="a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd" exitCode=0
Jul 17 10:08:02.969488 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.969442    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"
Jul 17 10:08:02.969488 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.969467    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" event={"ID":"f8903d3b-a86b-415e-94ac-890e8e518356","Type":"ContainerDied","Data":"a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd"}
Jul 17 10:08:02.969736 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.969524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq" event={"ID":"f8903d3b-a86b-415e-94ac-890e8e518356","Type":"ContainerDied","Data":"38bf37981bc474a94b94b1ccb8f19a5964fff73409b8d03d30c81ba47cedb7ab"}
Jul 17 10:08:02.969736 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.969546    2560 scope.go:117] "RemoveContainer" containerID="a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd"
Jul 17 10:08:02.978456 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.978438    2560 scope.go:117] "RemoveContainer" containerID="9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44"
Jul 17 10:08:02.986135 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.986110    2560 scope.go:117] "RemoveContainer" containerID="a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd"
Jul 17 10:08:02.986384 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:08:02.986363    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd\": container with ID starting with a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd not found: ID does not exist" containerID="a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd"
Jul 17 10:08:02.986469 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.986395    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd"} err="failed to get container status \"a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd\": rpc error: code = NotFound desc = could not find container \"a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd\": container with ID starting with a77394c558bbf7ff13da4680978a6b0d2fc5fe3e633ada56fe7b763d28cf9cfd not found: ID does not exist"
Jul 17 10:08:02.986469 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.986419    2560 scope.go:117] "RemoveContainer" containerID="9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44"
Jul 17 10:08:02.986695 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:08:02.986677    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44\": container with ID starting with 9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44 not found: ID does not exist" containerID="9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44"
Jul 17 10:08:02.986734 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.986702    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44"} err="failed to get container status \"9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44\": rpc error: code = NotFound desc = could not find container \"9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44\": container with ID starting with 9ae18514c1baba65f00b6c4e6b7b1966e690c9bc80b843f5834bfbfe8f913c44 not found: ID does not exist"
Jul 17 10:08:02.991710 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.991685    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"]
Jul 17 10:08:02.994304 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:02.994283    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-787694-openshift-default-6b8cc79445-ksgrq"]
Jul 17 10:08:03.184756 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:03.184719    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" path="/var/lib/kubelet/pods/f8903d3b-a86b-415e-94ac-890e8e518356/volumes"
Jul 17 10:08:05.772855 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:05.772819    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:06.267932 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.267895    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:06.474410 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.474374    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:08:06.593123 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593026    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"]
Jul 17 10:08:06.593363 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593350    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy"
Jul 17 10:08:06.593407 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593365    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy"
Jul 17 10:08:06.593407 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593377    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy"
Jul 17 10:08:06.593407 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593382    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy"
Jul 17 10:08:06.593407 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593390    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" containerName="main"
Jul 17 10:08:06.593407 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593396    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" containerName="main"
Jul 17 10:08:06.593407 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593403    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6999be4-5685-460c-ac65-0ab45bc1a38e" containerName="main"
Jul 17 10:08:06.593407 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593408    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6999be4-5685-460c-ac65-0ab45bc1a38e" containerName="main"
Jul 17 10:08:06.593623 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593451    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy"
Jul 17 10:08:06.593623 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593459    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6999be4-5685-460c-ac65-0ab45bc1a38e" containerName="main"
Jul 17 10:08:06.593623 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593466    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dd4034e-ac36-422a-96ea-5ddb17f1cb2d" containerName="main"
Jul 17 10:08:06.593623 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.593472    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8903d3b-a86b-415e-94ac-890e8e518356" containerName="istio-proxy"
Jul 17 10:08:06.597838 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.597817    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.601464 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.601441    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-439eab-openshift-default-dockercfg-v929x\""
Jul 17 10:08:06.611192 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.611151    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"]
Jul 17 10:08:06.611442 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.611419    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:06.730907 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.730868    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2957237-6143-428b-9ef8-ed83740f4a4c-istiod-ca-cert\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.731090 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.730916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-credential-socket\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.731090 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.730946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-data\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.731090 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.730968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-token\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.731090 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.730988    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-podinfo\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.731090 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.731013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-socket\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.731090 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.731035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-certs\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.731090 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.731055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trqzc\" (UniqueName: \"kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-kube-api-access-trqzc\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.731310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.731141    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-envoy\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.831982 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.831936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-envoy\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832481 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2957237-6143-428b-9ef8-ed83740f4a4c-istiod-ca-cert\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832481 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-credential-socket\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832481 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-data\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832481 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-token\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832481 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-podinfo\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832481 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-socket\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832481 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-certs\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832481 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqzc\" (UniqueName: \"kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-kube-api-access-trqzc\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832540    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-credential-socket\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832592    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-socket\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-certs\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.832953 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.832734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-data\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.833185 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.833121    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2957237-6143-428b-9ef8-ed83740f4a4c-istiod-ca-cert\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.834478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.834453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-envoy\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.834692 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.834673    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-podinfo\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.841366 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.841339    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-token\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.841847 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.841827    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trqzc\" (UniqueName: \"kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-kube-api-access-trqzc\") pod \"e2e-api-b-439eab-openshift-default-8558dc9485-9slmx\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") " pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:06.854597 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.854520    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:06.907933 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:06.907896    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:07.051338 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:07.051310    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"]
Jul 17 10:08:07.053596 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:08:07.053565    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2957237_6143_428b_9ef8_ed83740f4a4c.slice/crio-258dd3553acd9890d4543d42ba063b62ab932874b9c84ac8f6ee569f19ffe096 WatchSource:0}: Error finding container 258dd3553acd9890d4543d42ba063b62ab932874b9c84ac8f6ee569f19ffe096: Status 404 returned error can't find the container with id 258dd3553acd9890d4543d42ba063b62ab932874b9c84ac8f6ee569f19ffe096
Jul 17 10:08:07.055731 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:07.055693    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:08:07.055889 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:07.055798    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:08:07.055889 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:07.055844    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:08:07.993342 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:07.993304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" event={"ID":"b2957237-6143-428b-9ef8-ed83740f4a4c","Type":"ContainerStarted","Data":"01ab9659629364dc16510fd116377a36edb735e4994576aec6e37c7094ab171c"}
Jul 17 10:08:07.993746 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:07.993354    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" event={"ID":"b2957237-6143-428b-9ef8-ed83740f4a4c","Type":"ContainerStarted","Data":"258dd3553acd9890d4543d42ba063b62ab932874b9c84ac8f6ee569f19ffe096"}
Jul 17 10:08:08.039170 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:08.039115    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" podStartSLOduration=2.039097739 podStartE2EDuration="2.039097739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:08:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:08:08.037402078 +0000 UTC m=+3007.529096506" watchObservedRunningTime="2026-07-17 10:08:08.039097739 +0000 UTC m=+3007.530792143"
Jul 17 10:08:08.908707 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:08.908663    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:08.913848 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:08.913822    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:08.998604 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:08.998573    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:08.999658 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:08.999637    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:10.132100 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:10.132064    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:10.272162 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:10.272131    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:10.382285 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:10.382172    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:10.635984 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:10.635877    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:11.314085 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:11.314046    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:11.494229 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:11.494193    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:14.674814 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:14.674737    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:15.918989 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:15.918952    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:08:22.957483 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:22.957441    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:23.062890 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:23.062851    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:24.000290 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:24.000255    2560 patch_prober.go:28] interesting pod/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 17 10:08:24.000758 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:24.000312    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 17 10:08:24.073986 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:24.073953    2560 generic.go:356] "Generic (PLEG): container finished" podID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerID="01ab9659629364dc16510fd116377a36edb735e4994576aec6e37c7094ab171c" exitCode=0
Jul 17 10:08:24.074165 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:24.074009    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" event={"ID":"b2957237-6143-428b-9ef8-ed83740f4a4c","Type":"ContainerDied","Data":"01ab9659629364dc16510fd116377a36edb735e4994576aec6e37c7094ab171c"}
Jul 17 10:08:24.074355 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:24.074341    2560 scope.go:117] "RemoveContainer" containerID="01ab9659629364dc16510fd116377a36edb735e4994576aec6e37c7094ab171c"
Jul 17 10:08:24.075336 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:24.075302    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:08:24.075442 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:24.075384    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:08:24.075442 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:24.075424    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:08:25.080486 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:25.080451    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" event={"ID":"b2957237-6143-428b-9ef8-ed83740f4a4c","Type":"ContainerStarted","Data":"5cc1d92bd4c35521964d4e4abeb8716f7be3223aa07e5536111235b935529d32"}
Jul 17 10:08:25.908470 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:25.908424    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:25.908820 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:25.908758    2560 patch_prober.go:28] interesting pod/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 17 10:08:25.908935 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:25.908870    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 17 10:08:26.908724 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:26.908664    2560 patch_prober.go:28] interesting pod/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 17 10:08:26.909206 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:26.908800    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 17 10:08:27.908935 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:27.908898    2560 patch_prober.go:28] interesting pod/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 17 10:08:27.909374 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:27.908958    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 17 10:08:28.908876 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:28.908837    2560 patch_prober.go:28] interesting pod/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 17 10:08:28.909085 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:28.908896    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 17 10:08:29.912896 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:29.912867    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:29.913347 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:29.913118    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:29.913923 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:29.913906    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:08:32.494891 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:32.494845    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:32.596909 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:32.596864    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:33.512041 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:33.512010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:36.564223 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:36.564188    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:08:38.103627 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:38.103587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:44.983017 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:44.982982    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:45.049078 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:45.049038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:48.898094 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:48.898049    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:49.177253 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:49.177161    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:49.298459 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:49.298424    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97"]
Jul 17 10:08:49.302012 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:49.301994    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97"
Jul 17 10:08:49.305686 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:49.305663    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 10:08:49.305686 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:49.305679    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 10:08:49.317470 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:49.317436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97"]
Jul 17 10:08:49.426914 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:49.426873    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d92f1989-cb75-4196-a4dc-9faf33831b7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-439eab-55f97\" (UID: \"d92f1989-cb75-4196-a4dc-9faf33831b7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97"
Jul 17 10:08:49.527847 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:49.527735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d92f1989-cb75-4196-a4dc-9faf33831b7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-439eab-55f97\" (UID: \"d92f1989-cb75-4196-a4dc-9faf33831b7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97"
Jul 17 10:08:49.528375 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:49.528356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d92f1989-cb75-4196-a4dc-9faf33831b7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-439eab-55f97\" (UID: \"d92f1989-cb75-4196-a4dc-9faf33831b7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97"
Jul 17 10:08:49.611760 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:49.611725    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97"
Jul 17 10:08:49.746931 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:49.746903    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97"]
Jul 17 10:08:49.749615 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:08:49.749589    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92f1989_cb75_4196_a4dc_9faf33831b7a.slice/crio-863afdc4b03fe4ebd35d62d6fd9be00003f701174c5562b205fac495e9afb492 WatchSource:0}: Error finding container 863afdc4b03fe4ebd35d62d6fd9be00003f701174c5562b205fac495e9afb492: Status 404 returned error can't find the container with id 863afdc4b03fe4ebd35d62d6fd9be00003f701174c5562b205fac495e9afb492
Jul 17 10:08:50.196298 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:50.196262    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97" event={"ID":"d92f1989-cb75-4196-a4dc-9faf33831b7a","Type":"ContainerStarted","Data":"cd1daf7a709e78edc0fbd3114bbe2b16f08a8ebcad899c5add68803d3c5a288c"}
Jul 17 10:08:50.196773 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:50.196318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97" event={"ID":"d92f1989-cb75-4196-a4dc-9faf33831b7a","Type":"ContainerStarted","Data":"863afdc4b03fe4ebd35d62d6fd9be00003f701174c5562b205fac495e9afb492"}
Jul 17 10:08:50.230752 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:50.230702    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97" podStartSLOduration=1.230685016 podStartE2EDuration="1.230685016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:08:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:08:50.229320101 +0000 UTC m=+3049.721014496" watchObservedRunningTime="2026-07-17 10:08:50.230685016 +0000 UTC m=+3049.722379420"
Jul 17 10:08:51.201752 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:51.201717    2560 generic.go:356] "Generic (PLEG): container finished" podID="d92f1989-cb75-4196-a4dc-9faf33831b7a" containerID="cd1daf7a709e78edc0fbd3114bbe2b16f08a8ebcad899c5add68803d3c5a288c" exitCode=0
Jul 17 10:08:51.202168 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:51.201803    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97" event={"ID":"d92f1989-cb75-4196-a4dc-9faf33831b7a","Type":"ContainerDied","Data":"cd1daf7a709e78edc0fbd3114bbe2b16f08a8ebcad899c5add68803d3c5a288c"}
Jul 17 10:08:52.335221 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:52.335195    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97"
Jul 17 10:08:52.454562 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:52.454527    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d92f1989-cb75-4196-a4dc-9faf33831b7a-maas-api-service-ca\") pod \"d92f1989-cb75-4196-a4dc-9faf33831b7a\" (UID: \"d92f1989-cb75-4196-a4dc-9faf33831b7a\") "
Jul 17 10:08:52.454976 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:52.454950    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d92f1989-cb75-4196-a4dc-9faf33831b7a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d92f1989-cb75-4196-a4dc-9faf33831b7a" (UID: "d92f1989-cb75-4196-a4dc-9faf33831b7a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:08:52.556119 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:52.556018    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d92f1989-cb75-4196-a4dc-9faf33831b7a-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:08:53.210961 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:53.210928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97" event={"ID":"d92f1989-cb75-4196-a4dc-9faf33831b7a","Type":"ContainerDied","Data":"863afdc4b03fe4ebd35d62d6fd9be00003f701174c5562b205fac495e9afb492"}
Jul 17 10:08:53.210961 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:53.210948    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-439eab-55f97"
Jul 17 10:08:53.211173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:53.211012    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="863afdc4b03fe4ebd35d62d6fd9be00003f701174c5562b205fac495e9afb492"
Jul 17 10:08:54.073831 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:54.073764    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:54.159696 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:54.159646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:08:59.980640 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:08:59.980601    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:00.080656 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:00.080618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:00.273663 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:00.273582    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:03.268440 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:03.268400    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:09:04.376294 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:04.376255    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:10.910304 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:10.910268    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:11.012522 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:11.012483    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:15.136120 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:15.136087    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"]
Jul 17 10:09:15.136521 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:15.136303    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy" containerID="cri-o://5cc1d92bd4c35521964d4e4abeb8716f7be3223aa07e5536111235b935529d32" gracePeriod=30
Jul 17 10:09:15.160952 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:15.160911    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:15.389767 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:15.389729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:15.772206 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:15.772112    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:16.134980 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:16.134888    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:16.545456 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:16.545413    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:19.541925 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:19.541895    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:19.641645 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:19.641617    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:19.745668 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:19.745612    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:19.848700 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:19.848608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:20.334287 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.334258    2560 generic.go:356] "Generic (PLEG): container finished" podID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerID="5cc1d92bd4c35521964d4e4abeb8716f7be3223aa07e5536111235b935529d32" exitCode=0
Jul 17 10:09:20.334446 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.334308    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" event={"ID":"b2957237-6143-428b-9ef8-ed83740f4a4c","Type":"ContainerDied","Data":"5cc1d92bd4c35521964d4e4abeb8716f7be3223aa07e5536111235b935529d32"}
Jul 17 10:09:20.334446 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.334360    2560 scope.go:117] "RemoveContainer" containerID="01ab9659629364dc16510fd116377a36edb735e4994576aec6e37c7094ab171c"
Jul 17 10:09:20.369649 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.369615    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:20.392244 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.392218    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:09:20.404701 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.404620    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-certs\") pod \"b2957237-6143-428b-9ef8-ed83740f4a4c\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") "
Jul 17 10:09:20.404701 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.404662    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-envoy\") pod \"b2957237-6143-428b-9ef8-ed83740f4a4c\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") "
Jul 17 10:09:20.404954 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.404709    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-socket\") pod \"b2957237-6143-428b-9ef8-ed83740f4a4c\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") "
Jul 17 10:09:20.404954 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.404735    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-credential-socket\") pod \"b2957237-6143-428b-9ef8-ed83740f4a4c\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") "
Jul 17 10:09:20.404954 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.404791    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-podinfo\") pod \"b2957237-6143-428b-9ef8-ed83740f4a4c\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") "
Jul 17 10:09:20.404954 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.404847    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trqzc\" (UniqueName: \"kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-kube-api-access-trqzc\") pod \"b2957237-6143-428b-9ef8-ed83740f4a4c\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") "
Jul 17 10:09:20.404954 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.404886    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2957237-6143-428b-9ef8-ed83740f4a4c-istiod-ca-cert\") pod \"b2957237-6143-428b-9ef8-ed83740f4a4c\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") "
Jul 17 10:09:20.404954 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.404912    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-token\") pod \"b2957237-6143-428b-9ef8-ed83740f4a4c\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") "
Jul 17 10:09:20.404954 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.404943    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-data\") pod \"b2957237-6143-428b-9ef8-ed83740f4a4c\" (UID: \"b2957237-6143-428b-9ef8-ed83740f4a4c\") "
Jul 17 10:09:20.405229 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.404980    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2957237-6143-428b-9ef8-ed83740f4a4c" (UID: "b2957237-6143-428b-9ef8-ed83740f4a4c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:09:20.405229 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.405093    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2957237-6143-428b-9ef8-ed83740f4a4c" (UID: "b2957237-6143-428b-9ef8-ed83740f4a4c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:09:20.405328 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.405269    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2957237-6143-428b-9ef8-ed83740f4a4c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2957237-6143-428b-9ef8-ed83740f4a4c" (UID: "b2957237-6143-428b-9ef8-ed83740f4a4c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:09:20.405328 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.405279    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:09:20.405445 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.405326    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-workload-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:09:20.405741 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.405711    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2957237-6143-428b-9ef8-ed83740f4a4c" (UID: "b2957237-6143-428b-9ef8-ed83740f4a4c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:09:20.406592 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.406567    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2957237-6143-428b-9ef8-ed83740f4a4c" (UID: "b2957237-6143-428b-9ef8-ed83740f4a4c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:09:20.407670 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.407635    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-kube-api-access-trqzc" (OuterVolumeSpecName: "kube-api-access-trqzc") pod "b2957237-6143-428b-9ef8-ed83740f4a4c" (UID: "b2957237-6143-428b-9ef8-ed83740f4a4c"). InnerVolumeSpecName "kube-api-access-trqzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:09:20.407797 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.407665    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2957237-6143-428b-9ef8-ed83740f4a4c" (UID: "b2957237-6143-428b-9ef8-ed83740f4a4c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:09:20.407865 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.407807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2957237-6143-428b-9ef8-ed83740f4a4c" (UID: "b2957237-6143-428b-9ef8-ed83740f4a4c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 10:09:20.408497 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.408480    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2957237-6143-428b-9ef8-ed83740f4a4c" (UID: "b2957237-6143-428b-9ef8-ed83740f4a4c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:09:20.471032 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.470991    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:20.506295 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.506257    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-envoy\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:09:20.506295 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.506291    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-credential-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:09:20.506295 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.506301    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-podinfo\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:09:20.506536 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.506312    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trqzc\" (UniqueName: \"kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-kube-api-access-trqzc\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:09:20.506536 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.506321    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2957237-6143-428b-9ef8-ed83740f4a4c-istiod-ca-cert\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:09:20.506536 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.506329    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-token\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:09:20.506536 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:20.506336    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2957237-6143-428b-9ef8-ed83740f4a4c-istio-data\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:09:21.339988 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:21.339948    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx" event={"ID":"b2957237-6143-428b-9ef8-ed83740f4a4c","Type":"ContainerDied","Data":"258dd3553acd9890d4543d42ba063b62ab932874b9c84ac8f6ee569f19ffe096"}
Jul 17 10:09:21.340491 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:21.340013    2560 scope.go:117] "RemoveContainer" containerID="5cc1d92bd4c35521964d4e4abeb8716f7be3223aa07e5536111235b935529d32"
Jul 17 10:09:21.340491 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:21.339965    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"
Jul 17 10:09:21.371931 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:21.371899    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"]
Jul 17 10:09:21.373900 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:21.373879    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-439eab-openshift-default-8558dc9485-9slmx"]
Jul 17 10:09:23.183641 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:23.183604    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" path="/var/lib/kubelet/pods/b2957237-6143-428b-9ef8-ed83740f4a4c/volumes"
Jul 17 10:09:23.946715 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:23.946668    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:24.343523 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.343435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:24.368689 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.368658    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:09:24.669382 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.669343    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"]
Jul 17 10:09:24.669700 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.669686    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy"
Jul 17 10:09:24.669745 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.669702    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy"
Jul 17 10:09:24.669745 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.669711    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d92f1989-cb75-4196-a4dc-9faf33831b7a" containerName="revoke-keys"
Jul 17 10:09:24.669745 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.669718    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d92f1989-cb75-4196-a4dc-9faf33831b7a" containerName="revoke-keys"
Jul 17 10:09:24.669745 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.669730    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy"
Jul 17 10:09:24.669745 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.669736    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy"
Jul 17 10:09:24.669906 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.669804    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy"
Jul 17 10:09:24.669906 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.669811    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d92f1989-cb75-4196-a4dc-9faf33831b7a" containerName="revoke-keys"
Jul 17 10:09:24.669906 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.669818    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2957237-6143-428b-9ef8-ed83740f4a4c" containerName="istio-proxy"
Jul 17 10:09:24.674503 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.674471    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.678195 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.678175    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-8d12ab-openshift-default-dockercfg-ghqrs\""
Jul 17 10:09:24.687736 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.687704    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"]
Jul 17 10:09:24.692075 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.692045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:24.745900 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.745865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-envoy\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.746079 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.745923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqdzg\" (UniqueName: \"kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-kube-api-access-dqdzg\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.746079 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.746015    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-podinfo\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.746079 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.746054    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b1a5841-8123-4274-b667-5fbb3f139dbc-istiod-ca-cert\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.746188 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.746118    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-token\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.746188 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.746178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-data\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.746249 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.746204    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-credential-socket\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.746249 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.746228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-certs\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.746312 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.746250    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-socket\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847150 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-envoy\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847323 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqdzg\" (UniqueName: \"kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-kube-api-access-dqdzg\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847323 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-podinfo\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847323 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847233    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b1a5841-8123-4274-b667-5fbb3f139dbc-istiod-ca-cert\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847323 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847264    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-token\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847589 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-data\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847589 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-credential-socket\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847589 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-certs\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847589 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-socket\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847840 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847716    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-data\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847906 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-credential-socket\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847970 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847928    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-certs\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.847970 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.847961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-socket\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.848118 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.848097    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b1a5841-8123-4274-b667-5fbb3f139dbc-istiod-ca-cert\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.849608 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.849577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-envoy\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.849738 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.849719    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-podinfo\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.858113 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.858090    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-token\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.859621 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.859597    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqdzg\" (UniqueName: \"kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-kube-api-access-dqdzg\") pod \"e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") " pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:24.985040 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:24.984932    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:25.134446 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:25.134408    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"]
Jul 17 10:09:25.138071 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:09:25.138044    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1a5841_8123_4274_b667_5fbb3f139dbc.slice/crio-4eada4a4e1eed6488eca8c29799a95d3c6c576fbd844756aac6ab7f98dc3b303 WatchSource:0}: Error finding container 4eada4a4e1eed6488eca8c29799a95d3c6c576fbd844756aac6ab7f98dc3b303: Status 404 returned error can't find the container with id 4eada4a4e1eed6488eca8c29799a95d3c6c576fbd844756aac6ab7f98dc3b303
Jul 17 10:09:25.140514 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:25.140473    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:09:25.140606 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:25.140553    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:09:25.140606 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:25.140583    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:09:25.309853 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:25.309751    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:25.363476 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:25.363440    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" event={"ID":"7b1a5841-8123-4274-b667-5fbb3f139dbc","Type":"ContainerStarted","Data":"65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2"}
Jul 17 10:09:25.363945 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:25.363502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" event={"ID":"7b1a5841-8123-4274-b667-5fbb3f139dbc","Type":"ContainerStarted","Data":"4eada4a4e1eed6488eca8c29799a95d3c6c576fbd844756aac6ab7f98dc3b303"}
Jul 17 10:09:25.397897 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:25.397830    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" podStartSLOduration=1.397808201 podStartE2EDuration="1.397808201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:09:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:09:25.396819504 +0000 UTC m=+3084.888513909" watchObservedRunningTime="2026-07-17 10:09:25.397808201 +0000 UTC m=+3084.889502603"
Jul 17 10:09:25.985096 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:25.985054    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:26.990805 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:26.990756    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:27.372648 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:27.372562    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:27.373501 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:27.373485    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:27.492692 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:27.492661    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:27.602410 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:27.602370    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:27.747975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:27.747938    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:27.903321 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:27.903277    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:28.269129 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:28.269083    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:28.375436 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:28.375399    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:32.010956 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:32.010921    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:32.782211 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:32.782170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:09:41.289111 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:41.289059    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:41.388700 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:41.388650    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:41.443303 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:41.443261    2560 generic.go:356] "Generic (PLEG): container finished" podID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerID="65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2" exitCode=0
Jul 17 10:09:41.443494 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:41.443317    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" event={"ID":"7b1a5841-8123-4274-b667-5fbb3f139dbc","Type":"ContainerDied","Data":"65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2"}
Jul 17 10:09:41.443851 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:41.443831    2560 scope.go:117] "RemoveContainer" containerID="65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2"
Jul 17 10:09:41.444992 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:41.444961    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:09:41.445070 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:41.445052    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:09:41.445149 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:41.445134    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:09:42.373371 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:42.373335    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:42.449682 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:42.449644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" event={"ID":"7b1a5841-8123-4274-b667-5fbb3f139dbc","Type":"ContainerStarted","Data":"390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149"}
Jul 17 10:09:42.985465 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:42.985425    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:42.986452 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:42.986413    2560 patch_prober.go:28] interesting pod/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 17 10:09:42.986588 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:42.986475    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 17 10:09:43.986195 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:43.986153    2560 patch_prober.go:28] interesting pod/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 17 10:09:43.987204 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:43.987169    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 17 10:09:44.986151 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:44.986111    2560 patch_prober.go:28] interesting pod/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 17 10:09:44.986476 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:44.986442    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 17 10:09:45.986013 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:45.985970    2560 patch_prober.go:28] interesting pod/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 17 10:09:45.986312 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:45.986279    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 17 10:09:46.989598 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:46.989564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:46.990027 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:46.989827    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:46.990678 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:46.990657    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:09:49.356123 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:49.356088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:49.465909 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:49.465870    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:54.600344 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:54.600302    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"]
Jul 17 10:09:54.604228 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:54.604205    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"
Jul 17 10:09:54.607500 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:54.607478    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 10:09:54.607596 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:54.607555    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 10:09:54.615032 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:54.615000    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"]
Jul 17 10:09:54.730467 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:54.730426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45eebeed-61ea-4112-811d-d52b892e85d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f\" (UID: \"45eebeed-61ea-4112-811d-d52b892e85d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"
Jul 17 10:09:54.831032 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:54.830991    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45eebeed-61ea-4112-811d-d52b892e85d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f\" (UID: \"45eebeed-61ea-4112-811d-d52b892e85d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"
Jul 17 10:09:54.831699 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:54.831679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45eebeed-61ea-4112-811d-d52b892e85d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f\" (UID: \"45eebeed-61ea-4112-811d-d52b892e85d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"
Jul 17 10:09:54.914991 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:54.914959    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"
Jul 17 10:09:55.065051 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:55.064952    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"]
Jul 17 10:09:55.067278 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:09:55.067247    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45eebeed_61ea_4112_811d_d52b892e85d8.slice/crio-456fdd84a27cecb8382055de200fc23c9651bb6f67cd6984b127958f0c0d9da9 WatchSource:0}: Error finding container 456fdd84a27cecb8382055de200fc23c9651bb6f67cd6984b127958f0c0d9da9: Status 404 returned error can't find the container with id 456fdd84a27cecb8382055de200fc23c9651bb6f67cd6984b127958f0c0d9da9
Jul 17 10:09:55.448722 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:55.448669    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:09:55.506388 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:55.506351    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f" event={"ID":"45eebeed-61ea-4112-811d-d52b892e85d8","Type":"ContainerStarted","Data":"2a1ddd4df84fb388879d000a52015a1992991b1ec4c57d852ebd973218498e32"}
Jul 17 10:09:55.506734 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:55.506405    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f" event={"ID":"45eebeed-61ea-4112-811d-d52b892e85d8","Type":"ContainerStarted","Data":"456fdd84a27cecb8382055de200fc23c9651bb6f67cd6984b127958f0c0d9da9"}
Jul 17 10:09:55.524840 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:55.524765    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f" podStartSLOduration=1.524746224 podStartE2EDuration="1.524746224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:09:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:09:55.523012675 +0000 UTC m=+3115.014707082" watchObservedRunningTime="2026-07-17 10:09:55.524746224 +0000 UTC m=+3115.016440630"
Jul 17 10:09:56.512620 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:56.512584    2560 generic.go:356] "Generic (PLEG): container finished" podID="45eebeed-61ea-4112-811d-d52b892e85d8" containerID="2a1ddd4df84fb388879d000a52015a1992991b1ec4c57d852ebd973218498e32" exitCode=6
Jul 17 10:09:56.513044 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:56.512669    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f" event={"ID":"45eebeed-61ea-4112-811d-d52b892e85d8","Type":"ContainerDied","Data":"2a1ddd4df84fb388879d000a52015a1992991b1ec4c57d852ebd973218498e32"}
Jul 17 10:09:56.513044 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:56.512872    2560 scope.go:117] "RemoveContainer" containerID="2a1ddd4df84fb388879d000a52015a1992991b1ec4c57d852ebd973218498e32"
Jul 17 10:09:57.519565 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:57.519528    2560 generic.go:356] "Generic (PLEG): container finished" podID="45eebeed-61ea-4112-811d-d52b892e85d8" containerID="08eb66fe145a4e27925a1289172f3e18586805dcd3604f609c6b97a6d7b4cd30" exitCode=6
Jul 17 10:09:57.520074 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:57.519585    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f" event={"ID":"45eebeed-61ea-4112-811d-d52b892e85d8","Type":"ContainerDied","Data":"08eb66fe145a4e27925a1289172f3e18586805dcd3604f609c6b97a6d7b4cd30"}
Jul 17 10:09:57.520074 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:57.519639    2560 scope.go:117] "RemoveContainer" containerID="2a1ddd4df84fb388879d000a52015a1992991b1ec4c57d852ebd973218498e32"
Jul 17 10:09:57.520074 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:57.519848    2560 scope.go:117] "RemoveContainer" containerID="08eb66fe145a4e27925a1289172f3e18586805dcd3604f609c6b97a6d7b4cd30"
Jul 17 10:09:57.520236 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:09:57.520113    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f_odh-ai-gateway-infra(45eebeed-61ea-4112-811d-d52b892e85d8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f" podUID="45eebeed-61ea-4112-811d-d52b892e85d8"
Jul 17 10:09:58.525764 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:58.525734    2560 scope.go:117] "RemoveContainer" containerID="08eb66fe145a4e27925a1289172f3e18586805dcd3604f609c6b97a6d7b4cd30"
Jul 17 10:09:58.526186 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:09:58.525970    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f_odh-ai-gateway-infra(45eebeed-61ea-4112-811d-d52b892e85d8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f" podUID="45eebeed-61ea-4112-811d-d52b892e85d8"
Jul 17 10:09:58.865762 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:09:58.865674    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:10:09.179042 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:09.179000    2560 scope.go:117] "RemoveContainer" containerID="08eb66fe145a4e27925a1289172f3e18586805dcd3604f609c6b97a6d7b4cd30"
Jul 17 10:10:09.576434 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:09.576340    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f" event={"ID":"45eebeed-61ea-4112-811d-d52b892e85d8","Type":"ContainerStarted","Data":"d12f5435b33ed612f833aa737b9b4a4f8df27c657088e37dad60b8b966504082"}
Jul 17 10:10:10.582558 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:10.582470    2560 generic.go:356] "Generic (PLEG): container finished" podID="45eebeed-61ea-4112-811d-d52b892e85d8" containerID="d12f5435b33ed612f833aa737b9b4a4f8df27c657088e37dad60b8b966504082" exitCode=6
Jul 17 10:10:10.582558 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:10.582536    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f" event={"ID":"45eebeed-61ea-4112-811d-d52b892e85d8","Type":"ContainerDied","Data":"d12f5435b33ed612f833aa737b9b4a4f8df27c657088e37dad60b8b966504082"}
Jul 17 10:10:10.583046 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:10.582602    2560 scope.go:117] "RemoveContainer" containerID="08eb66fe145a4e27925a1289172f3e18586805dcd3604f609c6b97a6d7b4cd30"
Jul 17 10:10:10.583046 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:10.583001    2560 scope.go:117] "RemoveContainer" containerID="d12f5435b33ed612f833aa737b9b4a4f8df27c657088e37dad60b8b966504082"
Jul 17 10:10:10.583226 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:10:10.583205    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f_odh-ai-gateway-infra(45eebeed-61ea-4112-811d-d52b892e85d8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f" podUID="45eebeed-61ea-4112-811d-d52b892e85d8"
Jul 17 10:10:10.616046 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:10.616021    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"]
Jul 17 10:10:11.714904 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:11.714879    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"
Jul 17 10:10:11.774057 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:11.774021    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45eebeed-61ea-4112-811d-d52b892e85d8-maas-api-service-ca\") pod \"45eebeed-61ea-4112-811d-d52b892e85d8\" (UID: \"45eebeed-61ea-4112-811d-d52b892e85d8\") "
Jul 17 10:10:11.774380 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:11.774357    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45eebeed-61ea-4112-811d-d52b892e85d8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "45eebeed-61ea-4112-811d-d52b892e85d8" (UID: "45eebeed-61ea-4112-811d-d52b892e85d8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:10:11.874996 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:11.874902    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45eebeed-61ea-4112-811d-d52b892e85d8-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:10:12.593987 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:12.593953    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"
Jul 17 10:10:12.594183 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:12.593953    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f" event={"ID":"45eebeed-61ea-4112-811d-d52b892e85d8","Type":"ContainerDied","Data":"456fdd84a27cecb8382055de200fc23c9651bb6f67cd6984b127958f0c0d9da9"}
Jul 17 10:10:12.594183 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:12.594088    2560 scope.go:117] "RemoveContainer" containerID="d12f5435b33ed612f833aa737b9b4a4f8df27c657088e37dad60b8b966504082"
Jul 17 10:10:12.616337 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:12.616312    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"]
Jul 17 10:10:12.621468 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:12.621444    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-58adf1ce-h7p7f"]
Jul 17 10:10:13.183436 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:13.183398    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45eebeed-61ea-4112-811d-d52b892e85d8" path="/var/lib/kubelet/pods/45eebeed-61ea-4112-811d-d52b892e85d8/volumes"
Jul 17 10:10:43.306450 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.306361    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"]
Jul 17 10:10:43.306852 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.306661    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45eebeed-61ea-4112-811d-d52b892e85d8" containerName="revoke-keys"
Jul 17 10:10:43.306852 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.306672    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="45eebeed-61ea-4112-811d-d52b892e85d8" containerName="revoke-keys"
Jul 17 10:10:43.306852 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.306688    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45eebeed-61ea-4112-811d-d52b892e85d8" containerName="revoke-keys"
Jul 17 10:10:43.306852 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.306694    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="45eebeed-61ea-4112-811d-d52b892e85d8" containerName="revoke-keys"
Jul 17 10:10:43.306852 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.306702    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45eebeed-61ea-4112-811d-d52b892e85d8" containerName="revoke-keys"
Jul 17 10:10:43.306852 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.306707    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="45eebeed-61ea-4112-811d-d52b892e85d8" containerName="revoke-keys"
Jul 17 10:10:43.306852 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.306764    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="45eebeed-61ea-4112-811d-d52b892e85d8" containerName="revoke-keys"
Jul 17 10:10:43.306852 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.306790    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="45eebeed-61ea-4112-811d-d52b892e85d8" containerName="revoke-keys"
Jul 17 10:10:43.309643 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.309626    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.312411 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.312386    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"kube-root-ca.crt\""
Jul 17 10:10:43.313565 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.313538    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"auth-test-model-8d12ab-kserve-self-signed-certs\""
Jul 17 10:10:43.313721 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.313583    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"default-dockercfg-xfmbv\""
Jul 17 10:10:43.313721 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.313545    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"openshift-service-ca.crt\""
Jul 17 10:10:43.318883 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.318860    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"]
Jul 17 10:10:43.339058 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.339022    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:10:43.363354 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.363313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tls-certs\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.363354 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.363355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-home\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.363593 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.363398    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztxbj\" (UniqueName: \"kubernetes.io/projected/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-kube-api-access-ztxbj\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.363593 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.363441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-model-cache\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.363593 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.363479    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tmp-dir\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.363593 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.363520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-dshm\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.464114 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.464076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tls-certs\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.464114 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.464119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-home\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.464368 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.464166    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztxbj\" (UniqueName: \"kubernetes.io/projected/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-kube-api-access-ztxbj\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.464368 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.464283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-model-cache\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.464368 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.464343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tmp-dir\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.464538 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.464404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-dshm\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.464598 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.464547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-home\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.464658 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.464611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-model-cache\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.464658 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.464641    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tmp-dir\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.466435 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.466407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-dshm\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.466663 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.466644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tls-certs\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.474267 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.474234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztxbj\" (UniqueName: \"kubernetes.io/projected/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-kube-api-access-ztxbj\") pod \"auth-test-model-8d12ab-kserve-56bc469b75-t9jnh\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") " pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.619221 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.619120    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:43.757056 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:43.757020    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"]
Jul 17 10:10:43.760765 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:10:43.760739    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0acd1ef_4bcb_4b1c_864d_cdf2b20383df.slice/crio-e7d9ac0f5dad52d15d63b8d88e0f2b4f07aaccae7137a401d29fa7ee7f530126 WatchSource:0}: Error finding container e7d9ac0f5dad52d15d63b8d88e0f2b4f07aaccae7137a401d29fa7ee7f530126: Status 404 returned error can't find the container with id e7d9ac0f5dad52d15d63b8d88e0f2b4f07aaccae7137a401d29fa7ee7f530126
Jul 17 10:10:44.738681 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:44.738644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh" event={"ID":"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df","Type":"ContainerStarted","Data":"d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7"}
Jul 17 10:10:44.738681 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:44.738688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh" event={"ID":"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df","Type":"ContainerStarted","Data":"e7d9ac0f5dad52d15d63b8d88e0f2b4f07aaccae7137a401d29fa7ee7f530126"}
Jul 17 10:10:44.758366 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:44.758301    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh" podStartSLOduration=1.758283324 podStartE2EDuration="1.758283324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:10:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:10:44.758163589 +0000 UTC m=+3164.249858005" watchObservedRunningTime="2026-07-17 10:10:44.758283324 +0000 UTC m=+3164.249977728"
Jul 17 10:10:47.183792 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:47.183743    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:10:53.620040 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:53.619993    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:53.620558 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:53.620059    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:53.632198 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:53.632165    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:53.788191 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:53.788159    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:10:58.375717 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:10:58.375680    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:11:09.875231 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:11:09.875200    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:11:26.555372 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:11:26.555333    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:11:45.164445 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:11:45.164410    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:12:03.502403 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:12:03.502309    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:12:22.287117 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:12:22.287076    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:12:39.189302 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:12:39.189270    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:12:49.299482 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:12:49.299439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:12:50.449577 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:12:50.449542    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:12:51.317711 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:12:51.317676    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"]
Jul 17 10:12:51.332048 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:12:51.331994    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:12:54.683385 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:12:54.683347    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:12:57.507674 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:12:57.507621    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:13:06.337323 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.337260    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh" podUID="f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" containerName="main" containerID="cri-o://d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7" gracePeriod=45
Jul 17 10:13:06.584694 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.584662    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:13:06.714284 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.714252    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-model-cache\") pod \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") "
Jul 17 10:13:06.714503 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.714295    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-dshm\") pod \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") "
Jul 17 10:13:06.714503 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.714335    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tls-certs\") pod \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") "
Jul 17 10:13:06.714503 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.714363    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztxbj\" (UniqueName: \"kubernetes.io/projected/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-kube-api-access-ztxbj\") pod \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") "
Jul 17 10:13:06.714503 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.714397    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-home\") pod \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") "
Jul 17 10:13:06.714503 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.714441    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tmp-dir\") pod \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\" (UID: \"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df\") "
Jul 17 10:13:06.714800 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.714563    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" (UID: "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:13:06.714800 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.714713    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-home" (OuterVolumeSpecName: "home") pod "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" (UID: "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:13:06.714921 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.714823    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-model-cache\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:13:06.714921 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.714829    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" (UID: "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:13:06.716643 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.716618    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-dshm" (OuterVolumeSpecName: "dshm") pod "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" (UID: "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:13:06.716767 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.716685    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" (UID: "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:13:06.716767 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.716690    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-kube-api-access-ztxbj" (OuterVolumeSpecName: "kube-api-access-ztxbj") pod "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" (UID: "f0acd1ef-4bcb-4b1c-864d-cdf2b20383df"). InnerVolumeSpecName "kube-api-access-ztxbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:13:06.777625 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.777588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:13:06.815871 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.815833    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-dshm\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:13:06.815871 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.815866    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tls-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:13:06.815871 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.815881    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztxbj\" (UniqueName: \"kubernetes.io/projected/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-kube-api-access-ztxbj\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:13:06.816130 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.815892    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-home\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:13:06.816130 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.815930    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df-tmp-dir\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:13:06.865181 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:06.865142    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:13:07.367602 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:07.367565    2560 generic.go:356] "Generic (PLEG): container finished" podID="f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" containerID="d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7" exitCode=0
Jul 17 10:13:07.367602 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:07.367612    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"
Jul 17 10:13:07.368172 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:07.367657    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh" event={"ID":"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df","Type":"ContainerDied","Data":"d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7"}
Jul 17 10:13:07.368172 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:07.367698    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh" event={"ID":"f0acd1ef-4bcb-4b1c-864d-cdf2b20383df","Type":"ContainerDied","Data":"e7d9ac0f5dad52d15d63b8d88e0f2b4f07aaccae7137a401d29fa7ee7f530126"}
Jul 17 10:13:07.368172 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:07.367718    2560 scope.go:117] "RemoveContainer" containerID="d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7"
Jul 17 10:13:07.376374 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:07.376354    2560 scope.go:117] "RemoveContainer" containerID="d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7"
Jul 17 10:13:07.376658 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:13:07.376635    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7\": container with ID starting with d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7 not found: ID does not exist" containerID="d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7"
Jul 17 10:13:07.376730 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:07.376662    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7"} err="failed to get container status \"d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7\": rpc error: code = NotFound desc = could not find container \"d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7\": container with ID starting with d2c953d2eaa3ca7c3bedfa938f6cc0d829f5b9ebbeed83ae656fd007f72bdde7 not found: ID does not exist"
Jul 17 10:13:07.387096 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:07.387068    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"]
Jul 17 10:13:07.393551 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:07.393524    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/auth-test-model-8d12ab-kserve-56bc469b75-t9jnh"]
Jul 17 10:13:09.184148 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:09.184108    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" path="/var/lib/kubelet/pods/f0acd1ef-4bcb-4b1c-864d-cdf2b20383df/volumes"
Jul 17 10:13:10.660920 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:10.660882    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:13:16.040399 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.040366    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"]
Jul 17 10:13:16.040837 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.040679    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" containerName="main"
Jul 17 10:13:16.040837 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.040691    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" containerName="main"
Jul 17 10:13:16.040837 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.040751    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0acd1ef-4bcb-4b1c-864d-cdf2b20383df" containerName="main"
Jul 17 10:13:16.040837 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.040759    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="45eebeed-61ea-4112-811d-d52b892e85d8" containerName="revoke-keys"
Jul 17 10:13:16.043642 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.043624    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.051203 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.051171    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"default-dockercfg-xfmbv\""
Jul 17 10:13:16.051666 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.051643    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"sub-test-model-8d12ab-kserve-self-signed-certs\""
Jul 17 10:13:16.052023 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.051739    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"openshift-service-ca.crt\""
Jul 17 10:13:16.052304 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.051817    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"kube-root-ca.crt\""
Jul 17 10:13:16.062701 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.062673    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"]
Jul 17 10:13:16.096733 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.096698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw7lf\" (UniqueName: \"kubernetes.io/projected/ab0b56f5-52a0-47bf-8b46-6b78c8674653-kube-api-access-lw7lf\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.096933 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.096752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tmp-dir\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.096933 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.096895    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-home\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.096933 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.096929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-model-cache\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.097039 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.096990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-dshm\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.097039 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.097015    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tls-certs\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.103222 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.103187    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:13:16.197556 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.197515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-dshm\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.197556 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.197556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tls-certs\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.197878 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.197584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw7lf\" (UniqueName: \"kubernetes.io/projected/ab0b56f5-52a0-47bf-8b46-6b78c8674653-kube-api-access-lw7lf\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.197878 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.197614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tmp-dir\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.197878 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.197690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-home\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.197878 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.197718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-model-cache\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.198142 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.198115    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tmp-dir\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.198205 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.198128    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-home\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.198289 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.198210    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-model-cache\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.200015 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.199996    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-dshm\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.200154 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.200136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tls-certs\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.208963 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.208937    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw7lf\" (UniqueName: \"kubernetes.io/projected/ab0b56f5-52a0-47bf-8b46-6b78c8674653-kube-api-access-lw7lf\") pod \"sub-test-model-8d12ab-kserve-9c6d46447-v2xjl\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") " pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.356760 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.356659    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:16.504239 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:16.504208    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"]
Jul 17 10:13:16.506265 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:13:16.506227    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab0b56f5_52a0_47bf_8b46_6b78c8674653.slice/crio-baa7613a775a5ea2adcf248c5e1257b0ee5804c06a79b225c11c78537d27f3a7 WatchSource:0}: Error finding container baa7613a775a5ea2adcf248c5e1257b0ee5804c06a79b225c11c78537d27f3a7: Status 404 returned error can't find the container with id baa7613a775a5ea2adcf248c5e1257b0ee5804c06a79b225c11c78537d27f3a7
Jul 17 10:13:17.415940 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:17.415904    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl" event={"ID":"ab0b56f5-52a0-47bf-8b46-6b78c8674653","Type":"ContainerStarted","Data":"1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385"}
Jul 17 10:13:17.415940 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:17.415946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl" event={"ID":"ab0b56f5-52a0-47bf-8b46-6b78c8674653","Type":"ContainerStarted","Data":"baa7613a775a5ea2adcf248c5e1257b0ee5804c06a79b225c11c78537d27f3a7"}
Jul 17 10:13:17.465470 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:17.465410    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl" podStartSLOduration=1.465391011 podStartE2EDuration="1.465391011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:13:17.464196858 +0000 UTC m=+3316.955891259" watchObservedRunningTime="2026-07-17 10:13:17.465391011 +0000 UTC m=+3316.957085416"
Jul 17 10:13:21.582032 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:21.581988    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:13:26.357611 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:26.357502    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:26.357611 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:26.357572    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:26.369387 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:26.369362    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:26.469896 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:26.469866    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:13:44.461979 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:44.461941    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:13:55.658225 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:55.658188    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:13:55.757533 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:13:55.757505    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:14:02.908488 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:02.908457    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:14:08.826211 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:08.826170    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:14:09.781051 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:09.781018    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"]
Jul 17 10:14:09.837494 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:09.837463    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:14:14.383287 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:14.383251    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:14:16.329643 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:16.329608    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:14:21.266164 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:21.266114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:14:24.799983 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:24.799923    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl" podUID="ab0b56f5-52a0-47bf-8b46-6b78c8674653" containerName="main" containerID="cri-o://1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385" gracePeriod=45
Jul 17 10:14:25.047296 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.047271    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:14:25.130205 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.130126    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tmp-dir\") pod \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") "
Jul 17 10:14:25.130356 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.130212    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-model-cache\") pod \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") "
Jul 17 10:14:25.130356 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.130244    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tls-certs\") pod \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") "
Jul 17 10:14:25.130356 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.130266    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-dshm\") pod \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") "
Jul 17 10:14:25.130356 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.130292    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw7lf\" (UniqueName: \"kubernetes.io/projected/ab0b56f5-52a0-47bf-8b46-6b78c8674653-kube-api-access-lw7lf\") pod \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") "
Jul 17 10:14:25.130356 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.130351    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-home\") pod \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\" (UID: \"ab0b56f5-52a0-47bf-8b46-6b78c8674653\") "
Jul 17 10:14:25.130593 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.130405    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ab0b56f5-52a0-47bf-8b46-6b78c8674653" (UID: "ab0b56f5-52a0-47bf-8b46-6b78c8674653"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:14:25.130593 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.130470    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-model-cache" (OuterVolumeSpecName: "model-cache") pod "ab0b56f5-52a0-47bf-8b46-6b78c8674653" (UID: "ab0b56f5-52a0-47bf-8b46-6b78c8674653"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:14:25.130695 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.130636    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-home" (OuterVolumeSpecName: "home") pod "ab0b56f5-52a0-47bf-8b46-6b78c8674653" (UID: "ab0b56f5-52a0-47bf-8b46-6b78c8674653"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:14:25.130739 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.130696    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tmp-dir\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:14:25.130739 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.130716    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-model-cache\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:14:25.132434 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.132409    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0b56f5-52a0-47bf-8b46-6b78c8674653-kube-api-access-lw7lf" (OuterVolumeSpecName: "kube-api-access-lw7lf") pod "ab0b56f5-52a0-47bf-8b46-6b78c8674653" (UID: "ab0b56f5-52a0-47bf-8b46-6b78c8674653"). InnerVolumeSpecName "kube-api-access-lw7lf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:14:25.132771 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.132751    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ab0b56f5-52a0-47bf-8b46-6b78c8674653" (UID: "ab0b56f5-52a0-47bf-8b46-6b78c8674653"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:14:25.132848 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.132751    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-dshm" (OuterVolumeSpecName: "dshm") pod "ab0b56f5-52a0-47bf-8b46-6b78c8674653" (UID: "ab0b56f5-52a0-47bf-8b46-6b78c8674653"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:14:25.232139 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.232110    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-home\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:14:25.232139 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.232135    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab0b56f5-52a0-47bf-8b46-6b78c8674653-tls-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:14:25.232139 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.232145    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab0b56f5-52a0-47bf-8b46-6b78c8674653-dshm\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:14:25.232374 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.232153    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw7lf\" (UniqueName: \"kubernetes.io/projected/ab0b56f5-52a0-47bf-8b46-6b78c8674653-kube-api-access-lw7lf\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:14:25.731793 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.731743    2560 generic.go:356] "Generic (PLEG): container finished" podID="ab0b56f5-52a0-47bf-8b46-6b78c8674653" containerID="1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385" exitCode=0
Jul 17 10:14:25.731979 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.731801    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"
Jul 17 10:14:25.731979 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.731831    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl" event={"ID":"ab0b56f5-52a0-47bf-8b46-6b78c8674653","Type":"ContainerDied","Data":"1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385"}
Jul 17 10:14:25.731979 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.731873    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl" event={"ID":"ab0b56f5-52a0-47bf-8b46-6b78c8674653","Type":"ContainerDied","Data":"baa7613a775a5ea2adcf248c5e1257b0ee5804c06a79b225c11c78537d27f3a7"}
Jul 17 10:14:25.731979 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.731892    2560 scope.go:117] "RemoveContainer" containerID="1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385"
Jul 17 10:14:25.739858 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.739839    2560 scope.go:117] "RemoveContainer" containerID="1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385"
Jul 17 10:14:25.740151 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:14:25.740134    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385\": container with ID starting with 1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385 not found: ID does not exist" containerID="1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385"
Jul 17 10:14:25.740215 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.740158    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385"} err="failed to get container status \"1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385\": rpc error: code = NotFound desc = could not find container \"1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385\": container with ID starting with 1748d8ad6d4c8ced17e3078f163bcfa27da67e23738f2bda44c01828d1bde385 not found: ID does not exist"
Jul 17 10:14:25.763363 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.763336    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"]
Jul 17 10:14:25.771562 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:25.771534    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/sub-test-model-8d12ab-kserve-9c6d46447-v2xjl"]
Jul 17 10:14:27.183412 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:27.183377    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab0b56f5-52a0-47bf-8b46-6b78c8674653" path="/var/lib/kubelet/pods/ab0b56f5-52a0-47bf-8b46-6b78c8674653/volumes"
Jul 17 10:14:42.248644 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:42.248611    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:14:42.355477 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:42.355440    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:14:50.133253 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.133216    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"]
Jul 17 10:14:50.133647 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.133512    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0b56f5-52a0-47bf-8b46-6b78c8674653" containerName="main"
Jul 17 10:14:50.133647 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.133522    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0b56f5-52a0-47bf-8b46-6b78c8674653" containerName="main"
Jul 17 10:14:50.133647 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.133600    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0b56f5-52a0-47bf-8b46-6b78c8674653" containerName="main"
Jul 17 10:14:50.136514 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.136498    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.143023 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.142838    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"default-dockercfg-xfmbv\""
Jul 17 10:14:50.143023 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.142859    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"openshift-service-ca.crt\""
Jul 17 10:14:50.143173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.143067    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"kube-root-ca.crt\""
Jul 17 10:14:50.143173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.143115    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8d12ab\"/\"rate-test-model-8d12ab-kserve-self-signed-certs\""
Jul 17 10:14:50.162973 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.162948    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"]
Jul 17 10:14:50.173754 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.173722    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:14:50.230964 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.230932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sqn6\" (UniqueName: \"kubernetes.io/projected/ef5d4af2-3d10-4373-9257-f24ac4df5973-kube-api-access-9sqn6\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.231153 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.231005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-dshm\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.231153 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.231033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-home\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.231153 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.231070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-model-cache\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.231153 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.231093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef5d4af2-3d10-4373-9257-f24ac4df5973-tls-certs\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.231317 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.231157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-tmp-dir\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.331650 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.331610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-tmp-dir\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.331866 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.331671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sqn6\" (UniqueName: \"kubernetes.io/projected/ef5d4af2-3d10-4373-9257-f24ac4df5973-kube-api-access-9sqn6\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.331866 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.331726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-dshm\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.331866 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.331752    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-home\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.331866 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.331815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-model-cache\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.331866 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.331837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef5d4af2-3d10-4373-9257-f24ac4df5973-tls-certs\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.332168 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.332032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-tmp-dir\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.332168 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.332156    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-model-cache\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.332275 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.332182    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-home\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.333934 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.333906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-dshm\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.334160 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.334145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef5d4af2-3d10-4373-9257-f24ac4df5973-tls-certs\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.344369 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.344349    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sqn6\" (UniqueName: \"kubernetes.io/projected/ef5d4af2-3d10-4373-9257-f24ac4df5973-kube-api-access-9sqn6\") pod \"rate-test-model-8d12ab-kserve-5c658b5967-gtnzw\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") " pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.445946 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.445909    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:14:50.580707 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.580616    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"]
Jul 17 10:14:50.582981 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:14:50.582955    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef5d4af2_3d10_4373_9257_f24ac4df5973.slice/crio-84ce8dc33d73bc35cefebe27d2414e945f7bb3e76082941f328f843677dd6737 WatchSource:0}: Error finding container 84ce8dc33d73bc35cefebe27d2414e945f7bb3e76082941f328f843677dd6737: Status 404 returned error can't find the container with id 84ce8dc33d73bc35cefebe27d2414e945f7bb3e76082941f328f843677dd6737
Jul 17 10:14:50.601549 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.601519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:14:50.706977 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.706895    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:14:50.838318 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.838285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw" event={"ID":"ef5d4af2-3d10-4373-9257-f24ac4df5973","Type":"ContainerStarted","Data":"0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8"}
Jul 17 10:14:50.838318 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:50.838322    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw" event={"ID":"ef5d4af2-3d10-4373-9257-f24ac4df5973","Type":"ContainerStarted","Data":"84ce8dc33d73bc35cefebe27d2414e945f7bb3e76082941f328f843677dd6737"}
Jul 17 10:14:54.951214 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:54.951102    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw" podStartSLOduration=4.951082941 podStartE2EDuration="4.951082941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:14:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:14:50.871741769 +0000 UTC m=+3410.363436176" watchObservedRunningTime="2026-07-17 10:14:54.951082941 +0000 UTC m=+3414.442777346"
Jul 17 10:14:54.952563 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:14:54.952543    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:15:00.446367 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:00.446323    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:15:00.446367 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:00.446377    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:15:00.458833 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:00.458802    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:15:00.895204 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:00.895172    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:15:09.765789 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:09.765731    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:15:26.977215 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:26.977181    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:15:33.793170 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:33.793130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:15:34.617402 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:34.617367    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"]
Jul 17 10:15:34.648833 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:34.648803    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:15:46.790950 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:46.790910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:15:48.724880 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:48.724843    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7220-139733724416592"]
Jul 17 10:15:48.728084 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:48.728065    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:48.731358 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:48.731332    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8l869\""
Jul 17 10:15:48.742810 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:48.742771    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7220-139733724416592"]
Jul 17 10:15:48.757128 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:48.757105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvqsj\" (UniqueName: \"kubernetes.io/projected/34da1b6b-626a-4765-ad9b-f17801811f42-kube-api-access-vvqsj\") pod \"test-curl-7220-139733724416592\" (UID: \"34da1b6b-626a-4765-ad9b-f17801811f42\") " pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:48.857633 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:48.857597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqsj\" (UniqueName: \"kubernetes.io/projected/34da1b6b-626a-4765-ad9b-f17801811f42-kube-api-access-vvqsj\") pod \"test-curl-7220-139733724416592\" (UID: \"34da1b6b-626a-4765-ad9b-f17801811f42\") " pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:48.875296 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:48.875263    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvqsj\" (UniqueName: \"kubernetes.io/projected/34da1b6b-626a-4765-ad9b-f17801811f42-kube-api-access-vvqsj\") pod \"test-curl-7220-139733724416592\" (UID: \"34da1b6b-626a-4765-ad9b-f17801811f42\") " pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:49.036884 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:49.036805    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:49.174717 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:49.174687    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7220-139733724416592"]
Jul 17 10:15:49.178213 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:15:49.178180    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34da1b6b_626a_4765_ad9b_f17801811f42.slice/crio-45669f189892e9e04679fb147fd9c6bc307624ee97ae7913a09fbdfd59d7ad33 WatchSource:0}: Error finding container 45669f189892e9e04679fb147fd9c6bc307624ee97ae7913a09fbdfd59d7ad33: Status 404 returned error can't find the container with id 45669f189892e9e04679fb147fd9c6bc307624ee97ae7913a09fbdfd59d7ad33
Jul 17 10:15:49.179864 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:49.179842    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 10:15:49.636834 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:49.636749    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw" podUID="ef5d4af2-3d10-4373-9257-f24ac4df5973" containerName="main" containerID="cri-o://0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8" gracePeriod=45
Jul 17 10:15:50.002310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.002281    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:15:50.067931 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.067900    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-dshm\") pod \"ef5d4af2-3d10-4373-9257-f24ac4df5973\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") "
Jul 17 10:15:50.068091 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.067955    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-model-cache\") pod \"ef5d4af2-3d10-4373-9257-f24ac4df5973\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") "
Jul 17 10:15:50.068091 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.067990    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-tmp-dir\") pod \"ef5d4af2-3d10-4373-9257-f24ac4df5973\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") "
Jul 17 10:15:50.068091 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.068061    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sqn6\" (UniqueName: \"kubernetes.io/projected/ef5d4af2-3d10-4373-9257-f24ac4df5973-kube-api-access-9sqn6\") pod \"ef5d4af2-3d10-4373-9257-f24ac4df5973\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") "
Jul 17 10:15:50.068205 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.068091    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-home\") pod \"ef5d4af2-3d10-4373-9257-f24ac4df5973\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") "
Jul 17 10:15:50.068205 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.068139    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef5d4af2-3d10-4373-9257-f24ac4df5973-tls-certs\") pod \"ef5d4af2-3d10-4373-9257-f24ac4df5973\" (UID: \"ef5d4af2-3d10-4373-9257-f24ac4df5973\") "
Jul 17 10:15:50.068324 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.068287    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef5d4af2-3d10-4373-9257-f24ac4df5973" (UID: "ef5d4af2-3d10-4373-9257-f24ac4df5973"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:15:50.068324 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.068304    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef5d4af2-3d10-4373-9257-f24ac4df5973" (UID: "ef5d4af2-3d10-4373-9257-f24ac4df5973"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:15:50.068459 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.068416    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-home" (OuterVolumeSpecName: "home") pod "ef5d4af2-3d10-4373-9257-f24ac4df5973" (UID: "ef5d4af2-3d10-4373-9257-f24ac4df5973"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:15:50.068542 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.068526    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-model-cache\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:15:50.068614 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.068544    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-tmp-dir\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:15:50.068614 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.068553    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-home\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:15:50.070087 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.070061    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-dshm" (OuterVolumeSpecName: "dshm") pod "ef5d4af2-3d10-4373-9257-f24ac4df5973" (UID: "ef5d4af2-3d10-4373-9257-f24ac4df5973"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:15:50.070203 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.070183    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef5d4af2-3d10-4373-9257-f24ac4df5973-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef5d4af2-3d10-4373-9257-f24ac4df5973" (UID: "ef5d4af2-3d10-4373-9257-f24ac4df5973"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:15:50.070253 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.070193    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef5d4af2-3d10-4373-9257-f24ac4df5973-kube-api-access-9sqn6" (OuterVolumeSpecName: "kube-api-access-9sqn6") pod "ef5d4af2-3d10-4373-9257-f24ac4df5973" (UID: "ef5d4af2-3d10-4373-9257-f24ac4df5973"). InnerVolumeSpecName "kube-api-access-9sqn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:15:50.107383 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.107356    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef5d4af2-3d10-4373-9257-f24ac4df5973" containerID="0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8" exitCode=0
Jul 17 10:15:50.107537 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.107394    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"
Jul 17 10:15:50.107537 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.107436    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw" event={"ID":"ef5d4af2-3d10-4373-9257-f24ac4df5973","Type":"ContainerDied","Data":"0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8"}
Jul 17 10:15:50.107537 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.107474    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw" event={"ID":"ef5d4af2-3d10-4373-9257-f24ac4df5973","Type":"ContainerDied","Data":"84ce8dc33d73bc35cefebe27d2414e945f7bb3e76082941f328f843677dd6737"}
Jul 17 10:15:50.107537 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.107498    2560 scope.go:117] "RemoveContainer" containerID="0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8"
Jul 17 10:15:50.108889 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.108866    2560 generic.go:356] "Generic (PLEG): container finished" podID="34da1b6b-626a-4765-ad9b-f17801811f42" containerID="29075641740da731b6ae887677890b739e4b06a98bb4ea1a9edfed9bdadbb87e" exitCode=0
Jul 17 10:15:50.108992 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.108967    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7220-139733724416592" event={"ID":"34da1b6b-626a-4765-ad9b-f17801811f42","Type":"ContainerDied","Data":"29075641740da731b6ae887677890b739e4b06a98bb4ea1a9edfed9bdadbb87e"}
Jul 17 10:15:50.109058 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.109011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7220-139733724416592" event={"ID":"34da1b6b-626a-4765-ad9b-f17801811f42","Type":"ContainerStarted","Data":"45669f189892e9e04679fb147fd9c6bc307624ee97ae7913a09fbdfd59d7ad33"}
Jul 17 10:15:50.115614 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.115590    2560 scope.go:117] "RemoveContainer" containerID="0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8"
Jul 17 10:15:50.115916 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:15:50.115895    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8\": container with ID starting with 0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8 not found: ID does not exist" containerID="0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8"
Jul 17 10:15:50.116012 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.115925    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8"} err="failed to get container status \"0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8\": rpc error: code = NotFound desc = could not find container \"0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8\": container with ID starting with 0bb2291a857a1e9c4aa6d2f702a97b520c203f15e2052a3c7436ebfda5b495c8 not found: ID does not exist"
Jul 17 10:15:50.146259 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.146229    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"]
Jul 17 10:15:50.152764 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.152741    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8d12ab/rate-test-model-8d12ab-kserve-5c658b5967-gtnzw"]
Jul 17 10:15:50.169706 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.169652    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sqn6\" (UniqueName: \"kubernetes.io/projected/ef5d4af2-3d10-4373-9257-f24ac4df5973-kube-api-access-9sqn6\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:15:50.169706 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.169673    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef5d4af2-3d10-4373-9257-f24ac4df5973-tls-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:15:50.169706 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:50.169683    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef5d4af2-3d10-4373-9257-f24ac4df5973-dshm\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:15:51.185676 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.185648    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef5d4af2-3d10-4373-9257-f24ac4df5973" path="/var/lib/kubelet/pods/ef5d4af2-3d10-4373-9257-f24ac4df5973/volumes"
Jul 17 10:15:51.245745 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.245722    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:51.280206 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.280182    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvqsj\" (UniqueName: \"kubernetes.io/projected/34da1b6b-626a-4765-ad9b-f17801811f42-kube-api-access-vvqsj\") pod \"34da1b6b-626a-4765-ad9b-f17801811f42\" (UID: \"34da1b6b-626a-4765-ad9b-f17801811f42\") "
Jul 17 10:15:51.282426 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.282396    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34da1b6b-626a-4765-ad9b-f17801811f42-kube-api-access-vvqsj" (OuterVolumeSpecName: "kube-api-access-vvqsj") pod "34da1b6b-626a-4765-ad9b-f17801811f42" (UID: "34da1b6b-626a-4765-ad9b-f17801811f42"). InnerVolumeSpecName "kube-api-access-vvqsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:15:51.307347 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.307319    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7220-139733724416592_34da1b6b-626a-4765-ad9b-f17801811f42/test-curl-7220-139733724416592/0.log"
Jul 17 10:15:51.346672 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.346640    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7220-139733724416592"]
Jul 17 10:15:51.359282 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.359258    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7220-139733724416592"]
Jul 17 10:15:51.381836 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.381749    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvqsj\" (UniqueName: \"kubernetes.io/projected/34da1b6b-626a-4765-ad9b-f17801811f42-kube-api-access-vvqsj\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:15:51.479474 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.479439    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7220-139733724416592"]
Jul 17 10:15:51.479819 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.479805    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef5d4af2-3d10-4373-9257-f24ac4df5973" containerName="main"
Jul 17 10:15:51.479887 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.479821    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef5d4af2-3d10-4373-9257-f24ac4df5973" containerName="main"
Jul 17 10:15:51.479887 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.479830    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34da1b6b-626a-4765-ad9b-f17801811f42" containerName="test-curl-7220-139733724416592"
Jul 17 10:15:51.479887 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.479835    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="34da1b6b-626a-4765-ad9b-f17801811f42" containerName="test-curl-7220-139733724416592"
Jul 17 10:15:51.479999 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.479897    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef5d4af2-3d10-4373-9257-f24ac4df5973" containerName="main"
Jul 17 10:15:51.479999 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.479904    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="34da1b6b-626a-4765-ad9b-f17801811f42" containerName="test-curl-7220-139733724416592"
Jul 17 10:15:51.482808 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.482765    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:51.490882 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.490812    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7220-139733724416592"]
Jul 17 10:15:51.584257 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.584220    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzjp8\" (UniqueName: \"kubernetes.io/projected/b6a338e9-e791-4b15-b133-825e34d649dd-kube-api-access-pzjp8\") pod \"test-curl-7220-139733724416592\" (UID: \"b6a338e9-e791-4b15-b133-825e34d649dd\") " pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:51.685473 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.685444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjp8\" (UniqueName: \"kubernetes.io/projected/b6a338e9-e791-4b15-b133-825e34d649dd-kube-api-access-pzjp8\") pod \"test-curl-7220-139733724416592\" (UID: \"b6a338e9-e791-4b15-b133-825e34d649dd\") " pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:51.695154 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.695110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzjp8\" (UniqueName: \"kubernetes.io/projected/b6a338e9-e791-4b15-b133-825e34d649dd-kube-api-access-pzjp8\") pod \"test-curl-7220-139733724416592\" (UID: \"b6a338e9-e791-4b15-b133-825e34d649dd\") " pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:51.794273 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.794241    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:51.943975 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:51.939351    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7220-139733724416592"]
Jul 17 10:15:51.945657 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:15:51.945631    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6a338e9_e791_4b15_b133_825e34d649dd.slice/crio-610165df0b6b617ad4a84976d9322bdbf5baf4467c641177e0afd4fdc3410e89 WatchSource:0}: Error finding container 610165df0b6b617ad4a84976d9322bdbf5baf4467c641177e0afd4fdc3410e89: Status 404 returned error can't find the container with id 610165df0b6b617ad4a84976d9322bdbf5baf4467c641177e0afd4fdc3410e89
Jul 17 10:15:52.120466 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:52.120425    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:52.120664 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:52.120466    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45669f189892e9e04679fb147fd9c6bc307624ee97ae7913a09fbdfd59d7ad33"
Jul 17 10:15:52.121815 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:52.121762    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7220-139733724416592" event={"ID":"b6a338e9-e791-4b15-b133-825e34d649dd","Type":"ContainerStarted","Data":"610165df0b6b617ad4a84976d9322bdbf5baf4467c641177e0afd4fdc3410e89"}
Jul 17 10:15:52.135066 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:52.135035    2560 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7220-139733724416592" oldPodUID="34da1b6b-626a-4765-ad9b-f17801811f42" podUID="b6a338e9-e791-4b15-b133-825e34d649dd"
Jul 17 10:15:53.128179 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:53.128147    2560 generic.go:356] "Generic (PLEG): container finished" podID="b6a338e9-e791-4b15-b133-825e34d649dd" containerID="55e27e36f81f765e365d7550414945a70d4b6a85776a22560bad3b1faf396bbd" exitCode=0
Jul 17 10:15:53.128577 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:53.128199    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7220-139733724416592" event={"ID":"b6a338e9-e791-4b15-b133-825e34d649dd","Type":"ContainerDied","Data":"55e27e36f81f765e365d7550414945a70d4b6a85776a22560bad3b1faf396bbd"}
Jul 17 10:15:53.183518 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:53.183488    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34da1b6b-626a-4765-ad9b-f17801811f42" path="/var/lib/kubelet/pods/34da1b6b-626a-4765-ad9b-f17801811f42/volumes"
Jul 17 10:15:54.280674 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:54.280651    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:54.305824 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:54.305799    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7220-139733724416592_b6a338e9-e791-4b15-b133-825e34d649dd/test-curl-7220-139733724416592/0.log"
Jul 17 10:15:54.334469 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:54.334440    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7220-139733724416592"]
Jul 17 10:15:54.335900 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:54.335879    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7220-139733724416592"]
Jul 17 10:15:54.408997 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:54.408972    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzjp8\" (UniqueName: \"kubernetes.io/projected/b6a338e9-e791-4b15-b133-825e34d649dd-kube-api-access-pzjp8\") pod \"b6a338e9-e791-4b15-b133-825e34d649dd\" (UID: \"b6a338e9-e791-4b15-b133-825e34d649dd\") "
Jul 17 10:15:54.411034 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:54.411009    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a338e9-e791-4b15-b133-825e34d649dd-kube-api-access-pzjp8" (OuterVolumeSpecName: "kube-api-access-pzjp8") pod "b6a338e9-e791-4b15-b133-825e34d649dd" (UID: "b6a338e9-e791-4b15-b133-825e34d649dd"). InnerVolumeSpecName "kube-api-access-pzjp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:15:54.510349 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:54.510303    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzjp8\" (UniqueName: \"kubernetes.io/projected/b6a338e9-e791-4b15-b133-825e34d649dd-kube-api-access-pzjp8\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:15:55.137595 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:55.137559    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:55.137791 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:55.137562    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="610165df0b6b617ad4a84976d9322bdbf5baf4467c641177e0afd4fdc3410e89"
Jul 17 10:15:55.147520 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:15:55.147493    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7220-139733724416592\" is forbidden: User \"system:node:ip-10-0-131-131.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-131.ec2.internal' and this object" podUID="b6a338e9-e791-4b15-b133-825e34d649dd" pod="opendatahub/test-curl-7220-139733724416592"
Jul 17 10:15:55.183567 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:55.183534    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6a338e9-e791-4b15-b133-825e34d649dd" path="/var/lib/kubelet/pods/b6a338e9-e791-4b15-b133-825e34d649dd/volumes"
Jul 17 10:15:55.270695 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:55.270648    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:15:55.367000 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:15:55.366956    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:05.175640 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:05.175604    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:08.944224 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:08.944189    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:16:09.656636 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:09.656603    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:15.959063 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:15.959030    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:16.059731 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:16.059702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:20.399032 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:20.398996    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:20.781685 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:20.781598    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:21.473028 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:21.472994    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:21.597150 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:21.597120    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:31.448711 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:31.448633    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:35.149575 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:35.149541    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vgs7v"]
Jul 17 10:16:35.879282 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:35.879246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:42.555915 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:42.555881    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:42.657960 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:42.657919    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:46.527445 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:46.527405    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"]
Jul 17 10:16:46.527903 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:46.527653    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy" containerID="cri-o://390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149" gracePeriod=30
Jul 17 10:16:46.558318 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:46.558285    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:46.786879 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:46.786760    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:16:46.991949 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:46.991915    2560 patch_prober.go:28] interesting pod/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 10:16:46.992149 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:46.992011    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 10:16:47.231640 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:47.231590    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-857df49f64-5fw8t_b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab/authorino/0.log"
Jul 17 10:16:51.773480 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.773454    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:16:51.933295 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933266    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b1a5841-8123-4274-b667-5fbb3f139dbc-istiod-ca-cert\") pod \"7b1a5841-8123-4274-b667-5fbb3f139dbc\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") "
Jul 17 10:16:51.933478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933318    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-certs\") pod \"7b1a5841-8123-4274-b667-5fbb3f139dbc\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") "
Jul 17 10:16:51.933478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933353    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-credential-socket\") pod \"7b1a5841-8123-4274-b667-5fbb3f139dbc\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") "
Jul 17 10:16:51.933478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933370    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-socket\") pod \"7b1a5841-8123-4274-b667-5fbb3f139dbc\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") "
Jul 17 10:16:51.933478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933388    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-podinfo\") pod \"7b1a5841-8123-4274-b667-5fbb3f139dbc\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") "
Jul 17 10:16:51.933478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933414    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqdzg\" (UniqueName: \"kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-kube-api-access-dqdzg\") pod \"7b1a5841-8123-4274-b667-5fbb3f139dbc\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") "
Jul 17 10:16:51.933478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933443    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-data\") pod \"7b1a5841-8123-4274-b667-5fbb3f139dbc\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") "
Jul 17 10:16:51.933478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933464    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-token\") pod \"7b1a5841-8123-4274-b667-5fbb3f139dbc\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") "
Jul 17 10:16:51.933887 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933495    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-envoy\") pod \"7b1a5841-8123-4274-b667-5fbb3f139dbc\" (UID: \"7b1a5841-8123-4274-b667-5fbb3f139dbc\") "
Jul 17 10:16:51.933887 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933742    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b1a5841-8123-4274-b667-5fbb3f139dbc" (UID: "7b1a5841-8123-4274-b667-5fbb3f139dbc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:16:51.933887 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933825    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b1a5841-8123-4274-b667-5fbb3f139dbc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b1a5841-8123-4274-b667-5fbb3f139dbc" (UID: "7b1a5841-8123-4274-b667-5fbb3f139dbc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:16:51.934016 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933919    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b1a5841-8123-4274-b667-5fbb3f139dbc" (UID: "7b1a5841-8123-4274-b667-5fbb3f139dbc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:16:51.934016 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.933935    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b1a5841-8123-4274-b667-5fbb3f139dbc" (UID: "7b1a5841-8123-4274-b667-5fbb3f139dbc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:16:51.934424 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.934391    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b1a5841-8123-4274-b667-5fbb3f139dbc" (UID: "7b1a5841-8123-4274-b667-5fbb3f139dbc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:16:51.935675 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.935638    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b1a5841-8123-4274-b667-5fbb3f139dbc" (UID: "7b1a5841-8123-4274-b667-5fbb3f139dbc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:16:51.935755 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.935727    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b1a5841-8123-4274-b667-5fbb3f139dbc" (UID: "7b1a5841-8123-4274-b667-5fbb3f139dbc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 10:16:51.935755 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.935740    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b1a5841-8123-4274-b667-5fbb3f139dbc" (UID: "7b1a5841-8123-4274-b667-5fbb3f139dbc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:16:51.935868 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:51.935794    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-kube-api-access-dqdzg" (OuterVolumeSpecName: "kube-api-access-dqdzg") pod "7b1a5841-8123-4274-b667-5fbb3f139dbc" (UID: "7b1a5841-8123-4274-b667-5fbb3f139dbc"). InnerVolumeSpecName "kube-api-access-dqdzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:16:52.034513 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.034482    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-certs\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:16:52.034513 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.034508    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-credential-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:16:52.034513 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.034518    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-workload-socket\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:16:52.034718 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.034527    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-podinfo\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:16:52.034718 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.034535    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqdzg\" (UniqueName: \"kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-kube-api-access-dqdzg\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:16:52.034718 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.034545    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-data\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:16:52.034718 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.034553    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-token\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:16:52.034718 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.034560    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b1a5841-8123-4274-b667-5fbb3f139dbc-istio-envoy\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:16:52.034718 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.034568    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b1a5841-8123-4274-b667-5fbb3f139dbc-istiod-ca-cert\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:16:52.402031 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.401996    2560 generic.go:356] "Generic (PLEG): container finished" podID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerID="390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149" exitCode=0
Jul 17 10:16:52.402031 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.402036    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" event={"ID":"7b1a5841-8123-4274-b667-5fbb3f139dbc","Type":"ContainerDied","Data":"390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149"}
Jul 17 10:16:52.402311 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.402058    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"
Jul 17 10:16:52.402311 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.402107    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp" event={"ID":"7b1a5841-8123-4274-b667-5fbb3f139dbc","Type":"ContainerDied","Data":"4eada4a4e1eed6488eca8c29799a95d3c6c576fbd844756aac6ab7f98dc3b303"}
Jul 17 10:16:52.402311 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.402130    2560 scope.go:117] "RemoveContainer" containerID="390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149"
Jul 17 10:16:52.411372 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.411353    2560 scope.go:117] "RemoveContainer" containerID="65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2"
Jul 17 10:16:52.419874 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.419849    2560 scope.go:117] "RemoveContainer" containerID="390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149"
Jul 17 10:16:52.420139 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:16:52.420116    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149\": container with ID starting with 390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149 not found: ID does not exist" containerID="390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149"
Jul 17 10:16:52.420229 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.420145    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149"} err="failed to get container status \"390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149\": rpc error: code = NotFound desc = could not find container \"390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149\": container with ID starting with 390a05b80d9865e3ca8489be9e96e754d3f14934960673d755e0a6b2f1ba6149 not found: ID does not exist"
Jul 17 10:16:52.420229 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.420163    2560 scope.go:117] "RemoveContainer" containerID="65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2"
Jul 17 10:16:52.420448 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:16:52.420419    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2\": container with ID starting with 65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2 not found: ID does not exist" containerID="65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2"
Jul 17 10:16:52.420498 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.420460    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2"} err="failed to get container status \"65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2\": rpc error: code = NotFound desc = could not find container \"65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2\": container with ID starting with 65699ff36b0a10902d4eef444f522de290a9ad78f7dfe4de199022b93bdce4c2 not found: ID does not exist"
Jul 17 10:16:52.428572 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.428549    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"]
Jul 17 10:16:52.434259 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:52.434238    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-8d12ab-openshift-default-867849bb87-7bhpp"]
Jul 17 10:16:53.183340 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:16:53.183305    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" path="/var/lib/kubelet/pods/7b1a5841-8123-4274-b667-5fbb3f139dbc/volumes"
Jul 17 10:17:04.002664 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.002621    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"]
Jul 17 10:17:04.003173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.003089    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy"
Jul 17 10:17:04.003173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.003108    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy"
Jul 17 10:17:04.003173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.003125    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy"
Jul 17 10:17:04.003173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.003133    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy"
Jul 17 10:17:04.003173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.003148    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a338e9-e791-4b15-b133-825e34d649dd" containerName="test-curl-7220-139733724416592"
Jul 17 10:17:04.003173 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.003157    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a338e9-e791-4b15-b133-825e34d649dd" containerName="test-curl-7220-139733724416592"
Jul 17 10:17:04.003475 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.003233    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy"
Jul 17 10:17:04.003475 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.003249    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1a5841-8123-4274-b667-5fbb3f139dbc" containerName="istio-proxy"
Jul 17 10:17:04.003475 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.003259    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a338e9-e791-4b15-b133-825e34d649dd" containerName="test-curl-7220-139733724416592"
Jul 17 10:17:04.007873 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.007850    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"
Jul 17 10:17:04.010770 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.010742    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 10:17:04.010902 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.010794    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 10:17:04.013612 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.013587    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"]
Jul 17 10:17:04.033406 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.033383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34cc9f7c-0089-46e5-9e01-7eaa7cec5952-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt\" (UID: \"34cc9f7c-0089-46e5-9e01-7eaa7cec5952\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"
Jul 17 10:17:04.134724 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.134688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34cc9f7c-0089-46e5-9e01-7eaa7cec5952-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt\" (UID: \"34cc9f7c-0089-46e5-9e01-7eaa7cec5952\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"
Jul 17 10:17:04.135305 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.135284    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34cc9f7c-0089-46e5-9e01-7eaa7cec5952-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt\" (UID: \"34cc9f7c-0089-46e5-9e01-7eaa7cec5952\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"
Jul 17 10:17:04.319454 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.319367    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"
Jul 17 10:17:04.448188 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.448160    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"]
Jul 17 10:17:04.451636 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:17:04.451607    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34cc9f7c_0089_46e5_9e01_7eaa7cec5952.slice/crio-29930369b95c11c884897be6213d7a4478277643fcb2d9b57f31b7728100599e WatchSource:0}: Error finding container 29930369b95c11c884897be6213d7a4478277643fcb2d9b57f31b7728100599e: Status 404 returned error can't find the container with id 29930369b95c11c884897be6213d7a4478277643fcb2d9b57f31b7728100599e
Jul 17 10:17:04.948833 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.948746    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76fdbb8988-tjpnz_9c5a9c54-1aba-49a0-a72a-bd19a512920e/copy-manifests/0.log"
Jul 17 10:17:04.961347 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:04.961325    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76fdbb8988-tjpnz_9c5a9c54-1aba-49a0-a72a-bd19a512920e/manager/0.log"
Jul 17 10:17:05.466264 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:05.466226    2560 generic.go:356] "Generic (PLEG): container finished" podID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerID="aba8405f51b8a8deaf3eb73caebe44118c1140af9939e55d12d5aa29d82e80e9" exitCode=6
Jul 17 10:17:05.466621 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:05.466285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt" event={"ID":"34cc9f7c-0089-46e5-9e01-7eaa7cec5952","Type":"ContainerDied","Data":"aba8405f51b8a8deaf3eb73caebe44118c1140af9939e55d12d5aa29d82e80e9"}
Jul 17 10:17:05.466621 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:05.466363    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt" event={"ID":"34cc9f7c-0089-46e5-9e01-7eaa7cec5952","Type":"ContainerStarted","Data":"29930369b95c11c884897be6213d7a4478277643fcb2d9b57f31b7728100599e"}
Jul 17 10:17:05.466621 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:05.466551    2560 scope.go:117] "RemoveContainer" containerID="aba8405f51b8a8deaf3eb73caebe44118c1140af9939e55d12d5aa29d82e80e9"
Jul 17 10:17:05.980976 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:05.980946    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-439eab-55f97_d92f1989-cb75-4196-a4dc-9faf33831b7a/revoke-keys/0.log"
Jul 17 10:17:06.100877 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:06.100856    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt_34cc9f7c-0089-46e5-9e01-7eaa7cec5952/revoke-keys/0.log"
Jul 17 10:17:06.472048 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:06.472017    2560 generic.go:356] "Generic (PLEG): container finished" podID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerID="4833f005c977906ce89500fc863d6d1ed1870db73cb040efc60afd85234d98be" exitCode=6
Jul 17 10:17:06.472478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:06.472066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt" event={"ID":"34cc9f7c-0089-46e5-9e01-7eaa7cec5952","Type":"ContainerDied","Data":"4833f005c977906ce89500fc863d6d1ed1870db73cb040efc60afd85234d98be"}
Jul 17 10:17:06.472478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:06.472113    2560 scope.go:117] "RemoveContainer" containerID="aba8405f51b8a8deaf3eb73caebe44118c1140af9939e55d12d5aa29d82e80e9"
Jul 17 10:17:06.472478 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:06.472258    2560 scope.go:117] "RemoveContainer" containerID="4833f005c977906ce89500fc863d6d1ed1870db73cb040efc60afd85234d98be"
Jul 17 10:17:06.472599 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:17:06.472504    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt_odh-ai-gateway-infra(34cc9f7c-0089-46e5-9e01-7eaa7cec5952)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952"
Jul 17 10:17:07.477654 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:07.477629    2560 scope.go:117] "RemoveContainer" containerID="4833f005c977906ce89500fc863d6d1ed1870db73cb040efc60afd85234d98be"
Jul 17 10:17:07.478159 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:17:07.477899    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt_odh-ai-gateway-infra(34cc9f7c-0089-46e5-9e01-7eaa7cec5952)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952"
Jul 17 10:17:08.108489 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:08.108461    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-857df49f64-5fw8t_b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab/authorino/0.log"
Jul 17 10:17:08.558099 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:08.558068    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-98nns_8177e619-4d07-4178-933c-119b9119bbcc/registry-server/0.log"
Jul 17 10:17:08.670601 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:08.670570    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-m8dql_5df833c0-a751-4bc6-ab22-cf8189d3d119/manager/0.log"
Jul 17 10:17:08.773142 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:08.773115    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vgs7v_de9d0914-fc96-444c-89f9-3c8c359db686/limitador/0.log"
Jul 17 10:17:08.887771 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:08.887741    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7gfhj_50b215b9-6384-41a8-beb9-6e2446c84b92/manager/0.log"
Jul 17 10:17:09.685059 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:09.685032    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fhm4m_591010c8-b78d-46a5-b828-05ecf61a7429/istio-proxy/1.log"
Jul 17 10:17:10.034325 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:10.034239    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-94f5866d8-7xccq_d08ee435-02c4-433f-bc34-2cd946ce6b63/router/0.log"
Jul 17 10:17:10.374042 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:10.373959    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-tgtt9_4293bab8-dc3c-48c4-b091-151c60619cd2/main/0.log"
Jul 17 10:17:16.241969 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:16.241932    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"]
Jul 17 10:17:16.245146 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:16.245128    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"
Jul 17 10:17:16.262327 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:16.262304    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"]
Jul 17 10:17:16.335016 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:16.334988    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a78cb39-f86e-4dda-be86-227e15552e23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr\" (UID: \"7a78cb39-f86e-4dda-be86-227e15552e23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"
Jul 17 10:17:16.436141 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:16.436109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a78cb39-f86e-4dda-be86-227e15552e23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr\" (UID: \"7a78cb39-f86e-4dda-be86-227e15552e23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"
Jul 17 10:17:16.436701 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:16.436680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a78cb39-f86e-4dda-be86-227e15552e23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr\" (UID: \"7a78cb39-f86e-4dda-be86-227e15552e23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"
Jul 17 10:17:16.554681 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:16.554559    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"
Jul 17 10:17:16.888196 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:16.888167    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"]
Jul 17 10:17:16.890696 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:17:16.890669    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a78cb39_f86e_4dda_be86_227e15552e23.slice/crio-624b60019c935fbfc73b654f0bf95880d817a3b34acc2ae10ed873723e876189 WatchSource:0}: Error finding container 624b60019c935fbfc73b654f0bf95880d817a3b34acc2ae10ed873723e876189: Status 404 returned error can't find the container with id 624b60019c935fbfc73b654f0bf95880d817a3b34acc2ae10ed873723e876189
Jul 17 10:17:17.521755 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:17.521663    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr" event={"ID":"7a78cb39-f86e-4dda-be86-227e15552e23","Type":"ContainerStarted","Data":"3617b6b0b41698d2778ff240b424c60492057ce6e54d963d2a79e704dfe39f4d"}
Jul 17 10:17:17.521755 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:17.521718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr" event={"ID":"7a78cb39-f86e-4dda-be86-227e15552e23","Type":"ContainerStarted","Data":"624b60019c935fbfc73b654f0bf95880d817a3b34acc2ae10ed873723e876189"}
Jul 17 10:17:17.544190 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:17.544134    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr" podStartSLOduration=1.544119576 podStartE2EDuration="1.544119576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:17:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:17:17.542141348 +0000 UTC m=+3557.033835753" watchObservedRunningTime="2026-07-17 10:17:17.544119576 +0000 UTC m=+3557.035813982"
Jul 17 10:17:17.863054 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:17.862959    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:17:17.937295 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:17.937246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log" limit=1024
Jul 17 10:17:18.528197 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:18.528161    2560 generic.go:356] "Generic (PLEG): container finished" podID="7a78cb39-f86e-4dda-be86-227e15552e23" containerID="3617b6b0b41698d2778ff240b424c60492057ce6e54d963d2a79e704dfe39f4d" exitCode=6
Jul 17 10:17:18.528649 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:18.528232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr" event={"ID":"7a78cb39-f86e-4dda-be86-227e15552e23","Type":"ContainerDied","Data":"3617b6b0b41698d2778ff240b424c60492057ce6e54d963d2a79e704dfe39f4d"}
Jul 17 10:17:18.528649 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:18.528462    2560 scope.go:117] "RemoveContainer" containerID="3617b6b0b41698d2778ff240b424c60492057ce6e54d963d2a79e704dfe39f4d"
Jul 17 10:17:19.534323 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:19.534288    2560 generic.go:356] "Generic (PLEG): container finished" podID="7a78cb39-f86e-4dda-be86-227e15552e23" containerID="ae0470686ffdafaed44a4c7ea30a7fe3fd01eb622192d5f78d8df5df1fd889c1" exitCode=6
Jul 17 10:17:19.534788 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:19.534327    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr" event={"ID":"7a78cb39-f86e-4dda-be86-227e15552e23","Type":"ContainerDied","Data":"ae0470686ffdafaed44a4c7ea30a7fe3fd01eb622192d5f78d8df5df1fd889c1"}
Jul 17 10:17:19.534788 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:19.534373    2560 scope.go:117] "RemoveContainer" containerID="3617b6b0b41698d2778ff240b424c60492057ce6e54d963d2a79e704dfe39f4d"
Jul 17 10:17:19.534788 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:19.534567    2560 scope.go:117] "RemoveContainer" containerID="ae0470686ffdafaed44a4c7ea30a7fe3fd01eb622192d5f78d8df5df1fd889c1"
Jul 17 10:17:19.534949 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:17:19.534803    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr_odh-ai-gateway-infra(7a78cb39-f86e-4dda-be86-227e15552e23)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr" podUID="7a78cb39-f86e-4dda-be86-227e15552e23"
Jul 17 10:17:20.178315 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:20.178291    2560 scope.go:117] "RemoveContainer" containerID="4833f005c977906ce89500fc863d6d1ed1870db73cb040efc60afd85234d98be"
Jul 17 10:17:20.540998 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:20.540965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt" event={"ID":"34cc9f7c-0089-46e5-9e01-7eaa7cec5952","Type":"ContainerStarted","Data":"07447c40f76da29429aa7133290e499b95e6b5f42cbd35e1e2940865d5696479"}
Jul 17 10:17:20.542518 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:20.542500    2560 scope.go:117] "RemoveContainer" containerID="ae0470686ffdafaed44a4c7ea30a7fe3fd01eb622192d5f78d8df5df1fd889c1"
Jul 17 10:17:20.542672 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:17:20.542655    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr_odh-ai-gateway-infra(7a78cb39-f86e-4dda-be86-227e15552e23)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr" podUID="7a78cb39-f86e-4dda-be86-227e15552e23"
Jul 17 10:17:20.561243 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:20.561198    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt" podStartSLOduration=17.56118418 podStartE2EDuration="17.56118418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:17:20.560450699 +0000 UTC m=+3560.052145104" watchObservedRunningTime="2026-07-17 10:17:20.56118418 +0000 UTC m=+3560.052878586"
Jul 17 10:17:20.885401 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:20.885375    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zrdcn_e26a86fd-e979-4246-af0d-5881142edd51/global-pull-secret-syncer/0.log"
Jul 17 10:17:20.938584 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:20.938555    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5dt7g_8c8e2ec5-68c6-43df-87e9-b6100da255e6/konnectivity-agent/0.log"
Jul 17 10:17:21.054921 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:21.054847    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-131.ec2.internal_1b15db55deb2124b8d29985bc300252e/haproxy/0.log"
Jul 17 10:17:21.548916 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:21.548884    2560 generic.go:356] "Generic (PLEG): container finished" podID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerID="07447c40f76da29429aa7133290e499b95e6b5f42cbd35e1e2940865d5696479" exitCode=6
Jul 17 10:17:21.549380 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:21.548958    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt" event={"ID":"34cc9f7c-0089-46e5-9e01-7eaa7cec5952","Type":"ContainerDied","Data":"07447c40f76da29429aa7133290e499b95e6b5f42cbd35e1e2940865d5696479"}
Jul 17 10:17:21.549380 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:21.549015    2560 scope.go:117] "RemoveContainer" containerID="4833f005c977906ce89500fc863d6d1ed1870db73cb040efc60afd85234d98be"
Jul 17 10:17:21.549380 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:21.549274    2560 scope.go:117] "RemoveContainer" containerID="07447c40f76da29429aa7133290e499b95e6b5f42cbd35e1e2940865d5696479"
Jul 17 10:17:21.549505 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:17:21.549477    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt_odh-ai-gateway-infra(34cc9f7c-0089-46e5-9e01-7eaa7cec5952)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952"
Jul 17 10:17:21.584197 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:21.584170    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"]
Jul 17 10:17:22.685908 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:22.685882    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"
Jul 17 10:17:22.794043 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:22.794013    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34cc9f7c-0089-46e5-9e01-7eaa7cec5952-maas-api-service-ca\") pod \"34cc9f7c-0089-46e5-9e01-7eaa7cec5952\" (UID: \"34cc9f7c-0089-46e5-9e01-7eaa7cec5952\") "
Jul 17 10:17:22.794423 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:22.794397    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34cc9f7c-0089-46e5-9e01-7eaa7cec5952-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "34cc9f7c-0089-46e5-9e01-7eaa7cec5952" (UID: "34cc9f7c-0089-46e5-9e01-7eaa7cec5952"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:17:22.895003 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:22.894969    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34cc9f7c-0089-46e5-9e01-7eaa7cec5952-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:17:23.560565 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:23.560477    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt" event={"ID":"34cc9f7c-0089-46e5-9e01-7eaa7cec5952","Type":"ContainerDied","Data":"29930369b95c11c884897be6213d7a4478277643fcb2d9b57f31b7728100599e"}
Jul 17 10:17:23.560565 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:23.560535    2560 scope.go:117] "RemoveContainer" containerID="07447c40f76da29429aa7133290e499b95e6b5f42cbd35e1e2940865d5696479"
Jul 17 10:17:23.560772 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:23.560490    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"
Jul 17 10:17:23.581058 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:23.581032    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"]
Jul 17 10:17:23.585669 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:23.585646    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5593c7b6-45rpt"]
Jul 17 10:17:25.183864 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:25.183837    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" path="/var/lib/kubelet/pods/34cc9f7c-0089-46e5-9e01-7eaa7cec5952/volumes"
Jul 17 10:17:26.744926 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:26.744893    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-857df49f64-5fw8t_b4d0aafe-fd68-426c-aaf9-8e9b16ee5bab/authorino/0.log"
Jul 17 10:17:26.902141 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:26.902114    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-98nns_8177e619-4d07-4178-933c-119b9119bbcc/registry-server/0.log"
Jul 17 10:17:27.008257 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:27.008177    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-m8dql_5df833c0-a751-4bc6-ab22-cf8189d3d119/manager/0.log"
Jul 17 10:17:27.061724 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:27.061695    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vgs7v_de9d0914-fc96-444c-89f9-3c8c359db686/limitador/0.log"
Jul 17 10:17:27.128392 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:27.128364    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7gfhj_50b215b9-6384-41a8-beb9-6e2446c84b92/manager/0.log"
Jul 17 10:17:29.198551 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:29.198523    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfvc2_57076e0a-0568-416f-8496-dbf63d5c01e2/node-exporter/0.log"
Jul 17 10:17:29.223349 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:29.223326    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfvc2_57076e0a-0568-416f-8496-dbf63d5c01e2/kube-rbac-proxy/0.log"
Jul 17 10:17:29.246892 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:29.246866    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfvc2_57076e0a-0568-416f-8496-dbf63d5c01e2/init-textfile/0.log"
Jul 17 10:17:29.377888 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:29.377861    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec/prometheus/0.log"
Jul 17 10:17:29.405123 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:29.405086    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec/config-reloader/0.log"
Jul 17 10:17:29.431950 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:29.431924    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec/thanos-sidecar/0.log"
Jul 17 10:17:29.455090 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:29.455020    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec/kube-rbac-proxy-web/0.log"
Jul 17 10:17:29.485828 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:29.485802    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec/kube-rbac-proxy/0.log"
Jul 17 10:17:29.516295 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:29.516269    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec/kube-rbac-proxy-thanos/0.log"
Jul 17 10:17:29.538972 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:29.538951    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe57f93b-7dc3-49bf-8335-a44c0fcdc1ec/init-config-reloader/0.log"
Jul 17 10:17:30.529921 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.529884    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"]
Jul 17 10:17:30.530316 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.530183    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerName="revoke-keys"
Jul 17 10:17:30.530316 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.530195    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerName="revoke-keys"
Jul 17 10:17:30.530316 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.530204    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerName="revoke-keys"
Jul 17 10:17:30.530316 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.530210    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerName="revoke-keys"
Jul 17 10:17:30.530316 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.530268    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerName="revoke-keys"
Jul 17 10:17:30.530316 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.530279    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerName="revoke-keys"
Jul 17 10:17:30.534489 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.534467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.538059 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.538036    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z5nh8\"/\"default-dockercfg-qnv6m\""
Jul 17 10:17:30.538147 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.538126    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z5nh8\"/\"kube-root-ca.crt\""
Jul 17 10:17:30.538945 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.538932    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z5nh8\"/\"openshift-service-ca.crt\""
Jul 17 10:17:30.546960 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.546940    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"]
Jul 17 10:17:30.660210 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.660176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-podres\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.660433 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.660262    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-lib-modules\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.660433 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.660303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j28rq\" (UniqueName: \"kubernetes.io/projected/01a77095-b938-4564-b2b9-b48ec196c2f0-kube-api-access-j28rq\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.660433 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.660344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-proc\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.660433 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.660367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-sys\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.760997 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.760960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-proc\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.760997 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.760997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-sys\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.761226 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.761031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-podres\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.761226 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.761095    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-proc\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.761226 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.761115    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-sys\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.761226 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.761120    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-lib-modules\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.761226 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.761174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j28rq\" (UniqueName: \"kubernetes.io/projected/01a77095-b938-4564-b2b9-b48ec196c2f0-kube-api-access-j28rq\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.761409 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.761225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-podres\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.761409 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.761286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01a77095-b938-4564-b2b9-b48ec196c2f0-lib-modules\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.783936 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.783867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j28rq\" (UniqueName: \"kubernetes.io/projected/01a77095-b938-4564-b2b9-b48ec196c2f0-kube-api-access-j28rq\") pod \"perf-node-gather-daemonset-j8ksp\" (UID: \"01a77095-b938-4564-b2b9-b48ec196c2f0\") " pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.844165 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.844137    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:30.983572 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:30.983544    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"]
Jul 17 10:17:30.986144 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:17:30.986114    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod01a77095_b938_4564_b2b9_b48ec196c2f0.slice/crio-41248251e6135a64793853a7ec74cfa898e9b610f3d66da053f6dc50605f02a0 WatchSource:0}: Error finding container 41248251e6135a64793853a7ec74cfa898e9b610f3d66da053f6dc50605f02a0: Status 404 returned error can't find the container with id 41248251e6135a64793853a7ec74cfa898e9b610f3d66da053f6dc50605f02a0
Jul 17 10:17:31.597023 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:31.596986    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp" event={"ID":"01a77095-b938-4564-b2b9-b48ec196c2f0","Type":"ContainerStarted","Data":"64b43210d5a30e504b28356859bd952562e00768de1561ff990f9e01aec98428"}
Jul 17 10:17:31.597523 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:31.597043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp" event={"ID":"01a77095-b938-4564-b2b9-b48ec196c2f0","Type":"ContainerStarted","Data":"41248251e6135a64793853a7ec74cfa898e9b610f3d66da053f6dc50605f02a0"}
Jul 17 10:17:31.597523 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:31.597129    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:32.178506 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:32.178472    2560 scope.go:117] "RemoveContainer" containerID="ae0470686ffdafaed44a4c7ea30a7fe3fd01eb622192d5f78d8df5df1fd889c1"
Jul 17 10:17:32.304465 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:32.304437    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-558879fd98-jvfgv_dd88825f-c15c-404e-b0ac-cef6fa65f79a/console/0.log"
Jul 17 10:17:32.603485 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:32.603450    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr" event={"ID":"7a78cb39-f86e-4dda-be86-227e15552e23","Type":"ContainerStarted","Data":"1cc714b986da86e661a7951d0d1aa4097d376ddd218ca6dc69b57a46b79e6d8a"}
Jul 17 10:17:32.627260 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:32.627208    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp" podStartSLOduration=2.627194125 podStartE2EDuration="2.627194125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:17:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:17:31.633314568 +0000 UTC m=+3571.125008973" watchObservedRunningTime="2026-07-17 10:17:32.627194125 +0000 UTC m=+3572.118888531"
Jul 17 10:17:33.609687 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:33.609650    2560 generic.go:356] "Generic (PLEG): container finished" podID="7a78cb39-f86e-4dda-be86-227e15552e23" containerID="1cc714b986da86e661a7951d0d1aa4097d376ddd218ca6dc69b57a46b79e6d8a" exitCode=6
Jul 17 10:17:33.609687 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:33.609689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr" event={"ID":"7a78cb39-f86e-4dda-be86-227e15552e23","Type":"ContainerDied","Data":"1cc714b986da86e661a7951d0d1aa4097d376ddd218ca6dc69b57a46b79e6d8a"}
Jul 17 10:17:33.610257 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:33.609737    2560 scope.go:117] "RemoveContainer" containerID="ae0470686ffdafaed44a4c7ea30a7fe3fd01eb622192d5f78d8df5df1fd889c1"
Jul 17 10:17:33.610257 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:33.610070    2560 scope.go:117] "RemoveContainer" containerID="1cc714b986da86e661a7951d0d1aa4097d376ddd218ca6dc69b57a46b79e6d8a"
Jul 17 10:17:33.610365 ip-10-0-131-131 kubenswrapper[2560]: E0717 10:17:33.610314    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr_odh-ai-gateway-infra(7a78cb39-f86e-4dda-be86-227e15552e23)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr" podUID="7a78cb39-f86e-4dda-be86-227e15552e23"
Jul 17 10:17:33.637127 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:33.637088    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"]
Jul 17 10:17:34.300720 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:34.300694    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sx2fn_a17822fc-0486-4589-8572-77562adfcfe5/dns/0.log"
Jul 17 10:17:34.328489 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:34.328466    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sx2fn_a17822fc-0486-4589-8572-77562adfcfe5/kube-rbac-proxy/0.log"
Jul 17 10:17:34.359985 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:34.359960    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gcl4j_86eae500-f996-4f04-9792-5a5af6c9c893/dns-node-resolver/0.log"
Jul 17 10:17:34.741351 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:34.741324    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"
Jul 17 10:17:34.900922 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:34.900896    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a78cb39-f86e-4dda-be86-227e15552e23-maas-api-service-ca\") pod \"7a78cb39-f86e-4dda-be86-227e15552e23\" (UID: \"7a78cb39-f86e-4dda-be86-227e15552e23\") "
Jul 17 10:17:34.901256 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:34.901233    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a78cb39-f86e-4dda-be86-227e15552e23-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7a78cb39-f86e-4dda-be86-227e15552e23" (UID: "7a78cb39-f86e-4dda-be86-227e15552e23"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:17:35.001804 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:35.001756    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a78cb39-f86e-4dda-be86-227e15552e23-maas-api-service-ca\") on node \"ip-10-0-131-131.ec2.internal\" DevicePath \"\""
Jul 17 10:17:35.095135 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:35.095097    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mgltv_84807261-d1ec-4148-9c9c-776f43fdd74a/node-ca/0.log"
Jul 17 10:17:35.621959 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:35.621880    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"
Jul 17 10:17:35.621959 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:35.621895    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr" event={"ID":"7a78cb39-f86e-4dda-be86-227e15552e23","Type":"ContainerDied","Data":"624b60019c935fbfc73b654f0bf95880d817a3b34acc2ae10ed873723e876189"}
Jul 17 10:17:35.621959 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:35.621951    2560 scope.go:117] "RemoveContainer" containerID="1cc714b986da86e661a7951d0d1aa4097d376ddd218ca6dc69b57a46b79e6d8a"
Jul 17 10:17:35.638310 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:35.638288    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"]
Jul 17 10:17:35.642082 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:35.642056    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8f9d7266-tzqtr"]
Jul 17 10:17:36.438603 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:36.438571    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fhm4m_591010c8-b78d-46a5-b828-05ecf61a7429/istio-proxy/0.log"
Jul 17 10:17:36.469471 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:36.469445    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fhm4m_591010c8-b78d-46a5-b828-05ecf61a7429/istio-proxy/1.log"
Jul 17 10:17:36.583666 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:36.583620    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-94f5866d8-7xccq_d08ee435-02c4-433f-bc34-2cd946ce6b63/router/0.log"
Jul 17 10:17:37.183592 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:37.183556    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a78cb39-f86e-4dda-be86-227e15552e23" path="/var/lib/kubelet/pods/7a78cb39-f86e-4dda-be86-227e15552e23/volumes"
Jul 17 10:17:37.364025 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:37.363996    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tn85c_545402ad-c7ce-44e3-b164-b2d91e838e53/serve-healthcheck-canary/0.log"
Jul 17 10:17:37.613134 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:37.613057    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z5nh8/perf-node-gather-daemonset-j8ksp"
Jul 17 10:17:38.051608 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:38.051579    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trsvf_c4e3b967-e7df-41f0-a07b-4a09c859209a/kube-rbac-proxy/0.log"
Jul 17 10:17:38.079864 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:38.079838    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trsvf_c4e3b967-e7df-41f0-a07b-4a09c859209a/exporter/0.log"
Jul 17 10:17:38.106948 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:38.106921    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-trsvf_c4e3b967-e7df-41f0-a07b-4a09c859209a/extractor/0.log"
Jul 17 10:17:41.350725 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:41.350689    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fhm4m_591010c8-b78d-46a5-b828-05ecf61a7429/istio-proxy/0.log"
Jul 17 10:17:41.387048 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:41.387011    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fhm4m_591010c8-b78d-46a5-b828-05ecf61a7429/istio-proxy/1.log"
Jul 17 10:17:41.432635 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:41.432599    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76fdbb8988-tjpnz_9c5a9c54-1aba-49a0-a72a-bd19a512920e/manager/0.log"
Jul 17 10:17:41.451510 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:41.451488    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76fdbb8988-tjpnz_9c5a9c54-1aba-49a0-a72a-bd19a512920e/copy-manifests/0.log"
Jul 17 10:17:41.461952 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:41.461912    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-94f5866d8-7xccq_d08ee435-02c4-433f-bc34-2cd946ce6b63/router/0.log"
Jul 17 10:17:42.976820 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:42.976772    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7dd756d967-46l2f_f3ab21e9-34d4-46c3-9e8f-4cb22274a8ba/manager/0.log"
Jul 17 10:17:43.321436 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:43.321333    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fhm4m_591010c8-b78d-46a5-b828-05ecf61a7429/istio-proxy/0.log"
Jul 17 10:17:43.351892 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:43.351857    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-fhm4m_591010c8-b78d-46a5-b828-05ecf61a7429/istio-proxy/1.log"
Jul 17 10:17:43.434626 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:43.434597    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-94f5866d8-7xccq_d08ee435-02c4-433f-bc34-2cd946ce6b63/router/0.log"
Jul 17 10:17:46.583447 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.583374    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp"]
Jul 17 10:17:46.583814 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.583707    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a78cb39-f86e-4dda-be86-227e15552e23" containerName="revoke-keys"
Jul 17 10:17:46.583814 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.583719    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a78cb39-f86e-4dda-be86-227e15552e23" containerName="revoke-keys"
Jul 17 10:17:46.583814 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.583740    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a78cb39-f86e-4dda-be86-227e15552e23" containerName="revoke-keys"
Jul 17 10:17:46.583814 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.583745    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a78cb39-f86e-4dda-be86-227e15552e23" containerName="revoke-keys"
Jul 17 10:17:46.583814 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.583752    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerName="revoke-keys"
Jul 17 10:17:46.583814 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.583758    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerName="revoke-keys"
Jul 17 10:17:46.584006 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.583845    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="34cc9f7c-0089-46e5-9e01-7eaa7cec5952" containerName="revoke-keys"
Jul 17 10:17:46.584006 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.583854    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a78cb39-f86e-4dda-be86-227e15552e23" containerName="revoke-keys"
Jul 17 10:17:46.584006 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.583861    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a78cb39-f86e-4dda-be86-227e15552e23" containerName="revoke-keys"
Jul 17 10:17:46.592364 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.592336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp"
Jul 17 10:17:46.596086 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.596060    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8lndl\""
Jul 17 10:17:46.596863 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.596840    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 10:17:46.598138 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.598114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp"]
Jul 17 10:17:46.599092 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.599066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80e2246-4183-4cb3-aa81-a6dc4678c1c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp\" (UID: \"a80e2246-4183-4cb3-aa81-a6dc4678c1c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp"
Jul 17 10:17:46.699812 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.699766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80e2246-4183-4cb3-aa81-a6dc4678c1c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp\" (UID: \"a80e2246-4183-4cb3-aa81-a6dc4678c1c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp"
Jul 17 10:17:46.700414 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.700393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80e2246-4183-4cb3-aa81-a6dc4678c1c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp\" (UID: \"a80e2246-4183-4cb3-aa81-a6dc4678c1c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp"
Jul 17 10:17:46.904262 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:46.904228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp"
Jul 17 10:17:47.043833 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:47.043805    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp"]
Jul 17 10:17:47.046376 ip-10-0-131-131 kubenswrapper[2560]: W0717 10:17:47.046348    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80e2246_4183_4cb3_aa81_a6dc4678c1c7.slice/crio-e379ab0e1d78e08fb8b7cfed0bd4c2779cac87183d76b74351a6e754260e056a WatchSource:0}: Error finding container e379ab0e1d78e08fb8b7cfed0bd4c2779cac87183d76b74351a6e754260e056a: Status 404 returned error can't find the container with id e379ab0e1d78e08fb8b7cfed0bd4c2779cac87183d76b74351a6e754260e056a
Jul 17 10:17:47.677964 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:47.677922    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp" event={"ID":"a80e2246-4183-4cb3-aa81-a6dc4678c1c7","Type":"ContainerStarted","Data":"a395a0d1677491bb90d776c4ad83fcfef5cdabea55502c0ede2370adc5276187"}
Jul 17 10:17:47.678336 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:47.677987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp" event={"ID":"a80e2246-4183-4cb3-aa81-a6dc4678c1c7","Type":"ContainerStarted","Data":"e379ab0e1d78e08fb8b7cfed0bd4c2779cac87183d76b74351a6e754260e056a"}
Jul 17 10:17:47.699187 ip-10-0-131-131 kubenswrapper[2560]: I0717 10:17:47.699142    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f15c7b6a-mqtbp" podStartSLOduration=1.6991279609999999 podStartE2EDuration="1.699127961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:17:47.697984868 +0000 UTC m=+3587.189679273" watchObservedRunningTime="2026-07-17 10:17:47.699127961 +0000 UTC m=+3587.190822367"